"llm infrastructure" Jobs

734 open tech roles matching “llm infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, Kubernetes. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 734 results

Hippocratic AI

Own the serving infrastructure for healthcare AI, optimizing LLM inference systems to enhance patient experiences.

Hippocratic AI Menlo Park, CA Published 3 weeks ago
Flexible on stack
Preference Model

Join Preference Model as a Senior ML Infrastructure Engineer to build scalable infrastructure for post-training research on large language models.

Preference Model San Francisco, United States Published 1 day ago
Flexible on stack
Preference Model

Join Preference Model as a Senior ML Infrastructure Engineer to build scalable infrastructure for post-training research on large language models.

Preference Model San Francisco Published 3 days ago
Flexible on stack
Langfuse

Join Langfuse as a Senior Cloud Infrastructure Engineer to manage and scale cloud operations for a leading open-source AI platform.

Langfuse Europe Published 3 months ago
Flexible on stack
Braintrust Data

Join Braintrust as a backend engineer to build infrastructure for cutting-edge AI development tools in a fast-paced environment.

Braintrust Data San Francisco Published 1 month ago
Flexible on stack
Langfuse

Join Langfuse as a Senior Backend Engineer to optimize data infrastructure for a leading open-source LLM engineering platform.

Langfuse Europe Published 6 months ago
Flexible on stack
Periodic Labs

Join Periodic Labs as an ML Systems Engineer to build and optimize large-scale training and reinforcement learning infrastructure.

Periodic Labs Menlo Park, CA $250k–$350k/yr Published 4 months ago
Flexible on stack
Abridge

Join Abridge as a Machine Learning Infrastructure Engineer to optimize AI model inference infrastructure in a fast-paced healthcare startup.

Abridge SF Office Published 1 year ago
Flexible on stack
Doctronic

Join Doctronic as a DevOps Engineer to own and enhance our infrastructure for AI-driven healthcare solutions.

Doctronic New York City $180k–$240k/yr Published 2 months ago
70% coding
Sesame

Join Sesame as an ML Model Serving Engineer to enhance our serving layer for voice agents with cutting-edge techniques.

Sesame San Francisco Published 1 year ago
Flexible on stack
Ambient

Design and optimize AI infrastructure for real-time intelligence at Ambient.ai, enhancing security through advanced AI models.

Ambient Redwood City Published 2 months ago
Flexible on stack 70% coding
TRM Labs

Join TRM Labs as a Senior Software Engineer to build scalable data solutions for blockchain transaction analysis.

TRM Labs United States $190k–$220k/yr Published 5 months ago
Flexible on stack
Langfuse

Join Langfuse as a Senior Product Engineer to build impactful open-source AI applications in a small, dynamic team.

Langfuse Europe Published 6 months ago
Flexible on stack
TRM Labs

Join TRM Labs as a Senior Agent Engineer to build AI-powered solutions for crime investigation in a fully remote environment.

TRM Labs United States $200k–$275k/yr Published 7 months ago
Flexible on stack
Notable

Join Notable as a Senior AI Platform Engineer to design and maintain LLM integrations that enhance healthcare AI solutions.

Notable San Mateo, CA Published 3 months ago
Flexible on stack
MaintainX

Lead the technical direction for predictive maintenance and asset intelligence initiatives at MaintainX, leveraging deep ML expertise.

MaintainX San Francisco Published 1 month ago
Flexible on stack