"llm infrastructure" Jobs

549 open tech roles matching “llm infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, Kubernetes. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 549 results

Abridge

Join Abridge as a Machine Learning Infrastructure Engineer to optimize AI model inference infrastructure in a fast-paced healthcare startup.

Abridge SF Office Published 1 year ago
Flexible on stack
Vals AI

Join Vals AI as a researcher to design and build next-gen AI benchmarks in a fast-paced, innovative environment.

Vals AI San Francisco, United States Published 2 months ago
Flexible on stack
Sesame

Join Sesame as an ML Model Serving Engineer to enhance our serving layer for voice agents with cutting-edge techniques.

Sesame San Francisco Published 1 year ago
Flexible on stack
Reflection AI

Join Reflection AI as a Forward Deployed Engineer to fine-tune models and work directly with enterprise customers in a dynamic startup environment.

Reflection AI San Francisco, CA Published 4 months ago
Lightfield

Join Lightfield as a Staff Software Engineer to architect and scale the infrastructure for an AI-driven CRM in a fast-paced environment.

Lightfield HQ: San Francisco Published 1 year ago
Flexible on stack 60% coding
baseten

Lead and mentor a team of Forward Deployed Engineers to optimize LLM inference workloads for Baseten customers.

baseten San Francisco Published 4 months ago
Flexible on stack Heavy meetings
Databricks

Join Databricks as a Staff Software Engineer to build LLM infrastructure for large-scale AI inference workloads.

Databricks San Francisco, California $190k–$265k/yr Published 1 month ago
Langfuse

Join Langfuse as a Developer Relations Engineer to enhance community engagement and represent the company at key events across Europe and the US.

Langfuse Europe or US Published 1 month ago
Flexible on stack
Vals AI

Join Vals AI as an Evaluations Engineer to evaluate LLM models and contribute to industry-leading benchmarks.

Vals AI San Francisco, United States Published 2 months ago
Flexible on stack
Perplexity AI

Join Perplexity AI as an AI Infrastructure Engineer to design and optimize large-scale AI training and inference clusters.

Perplexity AI San Francisco Published 5 months ago
Flexible on stack
MaintainX

Lead the technical direction for predictive maintenance and asset intelligence initiatives at MaintainX, leveraging deep ML expertise.

MaintainX San Francisco Published 1 month ago
Flexible on stack
TRM Labs

Join TRM Labs as a Senior Software Engineer to build scalable data solutions for blockchain transaction analysis.

TRM Labs San Francisco, CA $190k–$220k/yr Published 2 weeks ago
Flexible on stack
TRM Labs

Join TRM Labs as a Senior Software Engineer to design scalable data services for blockchain transaction analysis.

TRM Labs San Francisco, United States $190k–$220k/yr Published 2 days ago
Flexible on stack AI-first team
Databricks

Join Databricks as a Staff Software Engineer to build LLM infrastructure for large-scale AI workloads.

Databricks San Francisco, California $190k–$265k/yr Published 1 month ago
Flexible on stack
Harvey AI

Join Harvey as a Staff Product Manager to shape the infrastructure of a leading legal AI platform with a focus on reliability and scalability.

Harvey AI San Francisco $213.6k–$300k/yr Published 2 months ago
AI-first team
Datadog
Datadog Boston, Massachusetts, USA; Denver, Colorado, USA; New York, New York, USA; San Francisco, California, USA $151.5k–$222k/yr Published 6 months ago