"inference infrastructure" Jobs

1154 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, Kubernetes. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 1154 results

Anthropic

Lead a team of engineers to optimize Anthropic's inference infrastructure for AI systems.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$625k/yr Published 2 months ago
Flexible on stack Heavy meetings
Cartesia

Join Cartesia as an Inference Engineer to design and build low latency, scalable model inference for cutting-edge AI applications.

Cartesia *HQ - San Francisco, CA Published 1 year ago
Flexible on stack
Anthropic

Join Anthropic's Inference team to build and maintain systems that serve AI models to millions of users worldwide.

Anthropic Ontario, CAN Published 3 months ago
Flexible on stack
Abridge

Join Abridge as a Machine Learning Infrastructure Engineer to optimize AI model inference infrastructure in a fast-paced healthcare startup.

Abridge SF Office Published 1 year ago
Flexible on stack
Sierra

Join Sierra as a Software Engineer on the Inference team to build efficient AI systems for customer-facing applications.

Sierra San Francisco, CA Published 1 month ago
Hippocratic AI

Own the serving infrastructure for healthcare AI, optimizing LLM inference systems to enhance patient experiences.

Hippocratic AI Menlo Park, CA Published 1 month ago
Flexible on stack
Mirendil

Own the inference systems that power frontier AI models in production and research at a tech-first startup.

Mirendil San Francisco $300k–$400k/yr Published 5 months ago
Inferact

Join Inferact as a co-op student to work on cutting-edge AI inference systems in a hands-on engineering role.

Inferact San Francisco Published 2 days ago
Flexible on stack
baseten

Join Baseten as a Software Engineer to build the distributed runtime for large-scale LLM inference in a high-impact team.

baseten San Francisco Published 1 month ago
Fundamental

Own the product strategy for NEXUS inference offerings at a pioneering AI research lab.

Fundamental EU, Remote Published 1 month ago
Reflection AI

Own inference performance and correctness for pre-training evaluations in a research lab focused on open AI models.

Reflection AI Global Office Published 4 days ago
Anthropic

Join Anthropic's Inference team to design and maintain distributed systems that serve AI models to millions of users worldwide.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 5 months ago
Flexible on stack
baseten

Join Baseten as an Infrastructure Software Engineer to build and maintain components of our ML inference platform for AI applications.

baseten San Francisco Published 1 year ago
Flexible on stack
baseten

Join Baseten as a Software Engineer to build the API layer for Model APIs in a fast-growing AI infrastructure company.

baseten San Francisco, United States Published 2 days ago
Flexible on stack
Anthropic

Drive programs that scale AI serving infrastructure across multiple platforms at Anthropic.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $290k–$435k/yr Published 1 month ago
Anthropic

Join Anthropic as a Staff + Sr. Software Engineer to build and scale AI systems that serve millions of users worldwide.

Anthropic New York City, NY; San Francisco, CA; Seattle, WA $320k–$485k/yr Published 1 month ago
Flexible on stack
Coreweave

Join CoreWeave as a Staff Software Engineer to lead the development of a Kubernetes-native inference platform for AI workloads.

Coreweave Sunnyvale, CA / Bellevue, WA $188k–$275k/yr Published 6 months ago
Flexible on stack
baseten

Join Baseten as a Software Engineer to optimize AI inference performance in a fast-paced startup environment.

baseten San Francisco Published 1 month ago
Flexible on stack
Inferact

Join Inferact as a Site Reliability Engineer to enhance the reliability and performance of AI inference systems at scale.

Inferact San Francisco $200k–$400k/yr Published 1 month ago
Flexible on stack AI-first team
Together AI

Join Together AI as a Staff AI Infra Engineer to enhance the reliability of our GPU inference infrastructure.

Together AI San Francisco $250k–$320k/yr Published 1 month ago
Flexible on stack