"inference infrastructure" Jobs

167 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, Go. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 167 results

Anthropic

Join Anthropic's Inference team to build and maintain systems that serve AI models to millions of users worldwide.

Anthropic Ontario, CAN Published 3 months ago
Flexible on stack
Mirendil

Own the inference systems that power frontier AI models in production and research at a tech-first startup.

Mirendil San Francisco $300k–$400k/yr Published 4 months ago
Reflection AI

Own inference performance and correctness for pre-training evaluations in a research lab focused on open AI models.

Reflection AI Global Office Published 3 days ago
Anthropic

Join Anthropic's Inference team to design and maintain distributed systems that serve AI models to millions of users worldwide.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 5 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff + Sr. Software Engineer to build and scale AI systems that serve millions of users worldwide.

Anthropic New York City, NY; San Francisco, CA; Seattle, WA $320k–$485k/yr Published 1 month ago
Flexible on stack
Coreweave

Join CoreWeave as a Staff Software Engineer to lead the development of a Kubernetes-native inference platform for AI workloads.

Coreweave Sunnyvale, CA / Bellevue, WA $188k–$275k/yr Published 6 months ago
Flexible on stack
Together AI

Join Together AI as a Staff AI Infra Engineer to enhance the reliability of our GPU inference infrastructure.

Together AI San Francisco $250k–$320k/yr Published 1 month ago
Flexible on stack
Inferact

Join Inferact as an inference runtime engineer to innovate AI inference engines for large models in a fully remote role.

Inferact Remote Published 2 months ago
Flexible on stack
Inferact

Join Inferact as an inference runtime engineer to optimize AI model execution across diverse hardware and architectures.

Inferact San Francisco $200k–$400k/yr Published 5 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff + Sr. Software Engineer to optimize and scale AI inference across major cloud platforms.

Anthropic San Francisco, CA | Seattle, WA $320k–$485k/yr Published 1 month ago
Flexible on stack
Inferact

Join Inferact as a staff engineer to build distributed systems for AI inference at global scale.

Inferact San Francisco $200k–$400k/yr Published 10 months ago
Flexible on stack
Together AI

Join Together AI as a Staff Software Engineer to build systems that automate infrastructure management for AI clusters.

Together AI India Published 3 months ago
Flexible on stack
Inferact

Join Inferact as a staff engineer to build distributed systems for AI inference at global scale.

Inferact Singapore S$200k–S$400k/yr Published 4 months ago
Flexible on stack
Inferact

Join Inferact as an inference runtime engineer to optimize AI model execution across diverse hardware and architectures.

Inferact Singapore S$200k–S$400k/yr Published 4 months ago
Flexible on stack
Together AI

Join Together AI as a Staff Software Engineer to build systems that automate infrastructure management for AI clusters.

Together AI London & Amsterdam Published 3 months ago
Flexible on stack
Anthropic

Join Anthropic's Cloud Inference team to design and optimize backend services for AI systems across multiple cloud platforms.

Anthropic San Francisco, CA | Seattle, WA $320k–$485k/yr Published 1 month ago
Flexible on stack
Together AI

Join Together AI as a Staff Software Engineer to build systems that automate infrastructure management for AI clusters.

Together AI Amsterdam Published 3 months ago
Flexible on stack
Coreweave

Lead complex programs for inference platform delivery in a high-growth AI infrastructure company.

Coreweave Livingston, NJ / New York City, NY / Sunnyvale, CA / Bellevue, WA $177k–$237k/yr Published 1 week ago
Gimlet Labs

Build reliable production infrastructure for Gimlet's AI cloud as an Infrastructure Platform Engineer.

Gimlet Labs San Francisco, CA Published 5 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff Engineer to lead the technical direction of the Inference Runtime for AI systems serving millions of users.

Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY $405k–$485k/yr Published 5 months ago
Flexible on stack