"inference infrastructure" Jobs

145 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, Kubernetes. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 145 results

Anthropic

Lead a team of engineers to optimize Anthropic's inference infrastructure for AI systems.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$625k/yr Published 2 months ago
Flexible on stack Heavy meetings
Anthropic

Join Anthropic's Inference team to design and maintain distributed systems that serve AI models to millions of users worldwide.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 5 months ago
Flexible on stack
Anthropic

Drive programs that scale AI serving infrastructure across multiple platforms at Anthropic.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $290k–$435k/yr Published 1 month ago
Anthropic

Join Anthropic as a Staff + Sr. Software Engineer to build and scale AI systems that serve millions of users worldwide.

Anthropic New York City, NY; San Francisco, CA; Seattle, WA $320k–$485k/yr Published 1 month ago
Flexible on stack
Anthropic

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 6 months ago
Flexible on stack
Roboflow

Join Roboflow as a Machine Learning Engineer to enhance our inference engine and contribute to impactful computer vision projects.

Roboflow NY, SF or Remote Published 4 months ago
Flexible on stack
Coreweave

Lead complex programs for inference platform delivery in a high-growth AI infrastructure company.

Coreweave Livingston, NJ / New York City, NY / Sunnyvale, CA / Bellevue, WA $177k–$237k/yr Published 2 weeks ago
Anthropic

Join Anthropic as a Staff Engineer to lead the technical direction of the Inference Runtime for AI systems serving millions of users.

Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY $405k–$485k/yr Published 5 months ago
Flexible on stack
Reflection AI

Build evaluation infrastructure for AI models at Reflection AI, enhancing model capabilities and training processes.

Reflection AI New York, NY Published 1 month ago
Flexible on stack
Anthropic

Join Anthropic as a Demand Planning expert to optimize AI infrastructure capacity and ensure timely delivery across multiple platforms.

Anthropic San Francisco, CA | New York City, NY $320k–$405k/yr Published 3 months ago
Flexible on stack
Harvey AI

Join Harvey AI as a Member of Technical Staff to build infrastructure for legal AI models in a fast-growing company.

Harvey AI New York $230k–$340k/yr Published 2 weeks ago
Flexible on stack
Anthropic

Own the infrastructure for machine learning research to detect and mitigate misuse of AI models at Anthropic.

Anthropic San Francisco, CA | New York City, NY $350k–$500k/yr Published 4 months ago
Flexible on stack
Crosby

Join Crosby as an Infrastructure Engineer to build and scale systems that power an AI-native law firm.

Crosby New York City Published 1 month ago
Flexible on stack
Goodfire

Join Goodfire as a Machine Learning Engineer to build interpretable AI systems with a world-class team.

Goodfire San Francisco, CA & New York, NY $200k–$400k/yr Published 11 months ago
Inductive Bio

Join Inductive Bio as a software engineer to build AI tools that accelerate drug discovery.

Inductive Bio New York City, San Francisco, or Boston Published 8 months ago
Anthropic

Build and operate production systems for capacity planning and compute efficiency in a high-autonomy environment.

Anthropic New York City, NY $320k–$485k/yr Published 1 month ago
Flexible on stack
Traversal

Join Traversal as a senior AI Engineer to design and operate core systems for AI products in a fast-paced, collaborative environment.

Traversal New York $175k–$300k/yr Published 5 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff+ Software Engineer to build production systems for capacity engineering in a hybrid work environment.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 4 months ago
Flexible on stack 70% coding