"inference serving" Jobs

176 open tech roles matching “inference serving”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, SQL. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 176 results

Anthropic

Join Anthropic's Inference team to design and maintain distributed systems that serve AI models to millions of users worldwide.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 1 month ago
Flexible on stack
Anthropic

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 2 months ago
Flexible on stack
Roboflow

Join Roboflow as a Machine Learning Engineer to enhance our inference engine and contribute to impactful computer vision projects.

Roboflow NY, SF or Remote Published 3 weeks ago
Flexible on stack
Anthropic

Join Anthropic as a Staff Software Engineer to design and optimize backend services for cloud inference at scale.

Anthropic San Francisco, CA $320k–$485k/yr Published 1 month ago
Flexible on stack
Anthropic

Join Anthropic as a Staff Software Engineer to optimize and scale AI inference across major cloud platforms.

Anthropic San Francisco, CA $320k–$485k/yr Published 1 month ago
Flexible on stack
Anthropic

Join Anthropic as a Staff Software Engineer to enhance deployment infrastructure for AI systems in a collaborative environment.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 4 weeks ago
Flexible on stack
Together AI

Join Together AI as a Customer Support Engineer to tackle complex technical challenges in a fast-paced AI environment.

Together AI San Francisco, CA $160k–$230k/yr Published 2 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff Engineer to lead the technical direction of the Inference Runtime for AI systems serving millions of users.

Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY $405k–$485k/yr Published 1 month ago
Flexible on stack
Inflection AI
Inflection AI Palo Alto, California, United States $350k–$500k/yr Published 2 months ago
Anthropic
Anthropic San Francisco, CA | New York City, NY | Seattle, WA $275k–$370k/yr Published 2 months ago
Twitch

Join Twitch's Monetization team as a Data Scientist to drive product decisions through rigorous analysis and causal inference.

Twitch San Francisco, CA $136k–$212.8k/yr Published 2 weeks ago
Flexible on stack
Twitch

Join Twitch's Monetization team as a Data Scientist to drive product decisions through causal analysis and experimentation.

Twitch Seattle, WA $136k–$212.8k/yr Published 2 weeks ago
Flexible on stack
Twitch

Join Twitch's Monetization team as a Data Scientist to apply causal inference methods and optimize revenue for creators.

Twitch New York City $136k–$212.8k/yr Published 2 weeks ago
Flexible on stack