"inference serving" Jobs

45 open tech roles matching “inference serving”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, Kubernetes. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 45 results

Anthropic

Join Anthropic's Inference team to design and maintain distributed systems that serve AI models to millions of users worldwide.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 1 month ago
Flexible on stack
Anthropic

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 2 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff Software Engineer to enhance deployment infrastructure for AI systems in a collaborative environment.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 4 weeks ago
Flexible on stack
Anthropic

Join Anthropic as a Staff Engineer to lead the technical direction of the Inference Runtime for AI systems serving millions of users.

Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY $405k–$485k/yr Published 1 month ago
Flexible on stack
Anthropic
Anthropic San Francisco, CA | New York City, NY | Seattle, WA $275k–$370k/yr Published 2 months ago
Twitch

Join Twitch's Monetization team as a Data Scientist to apply causal inference methods and optimize revenue for creators.

Twitch New York City $136k–$212.8k/yr Published 2 weeks ago
Flexible on stack
Mercury

Join Mercury as a Senior Machine Learning Operations Engineer to build and operate real-time inference services for risk decisioning.

Mercury San Francisco, CA, New York, NY, Portland, OR, or Remote within Canada or United States $166.6k–$208.3k/yr Published 1 month ago
Flexible on stack
Anthropic

Join Anthropic as a Data Scientist to shape marketing strategies for safe and beneficial AI systems.

Anthropic New York City, NY | Seattle, WA; San Francisco, CA $275k–$370k/yr Published 4 months ago
Anthropic

Join Anthropic as a Communications Lead to drive external storytelling for Claude's engineering and infrastructure work.

Anthropic New York City, NY; San Francisco, CA; Seattle, WA $255k–$320k/yr Published 1 month ago
Anthropic
Anthropic Remote-Friendly (Travel Required) | San Francisco, CA; San Francisco, CA | New York City, NY $850k–$850k/yr Published 4 months ago
Databricks

Develop and run the research stack that powers Databricks AI Research, enabling rapid large-scale experiments.

Databricks New York City, New York; San Francisco, California $199k–$270k/yr Published 2 months ago
Flexible on stack
Databricks
Databricks New York City, New York; San Francisco, California $190k–$270k/yr Published 2 months ago
Faire
Faire New York City, NY; San Francisco, CA $185.5k–$255k/yr Published 5 months ago
Fireworks AI

Design and maintain large-scale backend infrastructure for a leading generative AI platform at Fireworks AI.

Fireworks AI New York Published 1 month ago
Flexible on stack
Palantir

Join Palantir's software engineering team to enable ML models in production for critical customers.

Palantir New York, NY Published 1 month ago
Datadog

Join Datadog as a Manager of Strategic Sourcing to lead AI spend and vendor negotiations in a hybrid work environment.

Datadog New York, New York, USA $128k–$187k/yr Published 3 weeks ago
Anthropic
Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 3 months ago