"inference infrastructure" Jobs

407 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, Kubernetes. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 407 results

Rox

Join Rox as a Founding Applied Research Engineer to shape the future of applied AI with a focus on real-world production challenges.

Rox San Francisco Published 3 months ago
Harvey

Lead the design and development of systems powering AI requests at Harvey, ensuring high reliability and operational excellence.

Harvey San Francisco $193.4k–$290k/yr Published 1 week ago
Flexible on stack 60% coding
Cursor

Join Cursor as a Technical Program Manager to drive infrastructure efficiency and resource allocation in a dynamic startup environment.

Cursor San Francisco Published 3 months ago
Together AI

Build production AI agent systems for one of the world's largest GPU fleets at Together AI.

Together AI San Francisco $250k–$300k/yr Published 6 days ago
Flexible on stack
Fal

Build data infrastructure at fal to enhance cost, margin, and performance analytics in a fast-paced generative media ecosystem.

Fal San Francisco Published 4 months ago
Flexible on stack
Perplexity AI

Join Perplexity AI as a Technical Staff member to enhance our AI inference engine with cutting-edge technologies.

Perplexity AI San Francisco Published 5 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff+ Software Engineer to build production systems for capacity engineering in a hybrid work environment.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 2 months ago
Flexible on stack 70% coding
Exa

Join Exa's Infrastructure Team to build massive-scale ML systems that redefine how AI consumes information.

Exa San Francisco, California Published 1 year ago
baseten

Join Baseten as a Software Engineer to build an AI developer platform that enhances productivity for engineers.

baseten San Francisco Published 1 month ago
Flexible on stack
Anthropic
Anthropic San Francisco, CA $350k–$850k/yr Published 1 year ago
Databricks

Develop and run the research stack that powers Databricks AI Research, enabling rapid large-scale experiments.

Databricks New York City, New York; San Francisco, California $199k–$270k/yr Published 4 months ago
Flexible on stack
Databricks
Databricks New York City, New York; San Francisco, California $190k–$270k/yr Published 4 months ago
baseten

Join Baseten as a Software Engineer to lead GPU Networking efforts and optimize distributed systems for AI applications.

baseten San Francisco Published 6 months ago
Flexible on stack
Abridge

Lead product strategy for foundational models and post-training at a growing healthcare AI startup in San Francisco.

Abridge SF Office Published 3 weeks ago
Anthropic

Lead the Capacity Engineering team at Anthropic, ensuring efficient allocation and utilization of infrastructure resources.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 5 days ago
Flexible on stack Heavy meetings
Peregrine

Lead the development of AI-powered features for an end-to-end intelligence platform in public safety.

Peregrine San Francisco, CA $225k–$320k/yr Published 7 months ago
Mixpanel

Join Mixpanel as a Senior Data Scientist to drive AI-powered product insights and analytics for thousands of companies.

Mixpanel San Francisco, US (Hybrid) $216k–$254k/yr Published 1 month ago
Flexible on stack
baseten

Join Baseten as a Forward Deployed Engineer to solve complex AI challenges for leading companies.

baseten San Francisco Published 4 weeks ago
Flexible on stack