"inference infrastructure" Jobs

934 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AI/ML. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 934 results

Inworld AI

Join Inworld AI as a Staff/Principal Machine Learning Engineer to optimize and serve state-of-the-art voice models in a fully remote role.

Inworld AI Switzerland Published 5 months ago
Flexible on stack
Inflection AI

Lead the development of Inflection's realtime Voice AI stack, shaping emotionally intelligent AI for enterprise voice interactions.

Inflection AI Palo Alto, California, United States $400k–$550k/yr Published 2 months ago
Harvey

Lead the design and development of systems powering AI requests at Harvey, ensuring high reliability and operational excellence.

Harvey San Francisco $193.4k–$290k/yr Published 6 days ago
Flexible on stack 60% coding
Cursor

Join Cursor as a Technical Program Manager to drive infrastructure efficiency and resource allocation in a dynamic startup environment.

Cursor San Francisco Published 3 months ago
Together AI

Build production AI agent systems for one of the world's largest GPU fleets at Together AI.

Together AI San Francisco $250k–$300k/yr Published 2 days ago
Flexible on stack
Fal

Build data infrastructure at fal to enhance cost, margin, and performance analytics in a fast-paced generative media ecosystem.

Fal San Francisco Published 4 months ago
Flexible on stack
Perplexity AI

Join Perplexity AI as a Technical Staff member to enhance our AI inference engine with cutting-edge technologies.

Perplexity AI San Francisco Published 5 months ago
Flexible on stack
Traversal

Join Traversal as a senior AI Engineer to design and operate core systems for AI products in a fast-paced, collaborative environment.

Traversal New York $175k–$300k/yr Published 2 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff+ Software Engineer to build production systems for capacity engineering in a hybrid work environment.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 2 months ago
Flexible on stack 70% coding
Hebbia AI

Join Hebbia AI as a Backend Engineer to build scalable solutions for advanced AI-driven investment analysis.

Hebbia AI NYC $160k–$350k/yr Published 1 year ago
Flexible on stack
Together AI

Build production AI agents and foundational systems for one of the world's largest GPU fleets at Together AI in Amsterdam.

Together AI Amsterdam Published 6 days ago
Flexible on stack
Exa

Join Exa's Infrastructure Team to build massive-scale ML systems that redefine how AI consumes information.

Exa San Francisco, California Published 1 year ago
Inflection AI
Inflection AI Palo Alto, California, United States $350k–$500k/yr Published 4 months ago
baseten

Join Baseten as a Software Engineer to build an AI developer platform that enhances productivity for engineers.

baseten San Francisco Published 1 month ago
Flexible on stack
Traversal

Join Traversal as a Backend AI Engineer to design and build core systems for AI-driven site reliability in complex production environments.

Traversal New York $150k–$300k/yr Published 1 year ago
Flexible on stack
Anthropic
Anthropic San Francisco, CA $350k–$850k/yr Published 1 year ago
Fireworks AI

Design and maintain large-scale backend infrastructure for a leading generative AI platform at Fireworks AI.

Fireworks AI New York Published 3 months ago
Flexible on stack
Kodiak Robotics

Join Kodiak Robotics as a Senior AI Infrastructure Engineer to optimize model training for autonomous technology.

Kodiak Robotics Mountain View, CA $190k–$260k/yr Published 2 months ago
Flexible on stack