"inference infrastructure" Jobs

449 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: AI/ML, Python, Kubernetes. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 449 results

Inductive Bio

Join Inductive Bio as a software engineer to build AI tools that accelerate drug discovery.

Inductive Bio New York City, San Francisco, or Boston Published 8 months ago
baseten

Join Baseten as a lead Software Engineer to own and develop production-grade Voice AI systems that impact daily lives.

baseten San Francisco Published 7 months ago
Flexible on stack
Inferact

Join Inferact as a Product Marketing Manager to enhance vLLM's presence in the AI inference space through strategic marketing and community engagement.

Inferact San Francisco Published 4 months ago
Together AI

Join Together AI as an AI Infrastructure Engineer to ensure smooth operation of user-facing services and production systems.

Together AI San Francisco $190k–$270k/yr Published 6 months ago
Flexible on stack
Rox

Join Rox as a Founding Applied Research Engineer to shape the future of applied AI with a focus on real-world production challenges.

Rox San Francisco Published 5 months ago
Together AI

Build production AI agent systems for one of the world's largest GPU fleets at Together AI.

Together AI San Francisco $250k–$300k/yr Published 2 months ago
Flexible on stack
Anthropic

Join Anthropic as a Principal Engineer to optimize and manage a large-scale infrastructure fleet for AI systems.

Anthropic San Francisco, CA $320k–$485k/yr Published 1 month ago
Flexible on stack
Fal

Build data infrastructure at fal to enhance cost, margin, and performance analytics in a fast-paced generative media ecosystem.

Fal San Francisco Published 6 months ago
Flexible on stack
Perplexity AI

Join Perplexity AI as a Technical Staff member to enhance our AI inference engine with cutting-edge technologies.

Perplexity AI San Francisco Published 7 months ago
Flexible on stack
Arena

Join Arena as a Machine Learning Engineer to scale AI evaluation systems with a mission-driven team.

Arena SF Bay Area Published 1 week ago
Flexible on stack
Inferact

Build and lead the accounting and financial operations for Inferact as a Corporate Controller.

Inferact San Francisco Published 1 month ago
AI-first team
Anthropic

Join Anthropic as a Staff+ Software Engineer to build production systems for capacity engineering in a hybrid work environment.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 4 months ago
Flexible on stack 70% coding
baseten

Join Baseten as a Software Engineer to build an AI developer platform that enhances productivity for engineers.

baseten San Francisco Published 3 months ago
Flexible on stack
Anthropic
Anthropic San Francisco, CA $350k–$850k/yr Published 1 year ago
Inferact

Join Inferact as a Member of Technical Staff to manage vulnerability processes for vLLM's AI infrastructure.

Inferact San Francisco $200k–$400k/yr Published 1 month ago
baseten

Join Baseten as a Software Engineer to lead GPU Networking efforts and optimize distributed systems for AI applications.

baseten San Francisco Published 9 months ago
Flexible on stack
Abridge

Lead product strategy for foundational models and post-training at a growing healthcare AI startup in San Francisco.

Abridge SF Office Published 1 week ago
baseten

Join Baseten as a Backend Engineer to build scalable systems for AI products in a rapidly growing company.

baseten San Francisco Published 4 weeks ago
Flexible on stack
Peregrine

Lead the development of AI-powered features for an intelligence platform in public safety and government sectors.

Peregrine San Francisco, CA, United States $225k–$320k/yr Published 2 days ago
Flexible on stack