"inference infrastructure" Jobs

168 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, Go. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 168 results

Together AI

Join Together AI as a Staff Software Engineer to build systems that automate GPU infrastructure management.

Together AI San Francisco $240k–$280k/yr Published 4 months ago
Flexible on stack
Inworld AI

Join Inworld AI as a Staff/Principal Machine Learning Engineer to optimize and serve top-ranked realtime voice models.

Inworld AI Mountain View, California, USA $270k–$500k/yr Published 7 months ago
Flexible on stack
Inworld AI

Join Inworld AI as a Staff/Principal Machine Learning Engineer to optimize and serve top-ranked realtime voice models.

Inworld AI UK £140k–£200k/yr Published 7 months ago
Flexible on stack
Perplexity AI

Own the GPU cluster infrastructure at Perplexity AI, building a self-serve platform for training and inference workloads.

Perplexity AI San Francisco Published 3 weeks ago
Flexible on stack
Enterpret

Own the Graph Platform at Enterpret, leading data systems and architecture decisions for a customer feedback intelligence platform.

Enterpret Bengaluru, Onsite Published 3 months ago
Flexible on stack
Inductive Bio

Join Inductive Bio as a software engineer to build AI tools that accelerate drug discovery.

Inductive Bio New York City, San Francisco, or Boston Published 8 months ago
Inworld AI

Join Inworld AI as a Staff/Principal Research Scientist to innovate in real-time voice models and AI applications.

Inworld AI Mountain View, California, USA $270k–$500k/yr Published 3 years ago
Inworld AI

Join Inworld AI as a Staff/Principal Machine Learning Engineer to optimize and serve state-of-the-art voice models in a fully remote role.

Inworld AI Switzerland Published 7 months ago
Flexible on stack
Perplexity AI

Join Perplexity AI as a Technical Staff member to enhance our AI inference engine with cutting-edge technologies.

Perplexity AI San Francisco Published 7 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff+ Software Engineer to build and optimize production systems for AI capacity engineering.

Anthropic San Francisco, CA, United States $320k–$485k/yr Published 1 day ago
Flexible on stack 70% coding
Anthropic

Join Anthropic as a Staff+ Software Engineer to build production systems for capacity engineering in a hybrid work environment.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 4 months ago
Flexible on stack 70% coding
Fireworks AI

Own the traffic layer behind a generative AI platform, focusing on distributed systems and cloud networking.

Fireworks AI San Mateo Published 3 weeks ago
Flexible on stack
Hippocratic AI

Join Hippocratic AI as a Staff Site Reliability Engineer to manage a fleet of GPU-backed models and enhance healthcare AI systems.

Hippocratic AI Menlo Park, CA Published 2 months ago
Flexible on stack
Inferact

Join Inferact as a Member of Technical Staff to manage vulnerability processes for vLLM's AI infrastructure.

Inferact San Francisco $200k–$400k/yr Published 1 month ago
Anthropic
Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 8 months ago
Inferact

Join Inferact as a staff engineer to work on optimizing AI inference across the vLLM stack in a fully remote role.

Inferact Remote Published 10 months ago
Flexible on stack