"inference infrastructure" Jobs

449 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: AI/ML, Python, Kubernetes. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 449 results

Anthropic

Own the infrastructure for machine learning research to detect and mitigate misuse of AI models at Anthropic.

Anthropic San Francisco, CA | New York City, NY $350k–$500k/yr Published 4 months ago
Flexible on stack
Inferact

Build the commercial operating system for Inferact as a Go-to-Market Engineer in a hands-on role.

Inferact San Francisco Published 1 month ago
Gimlet Labs

Join Gimlet Labs as a Senior Technical Recruiter to build teams for next-generation AI data centers.

Gimlet Labs San Francisco, CA Published 1 month ago
Specter

Join Specter as an ML Infrastructure engineer to build and scale machine learning systems for real-time perception across edge-cloud platforms.

Specter San Francisco Published 1 year ago
Flexible on stack
Meter

Join Meter as a Backend Engineer to design and implement a unified data interface for model development in a cutting-edge networking company.

Meter San Francisco $160k–$230k/yr Published 1 year ago
Flexible on stack
baseten

Join Baseten as a Software Engineer on the Observability team to enhance the reliability of AI product systems.

baseten San Francisco Published 3 months ago
Flexible on stack
Inferact

Join Inferact as a Member of Technical Staff to secure our AI inference platform for enterprise customers.

Inferact San Francisco $200k–$400k/yr Published 2 weeks ago
Sierra

Join Sierra as a Software Engineer, Infrastructure, to design and maintain core systems for our AI platform in a collaborative environment.

Sierra San Francisco, CA Published 5 months ago
Flexible on stack
Inferact

Join Inferact as a cloud orchestration engineer to build reliable systems for AI model deployment at scale.

Inferact San Francisco $200k–$400k/yr Published 10 months ago
Flexible on stack
baseten

Join Baseten as a Site Reliability Engineer to enhance the reliability of our multi-cloud Kubernetes infrastructure.

baseten San Francisco Published 6 months ago
Flexible on stack 70% coding
Together AI

Join Together AI as a Staff Software Engineer to build systems that automate GPU infrastructure management.

Together AI San Francisco $240k–$280k/yr Published 4 months ago
Flexible on stack
Inferact

Own and grow strategic partnerships in the hardware and infrastructure ecosystem for a fast-moving AI startup.

Inferact San Francisco Published 1 month ago
Decagon

Design and operate data systems that power Decagon's AI products, ensuring high reliability and performance.

Decagon San Francisco $200k–$400k/yr Published 2 months ago
Flexible on stack
Goodfire

Join Goodfire as a Machine Learning Engineer to build interpretable AI systems with a world-class team.

Goodfire San Francisco, CA & New York, NY $200k–$400k/yr Published 11 months ago
Gimlet Labs

Build and optimize network infrastructure for Gimlet's AI-focused compute and storage systems in a growing tech environment.

Gimlet Labs San Francisco, CA Published 5 months ago
Flexible on stack
Perplexity AI

Own the GPU cluster infrastructure at Perplexity AI, building a self-serve platform for training and inference workloads.

Perplexity AI San Francisco Published 3 weeks ago
Flexible on stack
Gimlet Labs

Join Gimlet Labs as a Data Center Architect to design and oversee data hall infrastructure for AI workloads.

Gimlet Labs San Francisco, CA Published 1 month ago
baseten

Join Baseten as a Software Engineer to automate Kubernetes operations for AI workloads in a rapidly growing company.

baseten San Francisco Published 1 week ago
Flexible on stack 70% coding
Reflection AI

Lead cross-functional programs to scale research infrastructure for AI model training at a fast-moving startup.

Reflection AI San Francisco, CA Published 2 weeks ago