"inference infrastructure" Jobs

449 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: AI/ML, Python, Kubernetes. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 449 results

Harvey AI

Lead a high-performing team to develop and manage the model infrastructure platform at Harvey AI.

Harvey AI San Francisco $272k–$355k/yr Published 4 months ago
Heavy meetings
Inferact

Join Inferact as a cluster administration engineer to manage high-performance GPU compute infrastructure for AI inference.

Inferact San Francisco $200k–$400k/yr Published 3 months ago
Flexible on stack
Mirendil

Own the compute and cloud foundation for frontier AI research at a tech-first startup.

Mirendil San Francisco $300k–$400k/yr Published 5 months ago
AI-first team
Chai Discovery

Join Chai Discovery as a Software Engineer to optimize AI models for drug discovery in a fast-paced, innovative environment.

Chai Discovery San Francisco office Published 12 months ago
baseten

Join Baseten as a Cloud Platform Engineer to build scalable infrastructure for deploying machine learning models.

baseten San Francisco Published 1 year ago
Flexible on stack
Preference Model

Join Preference Model as a Senior ML Infrastructure Engineer to build scalable infrastructure for post-training research on large language models.

Preference Model San Francisco Published 1 week ago
Flexible on stack
Gimlet Labs

Join Gimlet Labs as an FP&A Manager to manage infrastructure budgets and improve operational efficiency in a growing tech company.

Gimlet Labs San Francisco, CA Published 1 month ago
Coreweave

Drive the adoption of CoreWeave's AI inference offerings across AMER, shaping product strategy and engaging with customers.

Coreweave Bellevue, WA / Dallas, TX / Livingston, NJ / Manhattan, NY / San Francisco, CA / Sunnyvale, CA $177k–$237k/yr Published 1 week ago
Bretton AI

Own and evolve Kubernetes infrastructure while building secure, compliant AI systems for major financial institutions.

Bretton AI San Francisco, CA $168k–$213k/yr Published 9 months ago
70% coding
Anthropic

Join Anthropic as a Demand Planning expert to optimize AI infrastructure capacity and ensure timely delivery across multiple platforms.

Anthropic San Francisco, CA | New York City, NY $320k–$405k/yr Published 3 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff Software Engineer to build scalable ML infrastructure for AI safety systems.

Anthropic San Francisco, CA $320k–$485k/yr Published 2 months ago
Flexible on stack
Gimlet Labs

Build systems for scheduling and coordinating AI workloads across Gimlet’s infrastructure as a Member of Technical Staff.

Gimlet Labs San Francisco, CA Published 8 months ago
Flexible on stack
Inferact

Join Inferact as an IT Support & Operations Engineer to enhance internal technology and security for a growing AI startup.

Inferact San Francisco $125k–$170k/yr Published 2 months ago
baseten

Join Baseten as a Software Engineer to architect and develop scalable infrastructure for ML training platforms.

baseten San Francisco Published 1 year ago
Flexible on stack
Harvey

Lead the design and development of systems powering AI requests at Harvey, a fast-scaling company in the legal tech space.

Harvey San Francisco $231k–$340k/yr Published 2 months ago
Flexible on stack
Salient

Own Salient's cloud infrastructure across AWS, GCP, and Render, ensuring reliability and cost efficiency.

Salient SF Headquarters Published 1 month ago
Cloudflare

Lead the models team at Cloudflare to ensure reliable AI model operations and drive innovation in AI Gateway.

Cloudflare In-Office $230k–$317k/yr Published 3 weeks ago
Flexible on stack AI-first team
baseten

Join Baseten as an AI Engineer to design and automate workflows for AI-powered capacity management in a fast-growing company.

baseten San Francisco Published 2 months ago
Flexible on stack
Harvey AI

Join Harvey AI as a Member of Technical Staff to build infrastructure for ML models in legal work.

Harvey AI San Francisco $230k–$340k/yr Published 2 weeks ago
Flexible on stack
Perplexity AI

Join Perplexity AI as a technical program manager to drive the core inference platform and coordinate across teams and model providers.

Perplexity AI San Francisco Published 2 months ago