"inference serving" Jobs

372 open tech roles matching “inference serving”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, Kubernetes. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 372 results

Mercury

Lead the development of an enterprise-wide governance program for data and AI at Mercury.

Mercury San Francisco, CA, New York, NY, Portland, OR, or Remote within United States $203.3k–$282.3k/yr Published 1 month ago
Coreweave

Drive the adoption of CoreWeave's data services by identifying market opportunities and shaping product strategy for enterprise customers.

Coreweave Livingston, NJ / New York, NY / Sunnyvale, CA / San Francisco, CA / Bellevue, WA $207k–$275k/yr Published 1 month ago
Flexible on stack
PagerDuty

Join PagerDuty as a Senior AI/ML Engineer to design and build AI-powered features for high-volume, real-time event streams.

PagerDuty Lisbon Published 1 month ago
Flexible on stack
Fireworks AI

Drive adoption of Fireworks AI within strategic AI companies as a trusted advisor to technical teams.

Fireworks AI San Francisco $280k–$320k/yr Published 3 months ago
Bretton AI

Own and evolve Kubernetes infrastructure while building secure, compliant AI systems for major financial institutions.

Bretton AI San Francisco, CA $168k–$213k/yr Published 7 months ago
70% coding
Anthropic

Lead the Search Platform team at Anthropic, focusing on building and improving search systems for AI applications.

Anthropic San Francisco, CA | New York City, NY $320k–$405k/yr Published 1 month ago
Heavy meetings
Mirendil

Own the compute and cloud foundation for frontier AI research at a tech-first startup.

Mirendil San Francisco $300k–$400k/yr Published 2 months ago
AI-first team
Fireworks AI

Join Fireworks AI as a Developer Advocate to shape the future of AI infrastructure through hands-on engineering and community engagement.

Fireworks AI San Francisco Published 3 weeks ago
Flexible on stack 70% coding
baseten

Lead Baseten's immigration and mobility strategy to support global hiring and employee relocation in a fast-growing AI company.

baseten San Francisco Published 1 month ago
baseten

Join Baseten as a hands-on Operations Manager to optimize the health and utilization of our GPU fleet in a fast-growing AI company.

baseten San Francisco Published 2 weeks ago
Benchling

Join Benchling as a senior Product Manager to drive the adoption of scientific AI models in biotech R&D.

Benchling San Francisco, CA Published 2 months ago
Anthropic

Own the financial strategy for the Claude Platform, shaping pricing and business models in a fast-paced AI environment.

Anthropic San Francisco, CA $325k–$425k/yr Published 2 days ago
Together AI

Join Together AI as a Software Engineer Intern to work on scalable systems and user-focused solutions in San Francisco.

Together AI San Francisco $58–$58/hr Published 3 days ago
Databricks
Databricks Mountain View, California; San Francisco, California Published 6 months ago
Lyft

Join Lyft as a Staff Applied Scientist to develop ML and optimization models that enhance pricing and ETA decisions.

Lyft San Francisco, CA $193.6k–$242k/yr Published 1 month ago
Flexible on stack
Anthropic

Join Anthropic as a Staff+ Software Engineer to shape the technical strategy for our storage systems in a collaborative environment.

Anthropic San Francisco, CA | New York City, NY $1–$2/yr Published 3 days ago
Flexible on stack
Sierra

Join Sierra as a Software Engineer on the Site Reliability team to enhance the reliability and scalability of AI-driven infrastructure.

Sierra San Francisco, CA Published 11 months ago
Flexible on stack