"inference serving systems" Jobs

97 open tech roles matching “inference serving systems”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AWS. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 97 results

Databricks
Databricks New York City, New York; San Francisco, California $190k–$270k/yr Published 4 months ago
Goodfire

Join Goodfire as a Machine Learning Engineer to build interpretable AI systems with a world-class team.

Goodfire San Francisco, CA & New York, NY $200k–$400k/yr Published 9 months ago
Lyft

Join Lyft as a Data Science Intern to solve diverse mathematical problems in a collaborative environment.

Lyft New York, United States $58–$62/hr Published 2 days ago
Flexible on stack
baseten

Lead the marketing technology and operations at Baseten, ensuring robust systems for a rapidly scaling marketing engine.

baseten New York Published 1 month ago
Flexible on stack
Fireworks AI

Design and maintain large-scale backend infrastructure for a leading generative AI platform at Fireworks AI.

Fireworks AI New York Published 3 months ago
Flexible on stack
Anthropic

Lead the Capacity Engineering team at Anthropic, ensuring efficient allocation and utilization of infrastructure resources.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 2 days ago
Flexible on stack Heavy meetings
Fireworks AI

Own foundational capabilities for enterprise AI, designing data models and APIs while ensuring security and compliance for large-scale customers.

Fireworks AI New York Published 1 month ago
Flexible on stack
Anthropic

Join Anthropic as a Staff+ Site Reliability Engineer to ensure safe AI model launches and automate deployment processes.

Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY $320k–$485k/yr Published 1 week ago
Flexible on stack
Databricks

Lead the development of data ingestion and normalization for advertising platforms at Databricks.

Databricks New York City, New York $190.9k–$253.8k/yr Published 2 weeks ago
Gusto

Lead the Sales Data Science & Analytics team to drive insights and forecasting for revenue growth at Gusto.

Gusto Denver, CO - Hybrid; New York, New York, United States; San Francisco, CA - Hybrid $218k–$255k/yr Published 11 months ago
Flexible on stack
Harvey AI

Join Harvey AI as a Staff Software Engineer to build and operate core infrastructure for AI workloads in a fast-growing company.

Harvey AI New York $231k–$340k/yr Published 1 month ago
Coreweave

Drive the adoption of AI runtime services at CoreWeave, leveraging your expertise in distributed systems and AI infrastructure.

Coreweave Livingston, NJ / New York, NY / Sunnyvale, CA / San Francisco, CA / Bellevue, WA $207k–$275k/yr Published 2 months ago
Flexible on stack
Attentive Mobile

Join Attentive as a Staff Software Engineer to architect and build the AI/ML infrastructure for a leading marketing platform.

Attentive Mobile United States $200k–$300k/yr Published 3 months ago
Flexible on stack
Vercel

Lead consumption forecasting at Vercel, architecting ML systems for financial planning and decision-making.

Vercel Hybrid - San Francisco, New York City $250k–$330k/yr Published 2 weeks ago
Flexible on stack
Anthropic
Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 5 months ago
Anthropic

Join Anthropic as a Staff+ Software Engineer to build production systems for capacity engineering in a hybrid work environment.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 2 months ago
Flexible on stack 70% coding
Harvey AI

Join Harvey AI as a Senior Software Engineer to build and operate core infrastructure for leading law firms and enterprises.

Harvey AI New York $161.3k–$241.9k/yr Published 1 month ago
Flexible on stack
Coreweave

Drive the adoption of CoreWeave's data services by identifying market opportunities and shaping product strategy for enterprise customers.

Coreweave Livingston, NJ / New York, NY / Sunnyvale, CA / San Francisco, CA / Bellevue, WA $207k–$275k/yr Published 1 month ago
Flexible on stack