"inference serving systems" Jobs

752 open tech roles matching “inference serving systems”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AI/ML. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 752 results

MongoDB

Join MongoDB as a Software Engineer 3 to enhance Voyage's AI models for diverse deployment environments.

MongoDB Sydney Published 1 month ago
Flexible on stack
Fireworks AI

Join Fireworks AI as a Software Engineer focused on Performance Optimization to enhance AI infrastructure efficiency and speed.

Fireworks AI San Mateo Published 1 year ago
Flexible on stack
Anthropic

Lead the Capacity Engineering team at Anthropic, ensuring efficient allocation and utilization of infrastructure resources.

Anthropic San Francisco, CA, United States $405k–$485k/yr Published 1 day ago
Flexible on stack Heavy meetings
Verkada

Lead Verkada's Search team to enhance AI-powered search and computer vision capabilities for their camera fleet.

Verkada San Mateo, CA, United States $200k–$315k/yr Published 4 months ago
Flexible on stack Heavy meetings
Fireworks AI

Own foundational capabilities for enterprise AI, designing data models and APIs while ensuring security and compliance for large-scale customers.

Fireworks AI New York Published 1 month ago
Flexible on stack
Fireworks AI

Join Fireworks AI as an Applied Machine Learning Engineer to bridge AI research and real-world applications in a fast-growing team.

Fireworks AI Singapore Published 1 month ago
Flexible on stack
Mirendil

Own the compute and cloud foundation for frontier AI research at a tech-first startup.

Mirendil San Francisco $300k–$400k/yr Published 2 months ago
AI-first team
Fireworks AI

Join Fireworks AI as a product-minded engineer to build and ship innovative AI solutions with a high degree of autonomy.

Fireworks AI San Mateo Published 1 month ago
Flexible on stack 70% coding
Anthropic

Join Anthropic as a Staff+ Site Reliability Engineer to ensure safe AI model launches and automate deployment processes.

Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY $320k–$485k/yr Published 1 week ago
Flexible on stack
Coreweave

Join CoreWeave as a Senior Applied ML Engineer to tackle challenges in continuous learning for AI agents with a focus on innovative solutions.

Coreweave Bellevue, WA / Sunnyvale, CA $182k–$242k/yr Published 5 months ago
Flexible on stack
OpenRouter

Join OpenRouter as a Software Engineer to scale systems handling millions of LLM requests daily in a fast-growing AI infrastructure company.

OpenRouter Remote (US) Published 4 months ago
Flexible on stack 70% coding
Databricks

Lead a multidisciplinary research team to advance large-scale machine learning efficiency at Databricks.

Databricks Mountain View, California; San Francisco, California $270k–$340k/yr Published 3 months ago
Flexible on stack 60% coding
baseten

Lead the Runtime Fabric team at Baseten to build container runtimes tailored for AI inference workloads.

baseten San Francisco Published 3 months ago
Flexible on stack Heavy meetings
Databricks

Lead the development of data ingestion and normalization for advertising platforms at Databricks.

Databricks New York City, New York $190.9k–$253.8k/yr Published 2 weeks ago
Stability AI

Join Stability AI as a Forward Deployed Engineer to help enterprises adopt generative AI across various creative domains.

Stability AI United States Published 1 week ago
Flexible on stack