"inference serving" Jobs
115 open tech roles matching “inference serving”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, Kubernetes. Every listing is re-checked daily and closed roles are removed.
Showing 20 of 115 results
Join Together AI as a Research Intern to work on cutting-edge distributed inference and optimization for large foundation models.
Join Anthropic's Inference team to design and maintain distributed systems that serve AI models to millions of users worldwide.
Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.
Join Anthropic as a Staff Software Engineer to design and optimize backend services for cloud inference at scale.
Join Anthropic as a Staff Software Engineer to optimize and scale AI inference across major cloud platforms.
Join Databricks as a Staff Software Engineer to build LLM infrastructure for large-scale AI inference workloads.
Join Anthropic as a Staff Software Engineer to enhance deployment infrastructure for AI systems in a collaborative environment.
Join Together AI as a Customer Support Engineer to tackle complex technical challenges in a fast-paced AI environment.
Lead a talented team of engineers to enhance Databricks' Foundation Model Inference capabilities in a fast-paced AI infrastructure environment.
Join Together AI as a Research Engineer to develop a platform for customizing open-source models with user data.
Join Anthropic as a Staff Engineer to lead the technical direction of the Inference Runtime for AI systems serving millions of users.