"inference serving" Jobs
1053 open tech roles matching “inference serving”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, Kubernetes. Every listing is re-checked daily and closed roles are removed.
Showing 20 of 1053 results
Own the serving infrastructure for healthcare AI, optimizing LLM inference systems to enhance patient experiences.
Join Sierra as a Software Engineer on the Inference team to build efficient AI systems for customer-facing applications.
Join Together AI as a Research Intern to work on cutting-edge distributed inference and optimization for large foundation models.
Join Together AI as a Research Intern to work on cutting-edge distributed inference and optimization for large foundation models.
Own Sarvam's production serving path for large distributed models, integrating and optimizing performance across a multi-node stack.
Join Anthropic's Inference team to build and maintain systems that serve AI models to millions of users worldwide.
Join Inferact as a co-op student to work on cutting-edge AI inference systems in a hands-on engineering role.
Join Baseten as a Software Engineer to optimize AI inference performance in a fast-paced startup environment.
Lead a team of engineers to optimize Anthropic's inference infrastructure for AI systems.
Join Hippocratic AI as a senior LLM Inference Systems Engineer to build high-performance networking for large language models.
Join Inworld AI as a Senior Machine Learning Engineer to optimize and run real-time AI inference systems in a collaborative environment.
Own the inference systems that power frontier AI models in production and research at a tech-first startup.
Join CoreWeave as a Staff Software Engineer to lead the development of a Kubernetes-native inference platform for AI workloads.
Own the product strategy for NEXUS inference offerings at a pioneering AI research lab.
Join Anthropic's Inference team to design and maintain distributed systems that serve AI models to millions of users worldwide.
Join Inferact as an inference runtime engineer to optimize AI model execution across diverse hardware and architectures.