"inference infrastructure" Jobs
1154 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, Kubernetes. Every listing is re-checked daily and closed roles are removed.
Showing 20 of 1154 results
Lead a team of engineers to optimize Anthropic's inference infrastructure for AI systems.
Join Anthropic's Inference team to build and maintain systems that serve AI models to millions of users worldwide.
Join Abridge as a Machine Learning Infrastructure Engineer to optimize AI model inference infrastructure in a fast-paced healthcare startup.
Join Sierra as a Software Engineer on the Inference team to build efficient AI systems for customer-facing applications.
Own the serving infrastructure for healthcare AI, optimizing LLM inference systems to enhance patient experiences.
Own the inference systems that power frontier AI models in production and research at a tech-first startup.
Join Inferact as a co-op student to work on cutting-edge AI inference systems in a hands-on engineering role.
Join Baseten as a Software Engineer to build the distributed runtime for large-scale LLM inference in a high-impact team.
Own the product strategy for NEXUS inference offerings at a pioneering AI research lab.
Own inference performance and correctness for pre-training evaluations in a research lab focused on open AI models.
Join Anthropic's Inference team to design and maintain distributed systems that serve AI models to millions of users worldwide.
Join Baseten as an Infrastructure Software Engineer to build and maintain components of our ML inference platform for AI applications.
Join Baseten as a Software Engineer to build the API layer for Model APIs in a fast-growing AI infrastructure company.
Drive programs that scale AI serving infrastructure across multiple platforms at Anthropic.
Join Anthropic as a Staff + Sr. Software Engineer to build and scale AI systems that serve millions of users worldwide.
Join CoreWeave as a Staff Software Engineer to lead the development of a Kubernetes-native inference platform for AI workloads.
Join Baseten as a Software Engineer to optimize AI inference performance in a fast-paced startup environment.
Join Inferact as a Site Reliability Engineer to enhance the reliability and performance of AI inference systems at scale.
Join Together AI as a Staff AI Infra Engineer to enhance the reliability of our GPU inference infrastructure.