"speculative decoding" Jobs
30 open tech roles matching “speculative decoding”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, CUDA, C++. Every listing is re-checked daily and closed roles are removed.
Showing 20 of 30 results
Own Sarvam's production serving path for large distributed models, integrating and optimizing performance across a multi-node stack.
Own the serving infrastructure for healthcare AI, optimizing LLM inference systems to enhance patient experiences.
Join Inworld AI as a Staff/Principal Machine Learning Engineer to optimize and serve top-ranked realtime voice models.
Join Inworld AI as a Staff/Principal Machine Learning Engineer to optimize and serve top-ranked realtime voice models.
Own the inference systems that power frontier AI models in production and research at a tech-first startup.
Join Inworld AI as a Staff/Principal Machine Learning Engineer to optimize and serve state-of-the-art voice models in a fully remote role.
Join Inworld AI as a Lead Machine Learning Engineer to optimize and serve state-of-the-art voice models in a dynamic startup environment.
Join Inworld AI as a Lead Machine Learning Engineer to optimize and serve state-of-the-art voice models in a dynamic environment.
Join Inferact as a Developer Relations Engineer to shape how developers learn and build with vLLM, the AI inference engine.
Join SpaceX as a Software Engineer to develop high-performance AI inference systems for mission-critical applications.
Join Together AI as a Forward Deployed Engineer to optimize inference systems for strategic customers in a hands-on role.
Join Perplexity AI as an AI Inference Engineer to optimize and develop our inference engine for various model architectures.
Lead the Production Inference team at DeepL, focusing on performance-critical model serving systems in a fast-paced AI environment.
Join Perplexity AI as a Technical Staff member to enhance our AI inference engine with cutting-edge technologies.
Join Baseten as a Software Engineer focusing on Model APIs to enhance AI model performance and developer experience.