"speculative decoding" Jobs

10 open tech roles matching “speculative decoding”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, vLLM, TensorRT-LLM. Every listing is re-checked daily and closed roles are removed.

Showing 10 of 10 results

Sarvam AI

Own Sarvam's production serving path for large distributed models, integrating and optimizing performance across a multi-node stack.

Sarvam AI Bengaluru Published 1 month ago
Hippocratic AI

Own the serving infrastructure for healthcare AI, optimizing LLM inference systems to enhance patient experiences.

Hippocratic AI Menlo Park, CA Published 3 weeks ago
Flexible on stack
Together AI

Join Together AI as a Forward Deployed Engineer to optimize inference systems for strategic customers in a hands-on role.

Together AI Singapore Published 1 month ago
Flexible on stack 70% coding
Coreweave
Coreweave Sunnyvale, CA / Bellevue, WA $165k–$242k/yr Published 11 months ago
Coreweave
Coreweave Sunnyvale, CA / Bellevue, WA $139k–$204k/yr Published 7 months ago
Fireworks AI

Join Fireworks AI as an Applied Machine Learning Engineer to bridge AI research and real-world applications in a collaborative environment.

Fireworks AI London Published 1 week ago
Flexible on stack
AssemblyAI

Join AssemblyAI as a Senior Research Engineer to enhance large-scale distributed training and inference systems in Voice AI.

AssemblyAI Remote - New York $270k–$310k/yr Published 1 week ago
Flexible on stack
Ambient

Design and optimize AI infrastructure for real-time intelligence at Ambient.ai, enhancing security through advanced AI models.

Ambient Redwood City Published 2 months ago
Flexible on stack 70% coding