"llm inference systems" Jobs

426 open tech roles matching “llm inference systems”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AI/ML. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 426 results

Pika

Join Pika as a Senior/Staff ML Engineer to enhance AI-driven products through advanced inference acceleration and GPU optimization.

Pika US remote Published 4 months ago
Flexible on stack
Sesame

Join Sesame as an ML Model Serving Engineer to enhance our serving layer for voice agents with cutting-edge techniques.

Sesame San Francisco Published 1 week ago
Flexible on stack
Inworld AI

Join Inworld AI as a Staff/Principal Research Scientist to innovate in real-time voice models and impact AI applications globally.

Inworld AI UK £140k–£200k/yr Published 7 months ago
Preference Model

Join Preference Model as a Senior ML Infrastructure Engineer to build scalable infrastructure for post-training research on large language models.

Preference Model San Francisco Published 3 weeks ago
Flexible on stack
Anthropic

Join Anthropic's Inference team to design and maintain distributed systems that serve AI models to millions of users worldwide.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 5 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff + Sr. Software Engineer to build and scale AI systems that serve millions of users worldwide.

Anthropic New York City, NY; San Francisco, CA; Seattle, WA $320k–$485k/yr Published 1 month ago
Flexible on stack
Lilt

Lead complex benchmark transformations and data deliverables as a Senior Technical Program Manager in Applied AI.

Lilt Boston, MA Published 3 weeks ago
Flexible on stack
Sarvam AI

Join Sarvam AI as an SDE2 to build and evolve the LLM API platform using Python and Go.

Sarvam AI Bengaluru Published 1 week ago
Flexible on stack
Gimlet Labs

Build Gimlet's AI Compiler Stack to optimize AI workloads across diverse hardware architectures.

Gimlet Labs San Francisco, CA Published 8 months ago
Flexible on stack
Perplexity AI

Join Perplexity AI as a technical program manager to drive the core inference platform and coordinate across teams and model providers.

Perplexity AI San Francisco Published 2 months ago
Perplexity AI

Join Perplexity AI as an AI Infrastructure Engineer to build and optimize large-scale AI training and inference clusters.

Perplexity AI London Published 7 months ago
Flexible on stack
Perplexity AI

Join Perplexity AI as a Technical Staff member to enhance our AI inference engine with cutting-edge technologies.

Perplexity AI San Francisco Published 7 months ago
Flexible on stack
Lilt

Lead complex benchmark transformations and data deliverables in a senior role focused on applied AI at Lilt.

Lilt London, UK Published 2 months ago
Flexible on stack
Macroscope

Join Macroscope as a Senior Backend Infrastructure Engineer to shape and scale core services and inference platforms.

Macroscope San Francisco Published 1 month ago
Flexible on stack
WisdomAI

Join WisdomAI as a Research Engineer to turn cutting-edge AI research into impactful production systems for enterprise customers.

WisdomAI San Mateo $280k+/yr Published 3 weeks ago
Flexible on stack
Triomics

Join Triomics as an MLOps & Data Engineer to build infrastructure for ML workflows in oncology, impacting patient outcomes.

Triomics India Office Published 4 months ago
Flexible on stack