"llm inference systems" Jobs

392 open tech roles matching “llm inference systems”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, PyTorch. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 392 results

Exa

Join Exa's Infrastructure Team to build massive-scale ML systems that redefine how AI consumes information.

Exa San Francisco, California Published 1 year ago
Fal

Join fal as a Senior Solutions Architect to engage with clients and design scalable AI solutions in a growing generative media ecosystem.

Fal San Francisco $220k–$290k/yr Published 1 month ago
Flexible on stack
Decagon

Design and operate data systems that power Decagon's AI products, ensuring high reliability and performance.

Decagon San Francisco $200k–$400k/yr Published 2 weeks ago
Flexible on stack
Reddit

Join Reddit as a Senior Security Engineer to secure AI-powered products and build reusable security primitives.

Reddit Remote - United States $190.8k–$267.1k/yr Published 2 months ago
Flexible on stack
Enterpret

Own the Graph Platform at Enterpret, leading data systems and architecture decisions for a customer feedback intelligence platform.

Enterpret Bengaluru, Onsite Published 3 weeks ago
Flexible on stack
Harvey

Lead the design and development of systems powering AI requests at Harvey, ensuring high reliability and operational excellence.

Harvey San Francisco $193.4k–$290k/yr Published 1 week ago
Flexible on stack 60% coding
Sierra

Join Sierra as a Software Engineer on the Site Reliability team to enhance the reliability and scalability of AI-driven infrastructure.

Sierra San Francisco, CA Published 10 months ago
Flexible on stack
Coreweave

Join CoreWeave as a Staff Applied ML Engineer to tackle challenges in continuous learning for AI agents with a highly autonomous team.

Coreweave Sunnyvale, CA / Bellevue, WA $185k–$275k/yr Published 5 months ago
Flexible on stack 60% coding
Faire

Own the technical vision of Faire’s ML platform, leading cross-functional initiatives to enhance data science velocity at scale.

Faire Kitchener-Waterloo, ON; Remote - Ontario; Toronto, ON CA$248k–CA$341k/yr Published 2 months ago
Flexible on stack
Sesame

Join Sesame as a Research Engineer to innovate in NLP, Speech, and Computer Vision with a focus on deep learning.

Sesame San Francisco Published 2 months ago
Flexible on stack
DeepL

Lead scientific innovation in speech and translation models for real-time voice products at DeepL.

DeepL London Published 1 month ago
Flexible on stack 70% coding
Tavus

Join Tavus as a Senior Software Engineer to enhance the infrastructure behind real-time AI conversations.

Tavus Remote Published 4 months ago
Flexible on stack
Reflection AI

Lead the Forward Deployed Engineering function at Reflection AI, bridging cutting-edge research with enterprise deployments.

Reflection AI Seoul Published 3 months ago
Flexible on stack
EigenLayer

Join EigenLayer as a Senior Agentic AI Engineer to build core systems for AI agents in a remote-friendly environment.

EigenLayer Remote $187k–$253k/yr Published 5 months ago
Flexible on stack 80% coding
Reflection AI

Lead the Forward Deployed Engineering function at Reflection AI, bridging cutting-edge AI research with enterprise deployments.

Reflection AI New York, NY Published 4 months ago
Flexible on stack
Imprint

Deliver analytical projects that influence product decisions and marketing campaigns in a fast-paced startup environment.

Imprint New York City Published 1 month ago
Flexible on stack
AssemblyAI

Join AssemblyAI as a Senior Design Engineer to shape and build exceptional product experiences in a fast-growing Voice AI company.

AssemblyAI Los Angeles $180k–$240k/yr Published 3 weeks ago
Flexible on stack
Harvey AI

Lead a high-performing team to develop and manage the model infrastructure platform at Harvey AI.

Harvey AI San Francisco $272k–$355k/yr Published 1 month ago
Heavy meetings
Coreweave

Lead a team of engineers to build and operate CoreWeave's next-generation Kubernetes-native inference platform.

Coreweave Bellevue, WA - US $188k–$303k/yr Published 9 months ago
Heavy meetings