"llm inference systems" Jobs

412 open tech roles matching “llm inference systems”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AI/ML. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 412 results

Etched

Join Etched as a Site Reliability Engineer to build the command-and-control layer for frontier inference systems in San Jose.

Etched San Jose Published 1 week ago
Flexible on stack
Inworld AI

Join Inworld AI as a Senior Content Marketing Manager to shape the voice of realtime AI in public and engage with developer communities.

Inworld AI Mountain View, California, USA $150k–$210k/yr Published 1 month ago
AI-first team
Sierra

Join Sierra as a Software Engineer, Infrastructure, to design and maintain core systems for our AI platform in a collaborative environment.

Sierra San Francisco, CA Published 5 months ago
Flexible on stack
Fireworks AI

Join Fireworks AI as an Applied Machine Learning Engineer to bridge AI research and real-world applications in a collaborative environment.

Fireworks AI London Published 2 months ago
Flexible on stack
Fireworks AI

Join Fireworks AI as a Backend Software Engineer to design and develop core backend systems for a high-performance generative AI platform.

Fireworks AI Singapore Published 4 months ago
Flexible on stack
Decagon

Design and operate data systems that power Decagon's AI products, ensuring high reliability and performance.

Decagon San Francisco $200k–$400k/yr Published 2 months ago
Flexible on stack
Illumio

Lead and grow a team of backend engineers building scalable cloud services and AI-powered platform capabilities.

Illumio Sunnyvale, California - HQ Published 2 weeks ago
Flexible on stack Heavy meetings
Enterpret

Own the Graph Platform at Enterpret, leading data systems and architecture decisions for a customer feedback intelligence platform.

Enterpret Bengaluru, Onsite Published 2 months ago
Flexible on stack
Stripe

Own the full lifecycle of ML models to detect fraud in Stripe's global payments network.

Stripe N/A Published 1 month ago
Flexible on stack
Sierra

Join Sierra as a Software Engineer on the Site Reliability team to enhance the reliability and scalability of AI-driven infrastructure.

Sierra San Francisco, CA Published 1 year ago
Flexible on stack
Sesame

Join Sesame as a Research Engineer to innovate in NLP, Speech, and Computer Vision with a focus on deep learning.

Sesame San Francisco Published 5 months ago
Flexible on stack
Tavus

Join Tavus as a Senior Software Engineer to enhance the infrastructure behind real-time AI conversations.

Tavus Remote Published 6 months ago
Flexible on stack
Hippocratic AI

Join Hippocratic AI as a Staff Site Reliability Engineer to manage a fleet of GPU-backed models and enhance healthcare AI systems.

Hippocratic AI Gurugram, India Published 1 week ago
Flexible on stack
Harvey AI

Lead a high-performing team to develop and manage the model infrastructure platform at Harvey AI.

Harvey AI San Francisco $272k–$355k/yr Published 3 months ago
Heavy meetings
AssemblyAI

Own the agent experience for AssemblyAI, enabling seamless integration for developers using AI coding agents.

AssemblyAI North America $160k–$210k/yr Published 4 weeks ago
Flexible on stack
Illumio

Lead and grow a team of backend engineers building scalable cloud services and AI-powered platform capabilities.

Illumio Sunnyvale, California - HQ Published 2 weeks ago
Flexible on stack Heavy meetings
Graphcore

Explore a research career at Graphcore through a PhD internship, gaining hands-on experience on real projects.

Graphcore Bristol, UK; Cambridge, UK; London, UK Published 3 weeks ago
Flexible on stack
Coreweave

Join CoreWeave as a Senior Applied ML Engineer to tackle challenges in continuous learning for AI agents with a focus on innovative solutions.

Coreweave Bellevue, WA / Sunnyvale, CA $182k–$242k/yr Published 7 months ago
Flexible on stack
Snorkel AI

Join Snorkel AI as a Senior/Staff AI Engineer to build infrastructure for large-scale AI experimentation and production systems.

Snorkel AI New York City, NY (Hybrid); San Francisco, CA (Hybrid) Published 2 months ago
Flexible on stack
Pinterest

Lead technical vision for AI/ML infrastructure at Pinterest, focusing on model training and serving.

Pinterest Palo Alto, CA; US; San Francisco, CA, US $285.5k–$449.5k/yr Published 2 weeks ago
Flexible on stack