"llm inference systems" Jobs

146 open tech roles matching “llm inference systems”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AI/ML. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 146 results

Fal

Join fal as a Senior Solutions Architect to engage with clients and design scalable AI solutions in a growing generative media ecosystem.

Fal San Francisco $220k–$290k/yr Published 1 month ago
Flexible on stack
Decagon

Design and operate data systems that power Decagon's AI products, ensuring high reliability and performance.

Decagon San Francisco $200k–$400k/yr Published 3 weeks ago
Flexible on stack
Harvey

Lead the design and development of systems powering AI requests at Harvey, ensuring high reliability and operational excellence.

Harvey San Francisco $193.4k–$290k/yr Published 2 weeks ago
Flexible on stack 60% coding
Sierra

Join Sierra as a Software Engineer on the Site Reliability team to enhance the reliability and scalability of AI-driven infrastructure.

Sierra San Francisco, CA Published 11 months ago
Flexible on stack
Sesame

Join Sesame as a Research Engineer to innovate in NLP, Speech, and Computer Vision with a focus on deep learning.

Sesame San Francisco Published 3 months ago
Flexible on stack
Harvey AI

Lead a high-performing team to develop and manage the model infrastructure platform at Harvey AI.

Harvey AI San Francisco $272k–$355k/yr Published 2 months ago
Heavy meetings
Databricks

Develop and run the research stack that powers Databricks AI Research, enabling rapid large-scale experiments.

Databricks New York City, New York; San Francisco, California $199k–$270k/yr Published 4 months ago
Flexible on stack
Databricks
Databricks New York City, New York; San Francisco, California $190k–$270k/yr Published 4 months ago
Snorkel AI

Join Snorkel AI as a Senior/Staff AI Engineer to build infrastructure for large-scale AI experimentation and production systems.

Snorkel AI New York City, NY (Hybrid); San Francisco, CA (Hybrid) Published 1 week ago
Flexible on stack
Handshake

Join Handshake as a Senior Software Engineer to build scalable ML infrastructure for a fast-growing AI data business.

Handshake San Francisco, CA Published 2 months ago
Flexible on stack
baseten

Join Baseten as an AI Engineer to build AI-driven product features and enhance internal workflows.

baseten San Francisco Published 1 month ago
Flexible on stack
Together AI

Build production AI agent systems for one of the world's largest GPU fleets at Together AI.

Together AI San Francisco $250k–$300k/yr Published 1 week ago
Flexible on stack
Mixpanel

Join Mixpanel as a Senior Data Scientist to drive AI-powered product insights and analytics for thousands of companies.

Mixpanel San Francisco, US (Hybrid) $216k–$254k/yr Published 1 month ago
Flexible on stack
Stripe

Serve as a technical lead for the ML Platform at Stripe, influencing strategy and driving impactful projects.

Stripe San Francisco, Seattle Published 3 months ago
Pinterest

Lead the technical vision for Ads Conversion Core Modeling at Pinterest, focusing on applied ML projects and large-scale model development.

Pinterest San Francisco, CA, US; Palo Alto, CA, US; Seattle, WA, US $222.7k–$389.8k/yr Published 2 months ago
Faire

Own the technical vision of Faire’s ML platform, leading cross-functional initiatives to enhance data science velocity at scale.

Faire Remote - US; San Francisco, CA $295k–$405.5k/yr Published 1 month ago
Flexible on stack
AssemblyAI

Join AssemblyAI as a Senior Design Engineer to shape and build exceptional product experiences in a fast-growing AI company.

AssemblyAI San Francisco $180k–$240k/yr Published 1 month ago
Flexible on stack
Anthropic

Join Anthropic as a Tech Lead to build reliable AI evaluation systems in a hybrid work environment.

Anthropic San Francisco, CA $500k–$850k/yr Published 2 months ago
Flexible on stack
Peregrine

Lead the development of AI-powered features for an end-to-end intelligence platform in public safety.

Peregrine San Francisco, CA $225k–$320k/yr Published 7 months ago