"llm inference systems" Jobs

433 open tech roles matching “llm inference systems”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AI/ML. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 433 results

Inworld AI

Join Inworld AI as a Staff/Principal Machine Learning Engineer to optimize and serve top-ranked realtime voice models.

Inworld AI UK £140k–£200k/yr Published 7 months ago
Flexible on stack
Inworld AI

Join Inworld AI as a Staff/Principal Machine Learning Engineer to optimize and serve top-ranked realtime voice models.

Inworld AI Mountain View, California, USA $270k–$500k/yr Published 7 months ago
Flexible on stack
Perplexity

Join Perplexity as a Machine Learning Engineer to enhance AI systems for search and problem-solving in a full-stack environment.

Perplexity Belgrade Published 1 month ago
baseten

Join Baseten as a Software Engineer to optimize AI inference performance in a fast-paced startup environment.

baseten San Francisco Published 1 month ago
Flexible on stack
Perplexity AI

Join Perplexity AI as a Machine Learning Engineer to enhance AI systems for search and reasoning in a collaborative environment.

Perplexity AI Belgrade Published 1 month ago
Sarvam AI

Own Sarvam's production serving path for large distributed models, integrating and optimizing performance across a multi-node stack.

Sarvam AI Bengaluru Published 3 months ago
Ricursive Intelligence

Explore opportunities at Ricursive Intelligence, a frontier AI Lab focused on self-improving systems and chip design.

Ricursive Intelligence Palo Alto Published 3 months ago
Inworld AI

Join Inworld AI as a Staff/Principal Machine Learning Engineer to optimize and serve state-of-the-art voice models in a fully remote role.

Inworld AI Switzerland Published 7 months ago
Flexible on stack
Sierra

Join Sierra as a Software Engineer on the Inference team to build efficient AI systems for customer-facing applications.

Sierra San Francisco, CA Published 1 month ago
Inferact

Own product marketing for vLLM and Inferact, translating complex AI infrastructure into developer-facing messaging.

Inferact San Francisco Published 1 month ago
Roboflow

Join Roboflow as a Machine Learning Engineer to enhance our inference engine and contribute to impactful computer vision projects.

Roboflow NY, SF or Remote Published 4 months ago
Flexible on stack
baseten

Join Baseten as a Software Engineer to build the distributed runtime for large-scale LLM inference in a high-impact team.

baseten San Francisco Published 1 month ago
Inworld AI

Join Inworld AI as a Lead Machine Learning Engineer to optimize and serve state-of-the-art voice models in a dynamic startup environment.

Inworld AI Germany Published 7 months ago
Flexible on stack
Anthropic

Join Anthropic's Inference team to build and maintain systems that serve AI models to millions of users worldwide.

Anthropic Ontario, CAN Published 2 months ago
Flexible on stack
Airbnb

Lead the fine-tuning and optimization of LLMs to enhance AI products at Airbnb with a focus on customer support.

Airbnb United States $292k–$365k/yr Published 5 months ago
Flexible on stack
Abridge

Join Abridge as a Machine Learning Infrastructure Engineer to optimize AI model inference infrastructure in a fast-paced healthcare startup.

Abridge SF Office Published 1 year ago
Flexible on stack
Anthropic

Lead a team of engineers to optimize Anthropic's inference infrastructure for AI systems.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$625k/yr Published 2 months ago
Flexible on stack Heavy meetings