"llm inference systems" Jobs

385 open tech roles matching “llm inference systems”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, PyTorch. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 385 results

Fireworks AI

Join Fireworks AI as a Security Engineer to design and implement security controls across AI infrastructure and platforms.

Fireworks AI San Mateo Published 7 months ago
Flexible on stack
Tavus

Join Tavus as a Senior Software Engineer to drive the development of a multimodal real-time conversational product.

Tavus San Francisco Published 2 months ago
70% coding
Anthropic
Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 5 months ago
Postman

Join Postman as an AI Engineer Intern to work on large-scale AI systems with mentorship from senior engineers.

Postman Berkeley, California, United States; San Francisco, California, United States Published 1 month ago
Flexible on stack
Twilio

Join Twilio as a Sr AI Architect to lead the development of cutting-edge conversational AI capabilities in a remote-first environment.

Twilio Remote - US $275.8k–$405.6k/yr Published 1 month ago
Sprinter Health

Join Sprinter Health as an Applied Scientist, AI to develop machine learning models that enhance healthcare access and operational efficiency.

Sprinter Health San Francisco, CA Published 1 month ago
Flexible on stack
Arena

Join Arena as a Software Engineer to build systems that ensure the integrity and safety of AI evaluations against abuse.

Arena Bay Area Published 4 months ago
Flexible on stack 70% coding
Magentic

Join Magentic as a Back-end Engineer to build scalable AI-driven backend services for enterprise supply chains.

Magentic London £125k–£140k/yr Published 3 months ago
Flexible on stack
Tigera

Own the ML and applied AI aspects of a new product tackling security challenges in enterprise infrastructure.

Tigera Vancouver CA$160k–CA$180k/yr Published 1 month ago
Flexible on stack
AKASA

Join AKASA as a Sr. Machine Learning Engineer to develop state-of-the-art ML solutions that empower healthcare professionals.

AKASA Remote - United States $175k–$230k/yr Published 3 months ago
Flexible on stack
Vanta

Own the data systems at Vanta, enhancing trustworthiness and efficiency in signal processing and ingestion.

Vanta Remote U.S. Published 3 weeks ago
Flexible on stack
Coreweave

Join CoreWeave as a Senior Engineer to build performance insights and observability systems for AI infrastructure.

Coreweave Sunnyvale, CA / Bellevue, WA $182k–$242k/yr Published 1 month ago
Flexible on stack
Anthropic

Join Anthropic as a Staff+ Software Engineer to build and scale Claude Managed Agents in a rapidly growing team.

Anthropic San Francisco, CA | New York City, NY $405k–$485k/yr Published 3 weeks ago
Verkada

Lead Verkada's Search team to enhance AI-powered search and computer vision capabilities for their camera fleet.

Verkada San Mateo, CA, United States $200k–$315k/yr Published 4 months ago
Flexible on stack Heavy meetings
Harvey AI

Join Harvey as a Staff Product Manager to shape the infrastructure of a leading legal AI platform with a focus on reliability and scalability.

Harvey AI San Francisco $213.6k–$300k/yr Published 2 months ago
AI-first team
baseten

Join Baseten as a Forward Deployed Engineer to solve complex AI challenges for leading companies.

baseten San Francisco Published 3 weeks ago
Flexible on stack
OpenRouter

Join OpenRouter as a Program Manager to scale provider partnerships and build a structured program in a fast-paced AI ecosystem.

OpenRouter Remote (US) Published 1 month ago
Fireworks AI

Own foundational capabilities for enterprise AI, designing data models and APIs while ensuring security and compliance for large-scale customers.

Fireworks AI New York Published 1 month ago
Flexible on stack
Harvey AI

Join Harvey AI as a Staff Software Engineer to build and operate core infrastructure for AI workloads in a fast-growing company.

Harvey AI New York $231k–$340k/yr Published 1 month ago
SingleStore

Join SingleStore as a Software Engineer to design and implement core AI/ML platform capabilities in a dynamic, engineering-focused team.

SingleStore India Published 7 months ago
Flexible on stack 70% coding