"llm inference systems" Jobs

146 open tech roles matching “llm inference systems”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AI/ML. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 146 results

Pinterest

Lead the technical direction of backend systems for AI-driven product experiences at Pinterest.

Pinterest San Francisco, CA, US; Remote, US $177.2k–$364.8k/yr Published 3 weeks ago
Flexible on stack
Together AI

Join Together AI as a Senior Software Engineer to design and implement a scalable observability platform for our generative AI lifecycle.

Together AI San Francisco $200k–$280k/yr Published 10 months ago
Flexible on stack
Harvey AI

Join Harvey AI as a Research Engineer to drive post-training experiments and enhance legal AI models.

Harvey AI San Francisco $231k–$340k/yr Published 2 months ago
Flexible on stack
Tavus

Join Tavus as a Senior Software Engineer to drive the development of a multimodal real-time conversational product.

Tavus San Francisco Published 2 months ago
70% coding
Postman

Join Postman as an AI Engineer Intern to work on large-scale AI systems with mentorship from senior engineers.

Postman Berkeley, California, United States; San Francisco, California, United States Published 1 month ago
Flexible on stack
Sprinter Health

Join Sprinter Health as an Applied Scientist, AI to develop machine learning models that enhance healthcare access and operational efficiency.

Sprinter Health San Francisco, CA Published 2 months ago
Flexible on stack
AKASA

Join AKASA as a Sr. Machine Learning Engineer to develop state-of-the-art ML solutions that empower healthcare professionals.

AKASA Remote - United States $175k–$230k/yr Published 3 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff+ Software Engineer to build and scale Claude Managed Agents in a rapidly growing team.

Anthropic San Francisco, CA | New York City, NY $405k–$485k/yr Published 1 month ago
Harvey AI

Join Harvey as a Staff Product Manager to shape the infrastructure of a leading legal AI platform with a focus on reliability and scalability.

Harvey AI San Francisco $213.6k–$300k/yr Published 2 months ago
AI-first team
baseten

Join Baseten as a Forward Deployed Engineer to solve complex AI challenges for leading companies.

baseten San Francisco Published 1 month ago
Flexible on stack
SingleStore

Join SingleStore as a Software Engineer to design and implement core AI/ML platform capabilities in a dynamic, engineering-focused team.

SingleStore India Published 7 months ago
Flexible on stack 70% coding
Harvey AI

Join Harvey AI as a Staff Software Engineer to build and operate core infrastructure for AI workloads in a fast-growing company.

Harvey AI San Francisco $231k–$340k/yr Published 1 month ago
Flexible on stack
Asana

Lead Asana's AI Platform organization to drive strategy and execution for AI experiences across the company.

Asana San Francisco $306k–$360k/yr Published 1 month ago
Harvey AI

Lead a high-performing team to build and operate Harvey's core compute and networking infrastructure for AI-driven legal services.

Harvey AI San Francisco $272k–$355k/yr Published 2 months ago
Flexible on stack Heavy meetings
Okta

Join Okta as a Principal Machine Learning Engineer to advance AI security mechanisms in a hybrid work environment.

Okta San Francisco, California $238k–$326k/yr Published 4 days ago
Flexible on stack
Faire

Join Faire as a Senior Applied AI/ML Scientist to drive retailer growth through innovative machine learning solutions.

Faire Kitchener-Waterloo, ON; Toronto, ON CA$180k–CA$247.5k/yr Published 1 month ago
Flexible on stack
AssemblyAI

Lead the sales organization for digital native companies at AssemblyAI, focusing on voice AI solutions.

AssemblyAI San Francisco $350k–$450k/yr Published 4 days ago
Harvey AI

Join Harvey AI as a Senior Software Engineer to build and operate core infrastructure for leading law firms and enterprises.

Harvey AI San Francisco $161.3k–$241.9k/yr Published 1 month ago
Flexible on stack
Pinterest

Lead technical vision and foundational work in AI and search systems at Pinterest, impacting millions of users.

Pinterest San Francisco, CA, US; Remote, US $242.6k–$449.5k/yr Published 1 month ago