"llm inference systems" Jobs

385 open tech roles matching “llm inference systems”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, PyTorch. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 385 results

Harvey AI

Join Harvey AI as a Staff Software Engineer to build and operate core infrastructure for AI workloads in a fast-growing company.

Harvey AI San Francisco $231k–$340k/yr Published 1 month ago
Flexible on stack
Asana

Lead Asana's AI Platform organization to drive strategy and execution for AI experiences across the company.

Asana San Francisco $306k–$360k/yr Published 1 month ago
Fireworks AI

Join Fireworks AI as a Member of Technical Staff to enhance model evaluation and fine-tuning workflows in a fast-paced generative AI environment.

Fireworks AI San Mateo Published 10 months ago
Coreweave

Join CoreWeave as a Senior Engineer to optimize GPU kernels for high-performance AI applications in a rapidly growing environment.

Coreweave Sunnyvale, CA / Bellevue, WA $182k–$242k/yr Published 2 months ago
70% coding
Roboflow

Join Roboflow as an Infrastructure Engineer to secure and scale core infrastructure in a fast-paced AI-native startup environment.

Roboflow NY, SF or Remote $165k–$200k/yr Published 1 week ago
Flexible on stack
Harvey AI

Lead a high-performing team to build and operate Harvey's core compute and networking infrastructure for AI-driven legal services.

Harvey AI San Francisco $272k–$355k/yr Published 2 months ago
Flexible on stack Heavy meetings
Faire

Join Faire as a Senior Applied AI/ML Scientist to drive retailer growth through innovative machine learning solutions.

Faire Kitchener-Waterloo, ON; Toronto, ON CA$180k–CA$247.5k/yr Published 1 month ago
Flexible on stack
Commure

Join Commure as a Senior Software Engineer to build and operate the infrastructure for AI-powered healthcare agents.

Commure Rio de Janeiro, Brazil Published 4 days ago
Flexible on stack 70% coding
Cresta

Lead the development of AI-powered voice systems for contact centers at Cresta, enhancing customer interactions through advanced machine learning.

Cresta United States (Remote) $205k–$270k/yr Published 6 months ago
Coram AI

Join Coram AI as a Senior Electrical Engineer to design cutting-edge edge-AI devices for video security.

Coram AI Bangalore Published 1 month ago
Flexible on stack
Coram AI

Join Coram AI as a Senior Electrical Engineer to design next-gen edge-AI devices for video security.

Coram AI Sunnyvale Published 1 month ago
Flexible on stack
Harvey AI

Join Harvey AI as a Senior Software Engineer to build and operate core infrastructure for leading law firms and enterprises.

Harvey AI New York $161.3k–$241.9k/yr Published 1 month ago
Flexible on stack
OpenRouter

Drive adoption and value for enterprise accounts as a Customer Success Manager at OpenRouter.

OpenRouter Remote (US) Published 2 months ago
Harvey AI

Join Harvey AI as a Senior Software Engineer to build and operate core infrastructure for leading law firms and enterprises.

Harvey AI San Francisco $161.3k–$241.9k/yr Published 1 month ago
Flexible on stack
Dataiku

Join Dataiku as a Fullstack Engineer to build core features for their AI platform in a fast-paced, innovative environment.

Dataiku France, Remote; Germany, Remote; Netherlands, Remote; Spain, Remote; United Kingdom, Remote Published 10 months ago
Flexible on stack
Protege

Join Protege as a Senior Software Engineer to lead the data processing layer for AI training data at scale.

Protege Remote Published 3 months ago
70% coding
Reddit

Join Reddit's Ads Creative Effectiveness team as a Senior Software Engineer to build generative products for impactful ad campaigns.

Reddit Remote - United States Published 3 months ago
Instacart

Lead a team of engineers to build an AI-native platform for catalog enrichment in a fully remote environment.

Instacart Canada - Remote (ON, AB, BC, or NS Only) CA$196k–CA$207k/yr Published 4 months ago
Heavy meetings
Datadog

Lead the Evaluation & Annotation team at Datadog, focusing on AI model evaluation and human annotation tooling.

Datadog Paris, France Published 3 months ago
Heavy meetings
Fireworks AI

Join Fireworks AI as a senior AI Field Engineer to lead technical partnerships and drive AI transformation in enterprise environments.

Fireworks AI San Mateo $200k–$260k/yr Published 3 months ago
Flexible on stack