"llm inference optimization" Jobs

107 open tech roles matching “llm inference optimization”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AWS. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 107 results

Hippocratic AI

Own the serving infrastructure for healthcare AI, optimizing LLM inference systems to enhance patient experiences.

Hippocratic AI Menlo Park, CA Published 1 month ago
Flexible on stack
Hippocratic AI

Join Hippocratic AI as a senior LLM Inference Systems Engineer to build high-performance networking for large language models.

Hippocratic AI Menlo Park, CA Published 1 month ago
Flexible on stack
ChipAgents

Join ChipAgents as an ML Systems Engineer to optimize LLM inference systems for leading semiconductor companies.

ChipAgents San Jose $150k–$350k/yr Published 6 days ago
Flexible on stack
Inworld AI

Join Inworld AI as a Senior Machine Learning Engineer to optimize and run real-time AI inference systems in a collaborative environment.

Inworld AI Mountain View, California, USA $250k–$300k/yr Published 2 weeks ago
Flexible on stack
Abridge

Join Abridge as a Machine Learning Infrastructure Engineer to optimize AI model inference infrastructure in a fast-paced healthcare startup.

Abridge SF Office Published 1 year ago
Flexible on stack
Sesame

Join Sesame as an ML Model Serving Engineer to enhance our serving layer for voice agents with cutting-edge techniques.

Sesame San Francisco Published 1 week ago
Flexible on stack
Periodic Labs

Join Periodic Labs as an ML Systems Engineer to build and optimize large-scale training and reinforcement learning infrastructure.

Periodic Labs Menlo Park, CA $250k–$350k/yr Published 6 months ago
Flexible on stack
Perplexity

Join Perplexity as a technical program manager to drive the core inference platform and coordinate between model providers and engineering teams.

Perplexity San Francisco Published 2 months ago
krea.ai

Join Krea as an ML Researcher to finetune diffusion models and enhance AI creative tools in a collaborative environment.

krea.ai San Francisco Published 2 months ago
Flexible on stack
Datadog

Join Datadog as a Senior AI Research Engineer to build large-scale LLM training and inference infrastructure.

Datadog Paris, France Published 2 days ago
Flexible on stack
Perplexity AI

Join Perplexity AI as a technical program manager to drive the core inference platform and coordinate across teams and model providers.

Perplexity AI San Francisco Published 2 months ago
Together AI

Join Together AI as a Forward Deployed Engineer to optimize inference systems for strategic customers in a hands-on role.

Together AI Singapore Published 3 months ago
Flexible on stack 70% coding
Genesis Molecular AI

Join Genesis Molecular AI as an ML Research Engineer to develop cutting-edge foundation models for drug discovery.

Genesis Molecular AI San Mateo, CA Published 1 year ago
Flexible on stack 70% coding
Sarvam AI

Join Sarvam AI as a Senior Performance Engineer to optimize GPU kernels for high-performance ML systems.

Sarvam AI Bengaluru Published 3 months ago
WisdomAI

Join WisdomAI as a Research Engineer to turn cutting-edge AI research into impactful production systems for enterprise customers.

WisdomAI San Mateo $280k+/yr Published 3 weeks ago
Flexible on stack