"llm inference optimization" Jobs

113 open tech roles matching “llm inference optimization”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AWS. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 113 results

Datadog

Join Datadog as a Senior AI Research Engineer to optimize GPU systems and kernels for large-scale model training and inference.

Datadog Paris, France Published 6 days ago
Flexible on stack
Etched

Lead the development of infrastructure tooling for AI ASICs at a cutting-edge startup in San Jose.

Etched San Jose Published 9 months ago
Flexible on stack
Hippocratic AI

Join Hippocratic AI as a Senior Manager of Strategic Finance to provide critical insights during a period of rapid growth.

Hippocratic AI Menlo Park, CA Published 3 weeks ago
baseten

Join Baseten as a Product Manager to enhance the developer experience in AI inference and shape the future of AI products.

baseten San Francisco Published 3 days ago
Flexible on stack
Etched

Join Etched as a Senior Signal & Power Integrity Engineer to optimize electrical performance for cutting-edge AI accelerator platforms.

Etched San Jose Published 2 months ago
Flexible on stack
Hebbia AI

Join Hebbia AI as a Backend Engineer to build scalable solutions for advanced AI-driven investment analysis.

Hebbia AI NYC $160k–$350k/yr Published 1 year ago
Flexible on stack
Robinhood

Join Robinhood as a Senior Machine Learning Engineer to lead the architecture of scalable ML systems in a hybrid work environment.

Robinhood Menlo Park, CA $209k–$245k/yr Published 1 month ago
Flexible on stack 70% coding
PagerDuty

Join PagerDuty as a Senior AI/ML Engineer to design and build AI-powered features for high-volume, real-time event streams.

PagerDuty Lisbon Published 2 months ago
Flexible on stack
baseten

Join Baseten as a Technical Program Manager to build and optimize the core algorithms for high-performance AI inference.

baseten San Francisco Published 2 months ago
MaintainX

Lead the technical direction for predictive maintenance and asset intelligence initiatives at MaintainX, focusing on AI and ML.

MaintainX Canada Published 2 months ago
Flexible on stack
Hippocratic AI

Own the backend infrastructure for AI agents in healthcare, ensuring reliability and scalability in a fast-paced environment.

Hippocratic AI Menlo Park, CA Published 2 days ago
Flexible on stack
Truecaller

Join Truecaller as a Senior MLOps Engineer to own the ML platform on GCP and support data teams in building reliable models.

Truecaller Sweden Published 4 days ago
Flexible on stack
OpenRouter

Join OpenRouter as a senior Software Engineer to build a flexible financial platform for AI-driven applications.

OpenRouter Remote (US) Published 3 weeks ago
Flexible on stack
OpenRouter

Join OpenRouter as a Product Manager to build a marketplace connecting developers and inference providers in the AI ecosystem.

OpenRouter Remote (US) Published 2 weeks ago
Inflection AI
Inflection AI Palo Alto, California, United States $350k–$500k/yr Published 6 months ago
Coreweave

Join CoreWeave as a Senior Engineer to build performance insights and observability systems for AI infrastructure.

Coreweave Sunnyvale, CA / Bellevue, WA $182k–$242k/yr Published 3 months ago
Flexible on stack
Coreweave

Join CoreWeave as a Senior Software Engineer to build and scale Weave, an observability platform for AI agents.

Coreweave Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA / San Francisco, CA $165k–$220k/yr Published 4 months ago
Flexible on stack
Etched

Own full-chip implementation for frontier inference clusters at a cutting-edge AI hardware startup.

Etched San Jose Published 3 months ago
Flexible on stack
Harvey AI

Lead a high-performing team to develop and manage the model infrastructure platform at Harvey AI.

Harvey AI San Francisco $272k–$355k/yr Published 3 months ago
Heavy meetings