"llm inference optimization" Jobs

36 open tech roles matching “llm inference optimization”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AWS. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 36 results

Anthropic

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 3 months ago
Flexible on stack
Anthropic

Join Anthropic's Inference team to build and maintain systems that serve AI models to millions of users worldwide.

Anthropic Ontario, CAN Published 6 days ago
Flexible on stack
Anthropic

Join Anthropic as a Staff Software Engineer to design and optimize backend services for cloud inference at scale.

Anthropic San Francisco, CA $320k–$485k/yr Published 2 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff Software Engineer to enhance deployment infrastructure for AI systems in a collaborative environment.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 1 month ago
Flexible on stack
Anthropic

Join Anthropic's Inference team to design and maintain distributed systems that serve AI models to millions of users worldwide.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 2 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff Software Engineer to optimize and scale AI inference across major cloud platforms.

Anthropic San Francisco, CA $320k–$485k/yr Published 2 months ago
Flexible on stack
Cloudflare

Join Cloudflare as a Lead Machine Learning Engineer to architect a scalable AI/ML platform in a hybrid role based in Austin.

Cloudflare Hybrid Published 1 month ago
Flexible on stack
Inflection AI
Inflection AI Palo Alto, California, United States $350k–$500k/yr Published 3 months ago
LangChain

Join LangChain as a Research Engineer to enhance the capabilities of the LangSmith Engine for AI agents.

LangChain New York, NY Published 1 week ago
Flexible on stack
Okta

Join Okta as a Staff Machine Learning Engineer to architect and deploy scalable Generative AI systems in a hybrid work environment.

Okta Toronto, Ontario, Canada CA$168k–CA$231k/yr Published 5 days ago
Flexible on stack
Asana

Lead Asana's AI Platform organization to drive strategy and execution for AI experiences across the company.

Asana San Francisco $306k–$360k/yr Published 2 weeks ago
Reddit

Join Reddit's Ads Creative Effectiveness team as a Senior Software Engineer to build generative products for impactful ad campaigns.

Reddit Remote - United States Published 2 months ago