"llm inference" Jobs

46 open tech roles matching “llm inference”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AWS. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 46 results

Roboflow

Join Roboflow as a Machine Learning Engineer to enhance our inference engine and contribute to impactful computer vision projects.

Roboflow NY, SF or Remote Published 2 months ago
Flexible on stack
Anthropic

Lead a team of engineers to optimize Anthropic's inference infrastructure for AI systems.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$625k/yr Published 1 week ago
Flexible on stack Heavy meetings
Anthropic

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 3 months ago
Flexible on stack
Anthropic

Join Anthropic as a Performance Engineer to optimize the inference engine for AI systems at scale.

Anthropic San Francisco, CA | New York City, NY $350k–$850k/yr Published 4 days ago
Flexible on stack
Reflection AI

Lead the post-training and evaluation capabilities for large language models in a dynamic AI research lab.

Reflection AI New York, NY Published 10 months ago
Anthropic

Join Anthropic's Inference team to design and maintain distributed systems that serve AI models to millions of users worldwide.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 3 months ago
Flexible on stack
AssemblyAI

Join a small team at AssemblyAI as a Senior Software Engineer to develop cutting-edge AI products and APIs.

AssemblyAI New York $190k–$225k/yr Published 1 week ago
Anthropic

Join Anthropic's Inference team to design and maintain distributed systems serving AI models to millions globally.

Anthropic New York City, NY; San Francisco, CA | Seattle, WA $320k–$485k/yr Published 2 weeks ago
Flexible on stack
Anthropic

Join Anthropic as a Staff Software Engineer to enhance deployment infrastructure for AI systems in a collaborative environment.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 2 months ago
Flexible on stack
Imprint

Deliver analytical projects that influence product decisions and marketing campaigns in a fast-paced startup environment.

Imprint New York City Published 1 month ago
Flexible on stack
LangChain

Join LangChain as a Research Engineer to enhance the capabilities of the LangSmith Engine for AI agents.

LangChain New York, NY Published 1 month ago
Flexible on stack
Doctronic

Join Doctronic as a DevOps Engineer to own and enhance our infrastructure for AI-driven healthcare solutions.

Doctronic New York City $180k–$240k/yr Published 2 months ago
70% coding
LangChain

Lead technical projects and mentor engineers in building AI agents at LangChain's NYC office.

LangChain New York, NY $160k–$200k/yr Published 1 week ago
Flexible on stack 60% coding
AssemblyAI

Join AssemblyAI as a Commercial Counsel to lead the legal aspects of our enterprise sales and commercial contracting lifecycle.

AssemblyAI New York $190k–$225k/yr Published 2 weeks ago
Databricks
Databricks New York City, New York; San Francisco, California $190k–$270k/yr Published 4 months ago
Databricks

Develop and run the research stack that powers Databricks AI Research, enabling rapid large-scale experiments.

Databricks New York City, New York; San Francisco, California $199k–$270k/yr Published 4 months ago
Flexible on stack
Reflection AI

Lead the Forward Deployed Engineering function at Reflection AI, bridging cutting-edge AI research with enterprise deployments.

Reflection AI New York, NY Published 4 months ago
Flexible on stack
Snorkel AI

Join Snorkel AI as a Senior/Staff AI Engineer to build infrastructure for large-scale AI experimentation and production systems.

Snorkel AI New York City, NY (Hybrid); San Francisco, CA (Hybrid) Published 5 days ago
Flexible on stack
Attentive Mobile

Join Attentive as a Staff Software Engineer to architect and build the AI/ML infrastructure for a leading marketing platform.

Attentive Mobile United States $200k–$300k/yr Published 3 months ago
Flexible on stack