"inference infrastructure" Jobs

122 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AI/ML. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 122 results

Anthropic

Join Anthropic as a Staff+ Software Engineer to enhance the Claude Platform for enterprise customers across multiple cloud environments.

Anthropic San Francisco, CA | New York City, NY $405k–$485k/yr Published 3 weeks ago
Flexible on stack
Vercel

Lead consumption forecasting at Vercel, architecting ML systems for financial planning and decision-making.

Vercel Hybrid - San Francisco, New York City $250k–$330k/yr Published 2 weeks ago
Flexible on stack
Anthropic

Lead the Search Platform team at Anthropic, focusing on building and improving search systems for AI applications.

Anthropic San Francisco, CA | New York City, NY $320k–$405k/yr Published 1 month ago
Heavy meetings
Anthropic
Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | New York City, NY $500k–$850k/yr Published 4 months ago
baseten

Lead the marketing technology and operations at Baseten, ensuring robust systems for a rapidly scaling marketing engine.

baseten New York Published 1 month ago
Flexible on stack
Doctronic

Join Doctronic as a Senior Backend Engineer to build scalable healthcare APIs and infrastructure for AI-driven healthcare solutions.

Doctronic New York City Published 1 month ago
Flexible on stack
Snorkel AI

Own the roadmap and execution for Snorkel AI's Infrastructure organization, focusing on internal platforms and security systems.

Snorkel AI New York City, NY (Hybrid); San Francisco, CA (Hybrid) $220k–$280k/yr Published 3 months ago
Anthropic
Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 5 months ago
Anthropic

Drive data-informed decisions across the commercial customer lifecycle as a Data Scientist at Anthropic.

Anthropic New York City, NY; San Francisco, CA | New York City, NY $275k–$370k/yr Published 3 months ago
Flexible on stack
Roboflow

Join Roboflow as an Infrastructure Engineer to secure and scale core infrastructure in a fast-paced AI-native startup environment.

Roboflow NY, SF or Remote $165k–$200k/yr Published 1 week ago
Flexible on stack
Anthropic
Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$405k/yr Published 4 months ago
Snorkel AI

Join Snorkel AI as a Senior/Staff AI Engineer to build infrastructure for large-scale AI experimentation and production systems.

Snorkel AI New York City, NY (Hybrid); San Francisco, CA (Hybrid) Published 6 days ago
Flexible on stack
LangChain

Join LangChain as a Research Engineer to enhance the capabilities of the LangSmith Engine for AI agents.

LangChain New York, NY Published 1 month ago
Flexible on stack
Coreweave

Lead complex cross-functional programs in performance and benchmarking for CoreWeave's AI/ML Platform Services.

Coreweave Livingston, NJ / New York, NY / Sunnyvale, CA / San Francisco, CA / Bellevue, WA $177k–$237k/yr Published 2 months ago
Attentive Mobile

Join Attentive as a Staff Software Engineer to architect and build the AI/ML infrastructure for a leading marketing platform.

Attentive Mobile United States $200k–$300k/yr Published 3 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff+ Software Engineer to build and scale Claude Managed Agents in a rapidly growing team.

Anthropic San Francisco, CA | New York City, NY $405k–$485k/yr Published 3 weeks ago
Datadog

Join Datadog as a Manager of Strategic Sourcing to lead AI spend and vendor negotiations in a hybrid work environment.

Datadog New York, New York, USA $128k–$187k/yr Published 2 months ago
Mirage

Join Mirage as a Research Engineer to build and scale systems for cutting-edge video generation models in a dynamic AI-focused environment.

Mirage Union Square, New York City Published 4 weeks ago
Flexible on stack
AssemblyAI

Join AssemblyAI as a Senior Research Engineer to enhance large-scale distributed training and inference systems in Voice AI.

AssemblyAI Remote - New York $270k–$310k/yr Published 1 week ago
Flexible on stack