"real time ml inference" Jobs

41 open tech roles matching “real time ml inference”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, PyTorch. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 41 results

Roboflow

Join Roboflow as a Machine Learning Engineer to enhance our inference engine and contribute to impactful computer vision projects.

Roboflow NY, SF or Remote Published 2 months ago
Flexible on stack
Mercury

Build and operate real-time inference services for risk decisioning in a fast-growing fintech startup.

Mercury San Francisco, CA, New York, NY, Portland, OR, or Remote within Canada or United States $166.6k–$208.3k/yr Published 5 days ago
Flexible on stack
Anthropic

Lead a team of engineers to optimize Anthropic's inference infrastructure for AI systems.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$625k/yr Published 1 week ago
Flexible on stack Heavy meetings
Doppel

Join Doppel as a Machine Learning Engineer to build and scale detection systems for social engineering defense.

Doppel San Francisco, New York Published 7 months ago
Anthropic

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 3 months ago
Flexible on stack
Mirage

Join Mirage as a Research Engineer to build and scale systems for cutting-edge video generation models in a dynamic AI-focused environment.

Mirage Union Square, New York City Published 4 weeks ago
Flexible on stack
Goodfire

Join Goodfire as a Machine Learning Engineer to build interpretable AI systems with a world-class team.

Goodfire San Francisco, CA & New York, NY $200k–$400k/yr Published 9 months ago
Anthropic

Join Anthropic as a Staff Engineer to lead the technical direction of the Inference Runtime for AI systems serving millions of users.

Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY $405k–$485k/yr Published 3 months ago
Flexible on stack
Figma
Figma San Francisco, CA • New York, NY • United States $153k–$376k/yr Published 1 year ago
Attentive Mobile

Join Attentive's ML Platform team as a Senior Software Engineer to enhance AI and ML product delivery.

Attentive Mobile United States $180k–$250k/yr Published 3 months ago
Flexible on stack 70% coding
Reflection AI

Lead the post-training and evaluation capabilities for large language models in a dynamic AI research lab.

Reflection AI New York, NY Published 10 months ago
Anthropic

Join Anthropic as a Staff+ Site Reliability Engineer to ensure safe AI model launches and automate deployment processes.

Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY $320k–$485k/yr Published 1 week ago
Flexible on stack
Databricks
Databricks New York City, New York; San Francisco, California $190k–$270k/yr Published 4 months ago
Databricks

Develop and run the research stack that powers Databricks AI Research, enabling rapid large-scale experiments.

Databricks New York City, New York; San Francisco, California $199k–$270k/yr Published 4 months ago
Flexible on stack
Attentive Mobile

Join Attentive as a Staff Software Engineer to architect and build the AI/ML infrastructure for a leading marketing platform.

Attentive Mobile United States $200k–$300k/yr Published 3 months ago
Flexible on stack
Twitch

Join Twitch's Monetization team as a Data Scientist to apply causal inference methods and optimize revenue for creators.

Twitch New York City $136k–$212.8k/yr Published 2 months ago
Flexible on stack
Translucent

Join Translucent as an AI Engineer to build an agentic platform transforming healthcare finance decision-making.

Translucent New York City, New York $175k–$275k/yr Published 1 month ago
Flexible on stack 70% coding
Anthropic
Anthropic San Francisco, CA | New York City, NY | Seattle, WA $280k–$850k/yr Published 11 months ago
Anthropic

Join Anthropic as a Staff+ Software Engineer to build and scale Claude Managed Agents in a rapidly growing team.

Anthropic San Francisco, CA | New York City, NY $405k–$485k/yr Published 3 weeks ago