"inference infrastructure" Jobs

122 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AI/ML. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 122 results

Traversal

Join Traversal as a senior AI Engineer to design and operate core systems for AI products in a fast-paced, collaborative environment.

Traversal New York $175k–$300k/yr Published 2 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff+ Software Engineer to build production systems for capacity engineering in a hybrid work environment.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 2 months ago
Flexible on stack 70% coding
Traversal

Join Traversal as a Backend AI Engineer to design and build core systems for AI-driven site reliability in complex production environments.

Traversal New York $150k–$300k/yr Published 1 year ago
Flexible on stack
Fireworks AI

Design and maintain large-scale backend infrastructure for a leading generative AI platform at Fireworks AI.

Fireworks AI New York Published 3 months ago
Flexible on stack
Databricks

Develop and run the research stack that powers Databricks AI Research, enabling rapid large-scale experiments.

Databricks New York City, New York; San Francisco, California $199k–$270k/yr Published 4 months ago
Flexible on stack
Databricks
Databricks New York City, New York; San Francisco, California $190k–$270k/yr Published 4 months ago
Anthropic

Lead the Capacity Engineering team at Anthropic, ensuring efficient allocation and utilization of infrastructure resources.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 2 days ago
Flexible on stack Heavy meetings
AssemblyAI

Join a small team at AssemblyAI as a Senior Software Engineer to develop cutting-edge AI products and APIs.

AssemblyAI New York $190k–$225k/yr Published 1 week ago
Anthropic

Join Anthropic as a Data Scientist to drive data-informed decision-making for our Developer Platform in a mission-driven environment.

Anthropic New York City, NY | Seattle, WA; San Francisco, CA $275k–$370k/yr Published 3 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff+ Software Engineer to design and build systems for cloud portability in AI infrastructure.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 3 weeks ago
Flexible on stack
Anthropic

Join Anthropic as a Staff+ Site Reliability Engineer to ensure safe AI model launches and automate deployment processes.

Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY $320k–$485k/yr Published 1 week ago
Flexible on stack
Coreweave

As an AI Engineer, you'll design and build systems that help engineers resolve real customer issues effectively.

Coreweave Livingston, NJ / New York, NY / Sunnyvale, CA $143k–$210k/yr Published 2 weeks ago
Flexible on stack 70% coding
Fireworks AI

Own foundational capabilities for enterprise AI, designing data models and APIs while ensuring security and compliance for large-scale customers.

Fireworks AI New York Published 1 month ago
Flexible on stack
Imprint

Deliver analytical projects that influence product decisions and marketing campaigns in a fast-paced startup environment.

Imprint New York City Published 1 month ago
Flexible on stack
Palantir

Join Palantir's software engineering team to enable ML models in production for critical customers.

Palantir New York, NY Published 3 months ago
Anthropic
Anthropic New York City, NY; San Francisco, CA; Seattle, WA $275k–$370k/yr Published 4 months ago
Mercury

Build and operate real-time inference services for risk decisioning in a fast-growing fintech startup.

Mercury San Francisco, CA, New York, NY, Portland, OR, or Remote within Canada or United States $166.6k–$208.3k/yr Published 4 days ago
Flexible on stack
Reflection AI

Lead the post-training and evaluation capabilities for large language models in a dynamic AI research lab.

Reflection AI New York, NY Published 10 months ago