"inference infrastructure" Jobs

402 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, Kubernetes. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 402 results

Inferact

Lead HR and People Operations at Inferact, scaling infrastructure in a fast-paced startup environment.

Inferact San Francisco $180k–$250k/yr Published 1 week ago
Rox

Join Rox as a Core Engineer to design and operate foundational infrastructure for autonomous revenue agents in a fast-growing AI company.

Rox San Francisco Published 4 months ago
Handshake

Join Handshake as a Senior Software Engineer to build scalable ML infrastructure for a fast-growing AI data business.

Handshake San Francisco, CA Published 2 months ago
Flexible on stack
Insitro

Lead and grow a team of machine learning researchers to develop methods for extracting insights from in-vitro microscopy datasets.

Insitro South San Francisco, CA $247k–$262k/yr Published 3 months ago
Heavy meetings
Twelve Labs

Drive research on Pegasus's complex problems in a hybrid role at a growing AI company focused on video understanding.

Twelve Labs Seoul, South Korea Published 5 months ago
Flexible on stack
Together AI

Join Together AI as a Staff ML Engineer to optimize voice model serving for real-time applications on a high-impact team.

Together AI San Francisco $220k–$280k/yr Published 4 months ago
Flexible on stack 60% coding
Twelve Labs

Drive technical direction for training infrastructure and operations within Pegasus at a growing AI company focused on video understanding.

Twelve Labs Seoul, South Korea Published 2 weeks ago
Perplexity AI

Join Perplexity AI as a Strategic Finance Lead to optimize GPU compute investments and drive capacity decisions.

Perplexity AI San Francisco Published 2 weeks ago
Perplexity

Join Perplexity as a Strategic Finance Lead to optimize GPU compute investments and drive capacity decisions in a fast-paced environment.

Perplexity San Francisco Published 2 weeks ago
Hedra

Design and scale backend systems for Hedra’s developer platform, focusing on Python services and cloud infrastructure.

Hedra San Francisco Published 3 months ago
Perplexity AI

Join Perplexity AI as a staff software engineer to enhance our model serving platform for AI products and infrastructure.

Perplexity AI San Francisco Published 3 weeks ago
Flexible on stack
Together AI

Design and deliver multi-petabyte storage systems for AI workloads at Together AI, optimizing performance and cost.

Together AI San Francisco $250k–$300k/yr Published 3 months ago
Flexible on stack
baseten

Lead a team of cloud platform engineers to build scalable and reliable infrastructure for AI products at Baseten.

baseten San Francisco Published 3 months ago
Flexible on stack Heavy meetings
baseten

Join Baseten as an AI Engineer to build AI-driven product features and enhance internal workflows.

baseten San Francisco Published 4 weeks ago
Flexible on stack
baseten

Join Baseten as a Software Engineer focusing on Model APIs to enhance AI model performance and developer experience.

baseten San Francisco Published 11 months ago
Coreweave

Join CoreWeave as a Senior Specialist Field Engineer to lead GPU cluster delivery and ensure high-performance AI workloads for customers.

Coreweave Sunnyvale, CA / San Francisco, CA / Bellevue, WA $188k–$275k/yr Published 3 months ago
Flexible on stack
Together AI

Own the cost side of data center build-outs at Together AI, partnering with Infrastructure Strategy to evaluate new opportunities.

Together AI San Francisco $138k–$175k/yr Published 1 month ago
Perplexity

Join Perplexity as a staff software engineer to enhance our model serving platform, impacting AI product development.

Perplexity San Francisco Published 3 weeks ago
Flexible on stack
Abridge

Lead the data science team at Abridge to drive product strategy and insights in a high-growth healthcare AI startup.

Abridge SF Office Published 5 months ago
Flexible on stack