"inference infrastructure" Jobs

934 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AI/ML. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 934 results

Coreweave

Join CoreWeave as a Senior Specialist Field Engineer to lead GPU cluster delivery and ensure high-performance AI workloads for customers.

Coreweave Sunnyvale, CA / San Francisco, CA / Bellevue, WA $188k–$275k/yr Published 3 months ago
Flexible on stack
Together AI

Own the cost side of data center build-outs at Together AI, partnering with Infrastructure Strategy to evaluate new opportunities.

Together AI San Francisco $138k–$175k/yr Published 3 weeks ago
Palantir

Join Palantir's software engineering team to enable ML models in production for critical customers.

Palantir Washington, D.C. Published 3 months ago
Perplexity

Join Perplexity as a staff software engineer to enhance our model serving platform, impacting AI product development.

Perplexity San Francisco Published 2 weeks ago
Flexible on stack
Abridge

Lead the data science team at Abridge to drive product strategy and insights in a high-growth healthcare AI startup.

Abridge SF Office Published 5 months ago
Flexible on stack
Twelve Labs

Build and operate production ML systems for Pegasus, focusing on reliability and performance in a hybrid work environment.

Twelve Labs Seoul, South Korea Published 3 weeks ago
Flexible on stack
Goodfire

Join Goodfire as a Product Engineer to build user-friendly AI systems with a focus on interpretability and product development.

Goodfire San Francisco, CA Published 3 months ago
baseten

Join Baseten as a Software Engineer to build continuous deployment infrastructure for AI products in a fast-growing team.

baseten San Francisco Published 1 month ago
Flexible on stack
Imprint

Deliver analytical projects that influence product decisions and marketing campaigns in a fast-paced startup environment.

Imprint New York City Published 1 month ago
Flexible on stack
Inworld AI

Join Inworld AI as a Lead Research Scientist to innovate in real-time voice models and impact AI applications globally.

Inworld AI Germany Published 5 months ago
Palantir

Join Palantir's software engineering team to enable ML models in production for critical customers.

Palantir New York, NY Published 3 months ago
Fireworks AI

Join Fireworks AI as a Backend Software Engineer to design and develop core backend systems for a high-performance generative AI platform.

Fireworks AI Singapore Published 2 months ago
Flexible on stack
krea.ai

Join Krea as an ML Researcher to finetune diffusion models and enhance AI creative tools in a collaborative environment.

krea.ai San Francisco Published 1 week ago
Flexible on stack
Fireworks AI

Join Fireworks AI as a Member of Technical Staff to design and build systems infrastructure for AI workloads at scale.

Fireworks AI San Mateo Published 5 days ago
Flexible on stack
Anthropic
Anthropic New York City, NY; San Francisco, CA; Seattle, WA $275k–$370k/yr Published 4 months ago
baseten

Join Baseten to lead capacity planning and operations in a fast-paced AI environment.

baseten San Francisco Published 3 days ago
Fundamental

Join Fundamental as a Model Serving Engineer to optimize and scale the NEXUS model for enterprise decision-making.

Fundamental Europe Published 5 months ago
Flexible on stack
Harvey AI

Join Harvey as a Staff Product Manager to shape the infrastructure of a leading legal AI platform with a focus on reliability and scalability.

Harvey AI San Francisco $213.6k–$300k/yr Published 2 months ago
AI-first team