"inference infrastructure" Jobs

461 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: AI/ML, Python, Kubernetes. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 461 results

baseten

Join Baseten as a senior software engineer to develop cutting-edge AI training products and enhance user workflows.

baseten San Francisco Published 10 months ago
Flexible on stack
Pinterest

Lead technical vision for AI/ML infrastructure at Pinterest, focusing on model training and serving.

Pinterest Palo Alto, CA; US; San Francisco, CA, US $285.5k–$449.5k/yr Published 3 weeks ago
Flexible on stack
Anthropic

Join Anthropic as a Staff+ Software Engineer to design and build systems for cloud portability in AI infrastructure.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 3 months ago
Flexible on stack
baseten

Join Baseten as a Post-Training Research Engineer to build in-house tooling for efficient and high-quality machine learning models.

baseten San Francisco Published 8 months ago
Anthropic

Join Anthropic as a Staff Software Engineer to build next-generation observability systems for large-scale AI infrastructure.

Anthropic London, UK £325k–£390k/yr Published 2 months ago
Flexible on stack
baseten

Join Baseten as a Software Engineer to drive model performance systems at the intersection of HPC and LLM engineering.

baseten San Francisco Published 10 months ago
Flexible on stack
Rox

Join Rox as a Core Engineer to design and operate foundational infrastructure for autonomous revenue agents in a fast-growing AI company.

Rox San Francisco Published 6 months ago
Handshake

Join Handshake as a Senior Software Engineer to build scalable ML infrastructure for a fast-growing AI data business.

Handshake San Francisco, CA Published 4 months ago
Flexible on stack
Gimlet Labs

Lead the facilities operations for Gimlet Labs' data centers and high-density AI infrastructure deployments.

Gimlet Labs San Francisco, CA Published 3 months ago
Inferact

Own product marketing for vLLM and Inferact, translating complex AI infrastructure into developer-facing messaging.

Inferact San Francisco Published 1 month ago
Anthropic

Join Anthropic as a Data Scientist to lead revenue forecasting models and enhance financial analytics in a mission-driven AI company.

Anthropic San Francisco, CA $270k–$345k/yr Published 2 weeks ago
Flexible on stack
baseten

Join Baseten as a Software Engineer to build a scalable networking stack for AI sandboxes in a fast-growing company.

baseten San Francisco Published 3 weeks ago
Flexible on stack
baseten

Join Baseten as a Sales Analytics Engineer to own the Sales data stack and build predictive models for revenue forecasting.

baseten San Francisco Published 6 days ago
Flexible on stack
baseten

Join Baseten as a Product Manager to shape the future of AI model routing and enhance developer experiences.

baseten San Francisco Published 1 week ago
Perplexity AI

Join Perplexity AI as a Strategic Finance Lead to optimize GPU compute investments and drive capacity decisions.

Perplexity AI San Francisco Published 2 months ago
Hedra

Design and scale backend systems for Hedra’s developer platform, focusing on Python services and cloud infrastructure.

Hedra San Francisco Published 6 months ago
Gimlet Labs

Characterize and improve GPU performance for AI inference at Gimlet Labs, working with a heterogeneous accelerator fleet.

Gimlet Labs San Francisco, CA Published 3 weeks ago
Flexible on stack
Coreweave

Own the strategy and execution for infrastructure-native products at the intersection of W&B and CoreWeave.

Coreweave Livingston, NJ / New York, NY / San Francisco, CA / Sunnyvale, CA / Bellevue, WA $188k–$275k/yr Published 10 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff+ Software Engineer to shape the technical strategy for our storage systems in a collaborative environment.

Anthropic San Francisco, CA | New York City, NY $1–$2/yr Published 2 months ago
Flexible on stack
Together AI

Design and deliver multi-petabyte storage systems for AI workloads at Together AI, optimizing performance and cost.

Together AI San Francisco $250k–$300k/yr Published 5 months ago
Flexible on stack