"inference infrastructure" Jobs

363 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AI/ML. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 363 results

baseten

Join Baseten as a Software Engineer to architect and develop scalable infrastructure for ML training platforms.

baseten San Francisco Published 1 year ago
Flexible on stack
Perplexity

Join Perplexity as a technical program manager to drive the core inference platform and coordinate between model providers and engineering teams.

Perplexity San Francisco Published 1 week ago
Cloudflare

Join Cloudflare as a Senior Systems Engineer to build core AI Gateway systems for high-volume inference traffic.

Cloudflare In-Office Published 1 month ago
Preference Model

Join Preference Model as a Senior ML Infrastructure Engineer to build scalable infrastructure for post-training research on large language models.

Preference Model San Francisco Published 3 days ago
Flexible on stack
Tavus

Join Tavus as a Senior Software Engineer to enhance the infrastructure behind real-time AI conversations.

Tavus Remote Published 4 months ago
Flexible on stack
Perplexity AI

Join Perplexity AI as a technical program manager to drive the core inference platform and coordinate across teams and model providers.

Perplexity AI San Francisco Published 1 week ago
Coreweave
Coreweave Sunnyvale, CA / Bellevue, WA $139k–$204k/yr Published 7 months ago
Together AI

Join Together AI as a Manager of Infrastructure Strategy & Operations to drive analytical decisions in scaling compute infrastructure.

Together AI San Francisco $220k–$260k/yr Published 3 months ago
Coreweave
Coreweave Sunnyvale, CA / Bellevue, WA $165k–$242k/yr Published 11 months ago
Nomic AI

Join Nomic AI as a Senior Platform Engineer to own and scale our infrastructure stack in the AEC industry.

Nomic AI New York HQ Published 2 months ago
Flexible on stack
Wizard

Own the end-to-end lifecycle of production ML serving systems for a top-performing AI Shopping Agent.

Wizard Remote - USA Published 5 months ago
Flexible on stack
Decagon

Design and operate data systems that power Decagon's AI products, ensuring high reliability and performance.

Decagon San Francisco $200k–$400k/yr Published 2 weeks ago
Flexible on stack
Coreweave

Join CoreWeave as a Senior Engineer to build performance insights and observability systems for AI infrastructure.

Coreweave Sunnyvale, CA / Bellevue, WA $182k–$242k/yr Published 1 month ago
Flexible on stack
Goodfire

Join Goodfire as a Machine Learning Engineer to build interpretable AI systems with a world-class team.

Goodfire San Francisco, CA & New York, NY $200k–$400k/yr Published 9 months ago
Together AI

Join Together AI as a Technical Support Engineer to tackle complex technical challenges in a fast-paced AI environment.

Together AI Remote $160k–$230k/yr Published 1 month ago
Flexible on stack
Anthropic
Anthropic San Francisco, CA $315k–$560k/yr Published 10 months ago
Together AI

Join Together AI as an AI Infrastructure Engineer to ensure smooth operation of user-facing services and production systems.

Together AI San Francisco $190k–$270k/yr Published 4 months ago
Flexible on stack