"inference infrastructure" Jobs

934 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AI/ML. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 934 results

Preference Model

Join Preference Model as a Senior ML Infrastructure Engineer to build scalable infrastructure for post-training research on large language models.

Preference Model San Francisco Published 2 days ago
Flexible on stack
baseten

Join Baseten as an AI Engineer to design and automate workflows for AI-powered capacity management in a fast-growing company.

baseten San Francisco Published 2 days ago
Flexible on stack
Tavus

Join Tavus as a Senior Software Engineer to enhance the infrastructure behind real-time AI conversations.

Tavus Remote Published 4 months ago
Flexible on stack
Inferact

Join Inferact as a cloud orchestration engineer to build reliable systems for AI model deployment at scale in a fully remote role.

Inferact Remote Published 2 weeks ago
Flexible on stack
Perplexity AI

Join Perplexity AI as a technical program manager to drive the core inference platform and coordinate across teams and model providers.

Perplexity AI San Francisco Published 1 week ago
Coreweave
Coreweave Sunnyvale, CA / Bellevue, WA $139k–$204k/yr Published 7 months ago
Anthropic

Own the infrastructure for machine learning research to detect and mitigate misuse of AI models at Anthropic.

Anthropic San Francisco, CA | New York City, NY $350k–$500k/yr Published 1 month ago
Flexible on stack
Together AI

Join Together AI as a Manager of Infrastructure Strategy & Operations to drive analytical decisions in scaling compute infrastructure.

Together AI San Francisco $220k–$260k/yr Published 3 months ago
Coreweave
Coreweave Sunnyvale, CA / Bellevue, WA $92k–$135k/yr Published 10 months ago
Coreweave
Coreweave Sunnyvale, CA / Bellevue, WA $165k–$242k/yr Published 11 months ago
Skild AI

Join Skild AI as a Software Engineer to optimize AI inference for robotic systems, enhancing their performance and adaptability.

Skild AI San Mateo, CA $100k–$300k/yr Published 1 year ago
Flexible on stack
Hilbert

Join Hilbert as an AI Engineer to build production-grade AI systems that drive enterprise outcomes in a fast-paced startup environment.

Hilbert San Francisco Published 6 months ago
Flexible on stack 70% coding
Meter

Join Meter as a Backend Engineer to design and implement a unified data interface for model development in a cutting-edge networking company.

Meter San Francisco $160k–$230k/yr Published 1 year ago
Flexible on stack
Crosby

Join Crosby as an Infrastructure Engineer to build and scale systems that power an AI-native law firm.

Crosby New York City Published 5 months ago
Flexible on stack
baseten

Join Baseten as a Software Engineer on the Observability team to enhance the reliability of AI product systems.

baseten San Francisco Published 1 month ago
Flexible on stack
Nomic AI

Join Nomic AI as a Senior Platform Engineer to own and scale our infrastructure stack in the AEC industry.

Nomic AI New York HQ Published 2 months ago
Flexible on stack
Perplexity AI

Join Perplexity AI as an AI Inference Engineer to optimize and develop our inference engine for various model architectures.

Perplexity AI London Published 5 months ago
Flexible on stack
Fireworks AI

Design and optimize infrastructure for large-scale AI model training at a leading generative AI company.

Fireworks AI San Mateo Published 1 month ago
Flexible on stack
Sierra

Join Sierra as a Software Engineer, Infrastructure, to design and maintain core systems for our AI platform in a collaborative environment.

Sierra San Francisco, CA Published 3 months ago
Flexible on stack