"inference infrastructure" Jobs

1154 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, Kubernetes. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 1154 results

Macroscope

Join Macroscope as a Senior Backend Infrastructure Engineer to shape and scale core services and inference platforms.

Macroscope San Francisco Published 1 month ago
Flexible on stack
baseten

Join Baseten as a Product Manager to enhance AI inference capabilities for dynamic AI companies.

baseten San Francisco Published 1 week ago
Flexible on stack
Hippocratic AI

Join Hippocratic AI as a senior LLM Inference Systems Engineer to build high-performance networking for large language models.

Hippocratic AI Menlo Park, CA Published 1 month ago
Flexible on stack
Ricursive Intelligence

Join Ricursive Intelligence to tackle challenges in scaling and optimization for LLM training and inference.

Ricursive Intelligence Palo Alto Published 10 months ago
Inferact

Join Inferact as a Forward Deployed Engineer to optimize AI inference systems in customer environments.

Inferact San Francisco $200k–$400k/yr Published 1 month ago
Flexible on stack
Together AI

Join Together AI as a Senior AI Inference Reliability Engineer to enhance the reliability of our GPU inference fleet.

Together AI San Francisco $160k–$280k/yr Published 3 weeks ago
Flexible on stack
Cartesia

Join Cartesia as a Research Engineer to build scalable data infrastructure for language modeling in a collaborative, in-person team.

Cartesia *HQ - San Francisco, CA Published 1 month ago
Coreweave

Lead complex programs for inference platform delivery in a high-growth AI infrastructure company.

Coreweave Livingston, NJ / New York City, NY / Sunnyvale, CA / Bellevue, WA $177k–$237k/yr Published 2 weeks ago
Gimlet Labs

Build reliable production infrastructure for Gimlet's AI cloud as an Infrastructure Platform Engineer.

Gimlet Labs San Francisco, CA Published 5 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff Engineer to lead the technical direction of the Inference Runtime for AI systems serving millions of users.

Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY $405k–$485k/yr Published 5 months ago
Flexible on stack
TypeSafe AI

Join TypeSafe as a senior backend engineer to build and maintain APIs for AI inference in a fast-paced startup environment.

TypeSafe AI San Francisco Office Published 4 months ago
Flexible on stack
baseten

Lead the Inference Performance team to optimize AI workloads for GPUs at Baseten.

baseten San Francisco Published 1 month ago
Heavy meetings
baseten

Join Baseten as a Product Manager to enhance the developer experience in AI inference and shape the future of AI products.

baseten San Francisco Published 1 week ago
Flexible on stack
Applied Intuition

Join Applied Intuition as a Senior Software Engineer to design and implement ML infrastructure for deep learning model training.

Applied Intuition Sunnyvale $215k–$285k/yr Published 3 years ago
Flexible on stack
Omnifold

Join Omnifold's Infrastructure Team to build robust systems for AI model training and deployment in a fast-paced environment.

Omnifold San Francisco HQ Published 8 months ago
Flexible on stack
Etched

Join Etched as a networking engineer to design and operate data center networks for AI inference systems.

Etched San Jose, United States Published 2 days ago
Flexible on stack
Inferact

Join Inferact as a Developer Relations Engineer to shape how developers learn and build with vLLM, the AI inference engine.

Inferact San Francisco $200k–$400k/yr Published 5 months ago
Flexible on stack
Gimlet Labs

Build inference systems for AI models in production at Gimlet Labs, focusing on performance and efficiency.

Gimlet Labs San Francisco, CA Published 8 months ago
Flexible on stack
Applied Intuition

Design and implement software and machine learning components for behavior prediction and environmental interactions in a dynamic environment.

Applied Intuition Sunnyvale Published 3 months ago
Flexible on stack