"inference infrastructure" Jobs

449 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: AI/ML, Python, Kubernetes. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 449 results

Anthropic

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 6 months ago
Flexible on stack
Hedra

Join Hedra as an Inference Optimization Engineer to enhance visual models' efficiency and performance in a collaborative research environment.

Hedra San Francisco Published 1 month ago
Flexible on stack
Coreweave

Join CoreWeave as an Applied AI Engineer to enhance the performance of our inference platform through benchmarking and optimization.

Coreweave Bellevue, WA/ San Francisco, CA/ Sunnyvale, CA $188k–$275k/yr Published 8 months ago
Flexible on stack
Anthropic

Join Anthropic's Cloud Inference team to design and optimize backend services for AI systems across multiple cloud platforms.

Anthropic San Francisco, CA | Seattle, WA $320k–$485k/yr Published 1 month ago
Flexible on stack
baseten

Join Baseten as a Data Engineer to build and scale the internal data platform for AI-driven decision-making.

baseten San Francisco Published 8 months ago
Macroscope

Join Macroscope as a Senior Backend Infrastructure Engineer to shape and scale core services and inference platforms.

Macroscope San Francisco Published 1 month ago
Flexible on stack
baseten

Join Baseten as a Product Manager to enhance AI inference capabilities for dynamic AI companies.

baseten San Francisco Published 1 week ago
Flexible on stack
Inferact

Join Inferact as a Forward Deployed Engineer to optimize AI inference systems in customer environments.

Inferact San Francisco $200k–$400k/yr Published 1 month ago
Flexible on stack
Together AI

Join Together AI as a Senior AI Inference Reliability Engineer to enhance the reliability of our GPU inference fleet.

Together AI San Francisco $160k–$280k/yr Published 3 weeks ago
Flexible on stack
Cartesia

Join Cartesia as a Research Engineer to build scalable data infrastructure for language modeling in a collaborative, in-person team.

Cartesia *HQ - San Francisco, CA Published 1 month ago
Gimlet Labs

Build reliable production infrastructure for Gimlet's AI cloud as an Infrastructure Platform Engineer.

Gimlet Labs San Francisco, CA Published 5 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff Engineer to lead the technical direction of the Inference Runtime for AI systems serving millions of users.

Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY $405k–$485k/yr Published 5 months ago
Flexible on stack
TypeSafe AI

Join TypeSafe as a senior backend engineer to build and maintain APIs for AI inference in a fast-paced startup environment.

TypeSafe AI San Francisco Office Published 4 months ago
Flexible on stack
baseten

Lead the Inference Performance team to optimize AI workloads for GPUs at Baseten.

baseten San Francisco Published 1 month ago
Heavy meetings
baseten

Join Baseten as a Product Manager to enhance the developer experience in AI inference and shape the future of AI products.

baseten San Francisco Published 1 week ago
Flexible on stack
Omnifold

Join Omnifold's Infrastructure Team to build robust systems for AI model training and deployment in a fast-paced environment.

Omnifold San Francisco HQ Published 8 months ago
Flexible on stack
Inferact

Join Inferact as a Developer Relations Engineer to shape how developers learn and build with vLLM, the AI inference engine.

Inferact San Francisco $200k–$400k/yr Published 5 months ago
Flexible on stack
Gimlet Labs

Build inference systems for AI models in production at Gimlet Labs, focusing on performance and efficiency.

Gimlet Labs San Francisco, CA Published 8 months ago
Flexible on stack
Descript

Join Descript as a Senior Software Engineer to own and enhance our infrastructure platform, impacting AI model training and deployment.

Descript San Francisco, CA or Remote, US $220k–$292k/yr Published 2 months ago
Flexible on stack
Inferact

Lead strategic finance initiatives to shape growth and investment decisions at Inferact, an AI inference engine startup.

Inferact San Francisco Published 1 month ago