"inference systems" Jobs

1246 open tech roles matching “inference systems”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, Kubernetes. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 1246 results

Coreweave

Join CoreWeave as a Staff Software Engineer to lead the development of a Kubernetes-native inference platform for AI workloads.

Coreweave Sunnyvale, CA / Bellevue, WA $188k–$275k/yr Published 6 months ago
Flexible on stack
baseten

Join Baseten as a Software Engineer to optimize AI inference performance in a fast-paced startup environment.

baseten San Francisco Published 1 month ago
Flexible on stack
ChipAgents

Join ChipAgents as an ML Systems Engineer to optimize LLM inference systems for leading semiconductor companies.

ChipAgents San Jose $150k–$350k/yr Published 4 days ago
Flexible on stack
Inferact

Join Inferact as an inference runtime engineer to optimize AI model execution across diverse hardware and architectures.

Inferact Singapore S$200k–S$400k/yr Published 4 months ago
Flexible on stack
Roboflow

Join Roboflow as a Machine Learning Engineer to enhance our inference engine and contribute to impactful computer vision projects.

Roboflow NY, SF or Remote Published 4 months ago
Flexible on stack
Inferact

Join Inferact as an inference runtime engineer to innovate AI inference engines for large models in a fully remote role.

Inferact Remote Published 2 months ago
Flexible on stack
Anthropic

Drive programs that scale AI serving infrastructure across multiple platforms at Anthropic.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $290k–$435k/yr Published 3 weeks ago
Sarvam AI

Own Sarvam's production serving path for large distributed models, integrating and optimizing performance across a multi-node stack.

Sarvam AI Bengaluru Published 3 months ago
Inferact

Join Inferact as an inference runtime engineer to optimize AI model execution across diverse hardware and architectures.

Inferact San Francisco $200k–$400k/yr Published 4 months ago
Flexible on stack
Inferact

Join Inferact as a Site Reliability Engineer to enhance the reliability and performance of AI inference systems at scale.

Inferact San Francisco $200k–$400k/yr Published 1 month ago
Flexible on stack AI-first team
Etched

Join Etched as an Inference Intern to work on next-generation AI accelerators in a hands-on, collaborative environment.

Etched San Jose Published 11 months ago
Flexible on stack
Applied Intuition

Design and implement software and machine learning components for behavior prediction and environmental interactions in a dynamic environment.

Applied Intuition Sunnyvale Published 2 months ago
Flexible on stack
Gimlet Labs

Build inference systems for AI models in production at Gimlet Labs, focusing on performance and efficiency.

Gimlet Labs San Francisco, CA Published 8 months ago
Flexible on stack
Ricursive Intelligence

Join Ricursive Intelligence to tackle challenges in scaling and optimization for LLM training and inference.

Ricursive Intelligence Palo Alto Published 9 months ago
SpaceX

Join SpaceX as a Software Engineer to develop high-performance AI inference systems for mission-critical applications.

SpaceX Palo Alto, CA $135k–$175k/yr Published 2 months ago
Flexible on stack
Together AI

Join Together AI as a Staff Software Engineer to build systems that automate infrastructure management for AI clusters.

Together AI India Published 2 months ago
Flexible on stack
baseten

Lead the Inference Performance team to optimize AI workloads for GPUs at Baseten.

baseten San Francisco Published 1 month ago
Heavy meetings
Etched

Join Etched as an Inference Software Engineer to build and optimize cutting-edge AI inference systems in a fully in-person team.

Etched San Jose Published 1 year ago
Flexible on stack
Together AI

Join Together AI as a Staff Software Engineer to build systems that automate infrastructure management for AI clusters.

Together AI London & Amsterdam Published 2 months ago
Flexible on stack