"inference infrastructure" Jobs

1154 open tech roles matching “inference infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, Kubernetes. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 1154 results

baseten

Join Baseten as a Software Engineer to enhance developer tools for deploying AI workloads in production.

baseten San Francisco Published 2 years ago
Flexible on stack
Inferact

Join Inferact as an inference runtime engineer to innovate AI inference engines for large models in a fully remote role.

Inferact Remote Published 2 months ago
Flexible on stack
Inferact

Join Inferact as an inference runtime engineer to optimize AI model execution across diverse hardware and architectures.

Inferact San Francisco $200k–$400k/yr Published 5 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff + Sr. Software Engineer to optimize and scale AI inference across major cloud platforms.

Anthropic San Francisco, CA | Seattle, WA $320k–$485k/yr Published 1 month ago
Flexible on stack
Inferact

Join Inferact as a staff engineer to build distributed systems for AI inference at global scale.

Inferact San Francisco $200k–$400k/yr Published 10 months ago
Flexible on stack
Anthropic

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 6 months ago
Flexible on stack
Inworld AI

Join Inworld AI as a Senior Machine Learning Engineer to optimize and run real-time AI inference systems in a collaborative environment.

Inworld AI Mountain View, California, USA $250k–$300k/yr Published 4 weeks ago
Flexible on stack
Hedra

Join Hedra as an Inference Optimization Engineer to enhance visual models' efficiency and performance in a collaborative research environment.

Hedra San Francisco Published 1 month ago
Flexible on stack
Etched

Join Etched as an Inference Intern to work on next-generation AI accelerators in a hands-on, collaborative environment.

Etched San Jose Published 11 months ago
Flexible on stack
Etched

Join Etched as an Inference Software Engineer to build and optimize cutting-edge AI inference systems in a fully in-person team.

Etched San Jose Published 1 year ago
Flexible on stack
Coreweave

Join CoreWeave as an Applied AI Engineer to enhance the performance of our inference platform through benchmarking and optimization.

Coreweave Bellevue, WA/ San Francisco, CA/ Sunnyvale, CA $188k–$275k/yr Published 8 months ago
Flexible on stack
Together AI

Join Together AI as a Staff Software Engineer to build systems that automate infrastructure management for AI clusters.

Together AI India Published 3 months ago
Flexible on stack
Inferact

Join Inferact as a staff engineer to build distributed systems for AI inference at global scale.

Inferact Singapore S$200k–S$400k/yr Published 5 months ago
Flexible on stack
Inferact

Join Inferact as an inference runtime engineer to optimize AI model execution across diverse hardware and architectures.

Inferact Singapore S$200k–S$400k/yr Published 5 months ago
Flexible on stack
Together AI

Join Together AI as a Staff Software Engineer to build systems that automate infrastructure management for AI clusters.

Together AI London & Amsterdam Published 3 months ago
Flexible on stack
Etched

Join Etched as an Infrastructure Engineer to build and manage lab infrastructure for cutting-edge AI hardware.

Etched San Jose Published 1 week ago
Flexible on stack
Roboflow

Join Roboflow as a Machine Learning Engineer to enhance our inference engine and contribute to impactful computer vision projects.

Roboflow NY, SF or Remote Published 4 months ago
Flexible on stack
Anthropic

Join Anthropic's Cloud Inference team to design and optimize backend services for AI systems across multiple cloud platforms.

Anthropic San Francisco, CA | Seattle, WA $320k–$485k/yr Published 1 month ago
Flexible on stack
baseten

Join Baseten as a Data Engineer to build and scale the internal data platform for AI-driven decision-making.

baseten San Francisco Published 8 months ago
Together AI

Join Together AI as a Staff Software Engineer to build systems that automate infrastructure management for AI clusters.

Together AI Amsterdam Published 3 months ago
Flexible on stack