"inference serving systems" Jobs

735 open tech roles matching “inference serving systems”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AI/ML. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 735 results

Decagon

Design and operate data systems that power Decagon's AI products, ensuring high reliability and performance.

Decagon San Francisco $200k–$400k/yr Published 2 weeks ago
Flexible on stack
Fireworks AI

Design and optimize infrastructure for large-scale AI model training at a leading generative AI company.

Fireworks AI San Mateo Published 1 month ago
Flexible on stack
baseten

Join Baseten as a Forward Deployed Engineer to architect and deploy high-scale AI applications while collaborating with customers.

baseten San Francisco Published 2 years ago
Flexible on stack 70% coding
Inferact

Join Inferact as an AMD GPU performance engineer to optimize vLLM for the AMD accelerator ecosystem.

Inferact Singapore S$200k–S$400k/yr Published 2 months ago
Flexible on stack
Cantina

Join Cantina as an MLOps Engineer to build and scale inference infrastructure for generative audio models.

Cantina Remote (U.S. or Europe) $125k–$165k/yr Published 1 month ago
Flexible on stack
Chef Robotics

Join Chef Robotics as a Senior Perception Engineer to develop AI-driven robots for food preparation in a fast-paced, onsite environment.

Chef Robotics San Francisco Published 4 months ago
Anthropic
Anthropic San Francisco, CA $315k–$560k/yr Published 10 months ago
Fireworks AI

Join Fireworks AI as a Member of Technical Staff to build innovative AI solutions on a large inference platform.

Fireworks AI London Published 5 days ago
Flexible on stack
Descript

Join Descript as a Senior Software Engineer to own and enhance our infrastructure platform, impacting AI model training and deployment.

Descript San Francisco, CA or Remote, US $220k–$292k/yr Published 1 week ago
Flexible on stack
Mercury

Build and operate real-time inference services for risk decisioning in a fast-growing fintech startup.

Mercury San Francisco, CA, New York, NY, Portland, OR, or Remote within Canada or United States $166.6k–$208.3k/yr Published 3 days ago
Flexible on stack
Instacart

Join Instacart as a Senior Marketing Decision Scientist II to drive data-driven marketing performance and investment decisions.

Instacart United States - Remote $167k–$212k/yr Published 3 months ago
Flexible on stack
Coreweave

As an AI Engineer, you'll design and build systems that help engineers resolve real customer issues effectively.

Coreweave Livingston, NJ / New York, NY / Sunnyvale, CA $143k–$210k/yr Published 2 weeks ago
Flexible on stack 70% coding
Inferact

Join Inferact as a TPU performance engineer to optimize vLLM for Google TPUs, enhancing AI inference performance.

Inferact Singapore S$200k–S$400k/yr Published 2 months ago
Flexible on stack
Instacart

Join Instacart as a Senior Machine Learning Engineer to develop models for real-time inventory understanding in a fully remote role.

Instacart United States - Remote $201k–$253.5k/yr Published 3 weeks ago
Illumio

Architect high-scale distributed systems and lead the development of autonomous AI agents in a dynamic cybersecurity environment.

Illumio HQ - Sunnyvale (Office) Published 2 months ago
Flexible on stack
Harvey AI

Lead a high-performing team to develop and manage the model infrastructure platform at Harvey AI.

Harvey AI San Francisco $272k–$355k/yr Published 1 month ago
Heavy meetings
baseten

Join Baseten as a Senior Software Engineer to build enterprise capabilities for AI products in a rapidly growing company.

baseten San Francisco Published 1 year ago
Flexible on stack 70% coding
Together AI

Operate and optimize multi-petabyte storage systems for AI workloads at Together AI.

Together AI Bangalore India Published 1 day ago
Flexible on stack
baseten

Join Baseten as a Software Engineer to lead the identity and authorization team, building critical access systems for enterprise clients.

baseten San Francisco Published 1 week ago
Flexible on stack
Reddit

Lead the development of large-scale machine learning infrastructure to enhance personalization and recommendation systems at Reddit.

Reddit Remote - United States $253.3k–$354.6k/yr Published 1 month ago
Flexible on stack