"inference serving systems" Jobs

741 open tech roles matching “inference serving systems”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AI/ML. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 741 results

Reddit

Lead the development of large-scale machine learning infrastructure to enhance personalization and recommendation systems at Reddit.

Reddit Remote - United States $253.3k–$354.6k/yr Published 1 month ago
Flexible on stack
Airbnb

Join Airbnb as a Senior Data Scientist to tackle complex data challenges and enhance trust on the platform.

Airbnb Remote - USA $179k–$210k/yr Published 1 month ago
Flexible on stack
Inceptive

Architect and implement secure data infrastructure for AI model training and deployment in a collaborative, antedisciplinary team.

Inceptive Berlin, Germany $200k–$275k/yr Published 2 months ago
Flexible on stack 70% coding
Twelve Labs

Lead and build a new team focused on developing Jockey Core, a reasoning LLM for video understanding at Twelve Labs.

Twelve Labs Seoul, South Korea Published 1 month ago
Flexible on stack
Skild AI

Join Skild AI as a Research Robotics/Computer Vision Engineer to develop intelligent robotic systems for real-world navigation.

Skild AI San Mateo $250k–$300k/yr Published 3 months ago
Flexible on stack
World Labs

Join World Labs as a Performance Engineer to optimize AI models for speed and efficiency in a cutting-edge research environment.

World Labs San Francisco $200k–$300k/yr Published 4 months ago
Flexible on stack 70% coding
Peregrine

Lead the development of AI-powered features for an end-to-end intelligence platform in public safety.

Peregrine San Francisco, CA $225k–$320k/yr Published 7 months ago
Inferact

Join Inferact as an AMD GPU performance engineer to optimize vLLM for the AMD accelerator ecosystem.

Inferact San Francisco $200k–$400k/yr Published 2 months ago
Flexible on stack
Hedra

Design and scale backend systems for Hedra’s developer platform, focusing on Python services and cloud infrastructure.

Hedra San Francisco Published 3 months ago
Inworld AI

Join Inworld AI as a Staff/Principal Software Engineer to develop cutting-edge backend systems for real-time voice models.

Inworld AI Mountain View, California, USA $280k–$350k/yr Published 1 year ago
Flexible on stack 70% coding
Instacart

Join Instacart as a Senior Machine Learning Engineer to tackle economic challenges in a flexible, remote-first environment.

Instacart United States - Remote $173k–$218.5k/yr Published 2 weeks ago
Flexible on stack
Harvey

Lead the design and development of systems powering AI requests at Harvey, ensuring high reliability and operational excellence.

Harvey San Francisco $193.4k–$290k/yr Published 6 days ago
Flexible on stack 60% coding
Fal

Join fal as a Software Engineer to build and maintain systems for managing a large fleet of GPU servers in a growing AI platform.

Fal San Francisco $180k–$250k/yr Published 6 months ago
Flexible on stack 70% coding
Sarvam AI

Build and enhance the AI infrastructure platform at Sarvam, focusing on GPU scheduling and multi-tenancy for machine learning workloads.

Sarvam AI Bengaluru Published 2 months ago
70% coding
Instacart

Join Instacart as a Senior Machine Learning Engineer to develop real-time inventory models for grocery stores across North America.

Instacart Canada - Remote (ON, AB, BC, or NS Only) CA$206k–CA$217.5k/yr Published 3 weeks ago
Kodiak Robotics

Join Kodiak Robotics as a Senior Software Engineer to enhance behavior prediction for autonomous driving systems.

Kodiak Robotics Mountain View, CA $170k–$210k/yr Published 2 months ago
Flexible on stack
Bretton AI

Own and evolve Kubernetes infrastructure while building secure, compliant AI systems for major financial institutions.

Bretton AI San Francisco, CA $168k–$213k/yr Published 7 months ago
70% coding
Instacart

Join Instacart as a Senior Marketing Decision Scientist II to drive data-driven growth and optimize marketing performance.

Instacart Canada - Remote (ON, AB, BC, or NS Only) CA$168k–CA$177.5k/yr Published 3 months ago
Flexible on stack
Nomic AI

Join Nomic AI as a Senior Platform Engineer to own and scale our infrastructure stack in the AEC industry.

Nomic AI New York HQ Published 2 months ago
Flexible on stack
Lyft

Join Lyft as a Data Scientist specializing in Algorithms to enhance driver incentives and marketplace efficiency.

Lyft Toronto, Canada CA$108k–CA$135k/yr Published 2 weeks ago
Flexible on stack