"inference serving systems" Jobs

296 open tech roles matching “inference serving systems”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, Kubernetes, AI/ML. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 296 results

Decagon

Design and operate data systems that power Decagon's AI products, ensuring high reliability and performance.

Decagon San Francisco $200k–$400k/yr Published 4 weeks ago
Flexible on stack
Faire

Own the measurement and optimization of long-term value in a hybrid role at Faire, a tech-driven wholesale platform.

Faire New York City, NY; San Francisco, CA $246.5k–$339k/yr Published 1 week ago
Flexible on stack
baseten

Join Baseten as a Forward Deployed Engineer to architect and deploy high-scale AI applications while collaborating with customers.

baseten San Francisco Published 2 years ago
Flexible on stack 70% coding
Chef Robotics

Join Chef Robotics as a Senior Perception Engineer to develop AI-driven robots for food preparation in a fast-paced, onsite environment.

Chef Robotics San Francisco Published 4 months ago
Anthropic
Anthropic San Francisco, CA $315k–$560k/yr Published 10 months ago
Descript

Join Descript as a Senior Software Engineer to own and enhance our infrastructure platform, impacting AI model training and deployment.

Descript San Francisco, CA or Remote, US $220k–$292k/yr Published 2 weeks ago
Flexible on stack
Mercury

Build and operate real-time inference services for risk decisioning in a fast-growing fintech startup.

Mercury San Francisco, CA, New York, NY, Portland, OR, or Remote within Canada or United States $166.6k–$208.3k/yr Published 1 week ago
Flexible on stack
Harvey AI

Lead a high-performing team to develop and manage the model infrastructure platform at Harvey AI.

Harvey AI San Francisco $272k–$355k/yr Published 2 months ago
Heavy meetings
baseten

Join Baseten as a Senior Software Engineer to build enterprise capabilities for AI products in a rapidly growing company.

baseten San Francisco Published 1 year ago
Flexible on stack 70% coding
baseten

Join Baseten as a Software Engineer to lead the identity and authorization team, building critical access systems for enterprise clients.

baseten San Francisco Published 2 weeks ago
Flexible on stack
Twelve Labs

Lead and build a new team focused on developing Jockey Core, a reasoning LLM for video understanding at Twelve Labs.

Twelve Labs Seoul, South Korea Published 1 month ago
Flexible on stack
Peregrine

Lead the development of AI-powered features for an end-to-end intelligence platform in public safety.

Peregrine San Francisco, CA $225k–$320k/yr Published 7 months ago
Inferact

Join Inferact as an AMD GPU performance engineer to optimize vLLM for the AMD accelerator ecosystem.

Inferact San Francisco $200k–$400k/yr Published 2 months ago
Flexible on stack
Hedra

Design and scale backend systems for Hedra’s developer platform, focusing on Python services and cloud infrastructure.

Hedra San Francisco Published 4 months ago
Harvey

Lead the design and development of systems powering AI requests at Harvey, ensuring high reliability and operational excellence.

Harvey San Francisco $193.4k–$290k/yr Published 2 weeks ago
Flexible on stack 60% coding
Fal

Join fal as a Software Engineer to build and maintain systems for managing a large fleet of GPU servers in a growing AI platform.

Fal San Francisco $180k–$250k/yr Published 7 months ago
Flexible on stack 70% coding
Bretton AI

Own and evolve Kubernetes infrastructure while building secure, compliant AI systems for major financial institutions.

Bretton AI San Francisco, CA $168k–$213k/yr Published 7 months ago
70% coding
krea.ai

Join Krea as a Backend Software Engineer to build AI creative tools in a collaborative, innovative environment.

krea.ai San Francisco Published 1 month ago
Flexible on stack
baseten

Lead the finance systems strategy and implementation at a rapidly growing AI company.

baseten San Francisco Published 3 weeks ago
Anthropic

Design and operate backend systems for Claude's safety systems, ensuring low latency and high reliability.

Anthropic San Francisco, CA $320k–$485k/yr Published 1 week ago