"real time ml serving infrastructure" Jobs

Showing 20 of 65 results

Staff Software Engineer, Model Serving

Databricks San Francisco, California $192k–$260k/yr Published 7 months ago

scheduling Routing AI/ML CPU distributed systems

Apply →

Senior Software Engineer, Model Serving

Databricks San Francisco, California $166k–$225k/yr Published 7 months ago

scheduling Routing AI/ML model serving CPU

Apply →

Staff Backend Software Engineer- (AI Platform)

Databricks San Francisco, California $166k–$225k/yr Published 2 months ago

AI/ML model serving CPU inference systems large-scale distributed systems

Apply →

Staff Backend Software Engineer- (AI Platform)

Databricks San Francisco, California $192k–$260k/yr Published 2 months ago

scheduling Routing AI/ML model serving CPU

Apply →

Sr. Manager, Engineering - Model Serving

Databricks San Francisco, California $217k–$312.2k/yr Published 7 months ago

AI/ML CPU GPU low-latency APIs real-time serving systems

Apply →

Member of Technical Staff (AI Infrastructure Engineer)

Perplexity San Francisco Published 1 month ago

C++ AWS Slurm PyTorch Python

Apply →

Research Engineer, Core ML

Together AI San Francisco $200k–$280k/yr Published 3 months ago

LLMs RLAIF SGLang vLLM quantization

Apply →

Staff Backend Software Engineer- (AI Platform)

Databricks San Francisco, California $166k–$225k/yr Published 2 months ago

Ray AI Gateway Sagemaker Agent Bricks Azure ML

Apply →

Staff Machine Learning Engineer, Voice AI

Join Together AI as a Staff ML Engineer to optimize voice model serving for real-time applications on a high-impact team.

Together AI San Francisco $220k–$280k/yr Published 2 weeks ago

TTS H100 TensorRT-LLM ASR SGLang

Flexible on stack 60% coding

Apply →

Senior Machine Learning Engineer, Voice AI

Together AI San Francisco $200k–$260k/yr Published 2 months ago

TTS STT H100 TensorRT-LLM ASR

Apply →

Senior Backend Engineer, Inference Platform

Together AI San Francisco $160k–$250k/yr Published 9 months ago

TypeScript NVLink Triton CUDA Go

Apply →

AI Researcher, Core ML (Turbo)

Together AI San Francisco $200k–$280k/yr Published 2 years ago

RLAIF speculative decoding SGLang vLLM reward modeling

Apply →

Senior Software Engineer, Machine Learning (Ads)

Discord San Francisco Bay Area $220k–$247k/yr Published 3 weeks ago

A/B Testing Machine Learning Ads ML PyTorch TensorFlow

Apply →

Staff Software Engineer - AI Research Infrastructure

Develop and run the research stack that powers Databricks AI Research, enabling rapid large-scale experiments.

Databricks New York City, New York; San Francisco, California $199k–$270k/yr Published 2 weeks ago

C++ Ray Java Go Slurm

Flexible on stack

Apply →

Staff Software Engineer - AI Research Infrastructure

Databricks New York City, New York; San Francisco, California $190k–$270k/yr Published 1 month ago

C++ Ray AI/ML Java Go

Apply →

Staff Product Manager, AI Platform Remote

Databricks San Francisco, California $181.7k–$249.8k/yr Published 3 months ago

Agent infrastructure Feature Engineering Unity Catalog AI/ML model serving

Apply →

Staff Software Engineer - Distributed Data Systems

Databricks San Francisco, California $192k–$260k/yr Published 3 years ago

C++ Delta Lake Java Hadoop Apache Spark

Apply →

Senior Software Engineer - Distributed Data Systems

Databricks San Francisco, California $166k–$225k/yr Published 6 years ago

C++ Java Hadoop Apache Spark Scala

Apply →

Senior Platform Engineer, Voice AI

Together AI San Francisco $200k–$260k/yr Published 2 months ago

TTS TypeScript WebSocket g711 STT

Apply →

Backend Software Engineer — Data Platform & AI Data Products

Together AI San Francisco $160k–$240k/yr Published 2 months ago

Trino gRPC Spark Java Go

Apply →