"real time ml serving infrastructure" Jobs

Showing 20 of 240 results

Staff Software Engineer, Model Serving

Databricks San Francisco, California $192k–$260k/yr Published 7 months ago

scheduling Routing AI/ML CPU distributed systems

Apply →

Staff Machine Learning Engineer, AI Serving

Reddit Remote - United States $253.3k–$354.6k/yr Published 4 weeks ago

Terraform AWS Triton vLLM Go

Apply →

Senior Software Engineer, Model Serving

Databricks San Francisco, California $166k–$225k/yr Published 7 months ago

scheduling Routing AI/ML model serving CPU

Apply →

Staff Backend Software Engineer- (AI Platform)

Databricks San Francisco, California $166k–$225k/yr Published 2 months ago

AI/ML model serving CPU inference systems large-scale distributed systems

Apply →

Staff Backend Software Engineer- (AI Platform)

Databricks San Francisco, California $192k–$260k/yr Published 2 months ago

scheduling Routing AI/ML model serving CPU

Apply →

Sr. Manager, Engineering - Model Serving

Databricks San Francisco, California $217k–$312.2k/yr Published 7 months ago

AI/ML CPU GPU low-latency APIs real-time serving systems

Apply →

Member of Technical Staff (AI Infrastructure Engineer)

Perplexity San Francisco Published 1 month ago

C++ AWS Slurm PyTorch Python

Apply →

Staff Backend Software Engineer

Databricks New York $190k–$261.3k/yr Published 2 months ago

Ray system observability Sagemaker Azure ML SGLang

Apply →

Research Engineer, Core ML

Together AI San Francisco $200k–$280k/yr Published 3 months ago

LLMs RLAIF SGLang vLLM quantization

Apply →

Senior Staff Software Engineer, Indexing & Retrieval Platform Remote

Reddit Remote - United States $279.2k–$390.9k/yr Published 1 month ago

AWS Spark Milvus Java Go

Apply →

ML Performance Benchmarking Engineer Remote

Cerebras Systems Toronto, Ontario, Canada Published 2 months ago

C++ AI/ML Python

Apply →

Staff Backend Software Engineer- (AI Platform)

Databricks San Francisco, California $166k–$225k/yr Published 2 months ago

Ray AI Gateway Sagemaker Agent Bricks Azure ML

Apply →

Staff Site Reliability Engineer – Automation and Platform

Cerebras Systems Remote, California, United States; Sunnyvale, CA; Toronto, Ontario, Canada Published 8 months ago

Loki Tempo Prometheus CI/CD Bazel

Apply →

Staff Machine Learning Engineer, Voice AI

Join Together AI as a Staff ML Engineer to optimize voice model serving for real-time applications on a high-impact team.

Together AI San Francisco $220k–$280k/yr Published 2 weeks ago

TTS H100 TensorRT-LLM ASR SGLang

Flexible on stack 60% coding

Apply →

ML Systems Performance Engineer

Cerebras Systems Sunnyvale CA or Toronto Canada Published 4 months ago

C++ Python Kernel Optimization HPC Computer Architecture

Apply →

Member of Technical Staff (AI Infrastructure Engineer)

Perplexity London Published 1 month ago

C++ AWS Slurm PyTorch Python

Apply →

Senior ML Software Engineer - Integration & Quality Remote

Cerebras Systems Sunnyvale CA or Toronto Canada Published 3 months ago

C++ ML frameworks cluster orchestration Microservices Go

Apply →

Senior Machine Learning Engineer, Voice AI

Together AI San Francisco $200k–$260k/yr Published 2 months ago

TTS STT H100 TensorRT-LLM ASR

Apply →

Senior Backend Engineer, Inference Platform

Together AI San Francisco $160k–$250k/yr Published 9 months ago

TypeScript NVLink Triton CUDA Go

Apply →

AI Infrastructure Operations Engineer

Cerebras Systems Sunnyvale CA or Toronto Canada Published 3 months ago

Networking Linux Hardware

Apply →