Inference Serving Jobs in San Francisco

Staff + Sr. Software Engineer, Inference Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $300k–$485k/yr Published 7 months ago

AWS Load Balancing AI/ML LLM inference distributed systems

Apply →

Engineering Manager, Model Routing & Inference

Cursor San Francisco Published 1 month ago

TensorRT-LLM vLLM AI/ML GPU TGI

Apply →

Performance Engineer, Inference Systems Remote Visa

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 1 week ago

pandas Load Balancing SQL TPU Python

Flexible on stack

Apply →

Engineering Manager (AI Inference)

Perplexity San Francisco Published 1 month ago

ONNX C++ vLLM Rust TensorRT

Apply →

Staff + Sr. Software Engineer, Inference Deployment Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 3 months ago

Trainium Rust TPU Python GPU

Apply →

Staff + Sr. Software Engineer, Cloud Inference Launch Engineering Remote Visa

Anthropic San Francisco, CA | Seattle, WA $320k–$485k/yr Published 3 weeks ago

infrastructure as code AWS Rust Python GCP

Apply →

Senior Software Engineer, Model Serving

Databricks San Francisco, California $166k–$225k/yr Published 7 months ago

scheduling Routing AI/ML model serving CPU

Apply →

Sr. Manager, Engineering - Model Serving

Databricks San Francisco, California $217k–$312.2k/yr Published 7 months ago

AI/ML CPU GPU low-latency APIs real-time serving systems

Apply →

Staff Software Engineer, Model Serving

Databricks San Francisco, California $192k–$260k/yr Published 7 months ago

scheduling Routing AI/ML CPU distributed systems

Apply →

Engineering Manager, Inference Routing and Performance Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 2 months ago

continuous batching coordination planes prefill/decode disaggregation KV caching Trainium

Apply →

Software Engineer - GenAI inference

Databricks San Francisco, California $142.2k–$204.6k/yr Published 7 months ago

GPU programming CUDA distributed systems cuDNN CUBLAS

Apply →

Staff Software Engineer - GenAI inference

Databricks San Francisco, California $190.9k–$232.8k/yr Published 7 months ago

memory partitioning GPU programming CUDA AI/ML distributed systems

Apply →

Staff + Sr. Software Engineer, Cloud Inference Remote Visa

Anthropic San Francisco, CA | Seattle, WA $300k–$485k/yr Published 3 months ago

infrastructure as code AWS TPUs GPUs Rust

Apply →

Customer Support Engineer (Inference) Remote

Join Together AI as a Customer Support Engineer to tackle complex technical challenges in a fast-paced AI environment.

Together AI San Francisco, CA $160k–$230k/yr Published 3 days ago

TypeScript JavaScript AI/ML Ansible Python

Flexible on stack

Apply →

Senior Backend Engineer, Inference Platform

Together AI San Francisco $160k–$250k/yr Published 9 months ago

TypeScript NVLink Triton CUDA Go

Apply →

Staff Software Engineer, Foundational Model Serving

Databricks San Francisco, California $192k–$260k/yr Published 7 months ago

SGLang vLLM AI/ML GPU

Apply →

LLM Inference Frameworks and Optimization Engineer

Together AI San Francisco, Singapore, Amsterdam $160k–$230k/yr Published 1 year ago

C++ TensorRT-LLM SGLang CUDA vLLM

Apply →

Product Manager, Strategic Verticals Remote

Cerebras Systems San Francisco, California, United States Published 8 months ago

LLMs TensorRT-LLM vLLM AI/ML TGI

Apply →

Machine Learning Engineer - Inference

Together AI San Francisco $160k–$230k/yr Published 1 year ago

Cython TensorRT-LLM Triton CUDA vLLM

Apply →

Staff Backend Software Engineer- (AI Platform)

Databricks San Francisco, California $192k–$260k/yr Published 2 months ago

SGLang vLLM AI/ML APIs GPU

Apply →