joblaze

Direct from source · No middlemen

Llm Inference Jobs in San Francisco

54 open positions · Updated 1 month ago

Average salary: 226.4k–335.8k/yr

Showing 20 of 54 positions

Search with filters →

LLM Inference Frameworks and Optimization Engineer

Together AI San Francisco, Singapore, Amsterdam $160k–$230k/yr Published 1 year ago

C++ TensorRT-LLM SGLang CUDA vLLM

Apply →

Software Engineer - GenAI inference

Databricks San Francisco, California $142.2k–$204.6k/yr Published 7 months ago

GPU programming CUDA distributed systems cuDNN CUBLAS

Apply →

Machine Learning Engineer

Together AI San Francisco $160k–$220k/yr Published 1 year ago

TRT SGLang vLLM Go Rust

Apply →

Staff Software Engineer - GenAI inference

Databricks San Francisco, California $190.9k–$232.8k/yr Published 7 months ago

memory partitioning GPU programming CUDA AI/ML distributed systems

Apply →

Staff + Sr. Software Engineer, Inference Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $300k–$485k/yr Published 7 months ago

AWS Load Balancing AI/ML LLM inference distributed systems

Apply →

Sr. Staff AI Research TLM - AI Systems

Lead a multidisciplinary research team to advance large-scale machine learning efficiency at Databricks.

Databricks Mountain View, California; San Francisco, California $270k–$340k/yr Published 1 week ago

Large Language Models AI/ML model optimization PyTorch Python

Flexible on stack 60% coding

Apply →

Machine Learning Engineer - Inference

Together AI San Francisco $160k–$230k/yr Published 1 year ago

Cython TensorRT-LLM Triton CUDA vLLM

Apply →

Engineering Manager (AI Inference)

Perplexity San Francisco Published 1 month ago

ONNX C++ vLLM Rust TensorRT

Apply →

Engineering Manager, Model Routing & Inference

Cursor San Francisco Published 1 month ago

TensorRT-LLM vLLM AI/ML GPU TGI

Apply →

Staff Software Engineer, Foundational Model Serving

Databricks San Francisco, California $192k–$260k/yr Published 7 months ago

SGLang vLLM AI/ML GPU

Apply →

Senior Backend Engineer, Inference Platform

Together AI San Francisco $160k–$250k/yr Published 9 months ago

TypeScript NVLink Triton CUDA Go

Apply →

Staff Backend Software Engineer- (AI Platform)

Databricks San Francisco, California $192k–$260k/yr Published 2 months ago

SGLang vLLM AI/ML APIs GPU

Apply →

Research Engineer, Interpretability Remote Visa

Anthropic San Francisco, CA $315k–$560k/yr Published 6 months ago

JAX CUDA Interpretability Java Go

Apply →

Performance Engineer, Inference Systems Remote Visa

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 1 week ago

pandas Load Balancing SQL TPU Python

Flexible on stack

Apply →

Engineering Manager, Inference Routing and Performance Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 2 months ago

continuous batching coordination planes prefill/decode disaggregation KV caching Trainium

Apply →

Staff Machine Learning Engineer, Voice AI

Join Together AI as a Staff ML Engineer to optimize voice model serving for real-time applications on a high-impact team.

Together AI San Francisco $220k–$280k/yr Published 1 week ago

TTS H100 TensorRT-LLM ASR SGLang

Flexible on stack 60% coding

Apply →

Member of Technical Staff (AI Infrastructure Engineer)

Perplexity San Francisco Published 1 month ago

C++ AWS Slurm PyTorch Python

Apply →

Member of Technical Staff (AI Inference Engineer)

Perplexity San Francisco Published 1 month ago

NVLink CuTe DSL Nsight Systems Triton JAX

Apply →

PhD GenAI Research Scientist Intern

Databricks San Francisco, California $54–$60/yr Published 2 years ago

AI/ML PyTorch

Apply →

Engineering Manager, Cloud Inference AWS Remote Visa

Anthropic San Francisco, CA | Seattle, WA $405k–$485k/yr Published 2 months ago

LLMs AWS TPUs GPUs Trainium

Apply →

Page 1 of 3