joblaze

Direct from source · No middlemen

Ai Inference Jobs in San Francisco

123 open positions · Updated 1 month ago

Average salary: 262.2k–394.6k/yr

Showing 20 of 123 positions

Search with filters →

Technical Program Manager, Inference Performance Remote Visa

Anthropic San Francisco, CA | Seattle, WA $290k–$365k/yr Published 3 months ago

Large Language Models AI/ML compilers inference systems hardware accelerators

Apply →

Staff + Sr. Software Engineer, Inference Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $300k–$485k/yr Published 7 months ago

AWS Load Balancing AI/ML LLM inference distributed systems

Apply →

Machine Learning Engineer - Inference

Together AI San Francisco $160k–$230k/yr Published 1 year ago

Cython TensorRT-LLM Triton CUDA vLLM

Apply →

Engineering Manager, Model Routing & Inference

Cursor San Francisco Published 1 month ago

TensorRT-LLM vLLM AI/ML GPU TGI

Apply →

Software Engineer - GenAI inference

Databricks San Francisco, California $142.2k–$204.6k/yr Published 7 months ago

GPU programming CUDA distributed systems cuDNN CUBLAS

Apply →

Performance Engineer, Inference Systems Remote Visa

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 1 week ago

pandas Load Balancing SQL TPU Python

Flexible on stack

Apply →

Engineering Manager (AI Inference)

Perplexity San Francisco Published 1 month ago

ONNX C++ vLLM Rust TensorRT

Apply →

Staff + Sr. Software Engineer, Inference Deployment Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 3 months ago

Trainium Rust TPU Python GPU

Apply →

Engineering Manager, Inference Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $425k–$560k/yr Published 1 year ago

ML framework internals GPU/Accelerator programming Machine Learning AI/ML distributed systems

Apply →

Staff Software Engineer - GenAI inference

Databricks San Francisco, California $190.9k–$232.8k/yr Published 7 months ago

memory partitioning GPU programming CUDA AI/ML distributed systems

Apply →

Engineering Manager, Inference Routing and Performance Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 2 months ago

continuous batching coordination planes prefill/decode disaggregation KV caching Trainium

Apply →

Staff + Sr. Software Engineer, Cloud Inference Launch Engineering Remote Visa

Anthropic San Francisco, CA | Seattle, WA $320k–$485k/yr Published 3 weeks ago

infrastructure as code AWS Rust Python GCP

Apply →

Research Engineer, Interpretability Remote Visa

Anthropic San Francisco, CA $315k–$560k/yr Published 6 months ago

JAX CUDA Interpretability Java Go

Apply →

LLM Inference Frameworks and Optimization Engineer

Together AI San Francisco, Singapore, Amsterdam $160k–$230k/yr Published 1 year ago

C++ TensorRT-LLM SGLang CUDA vLLM

Apply →

Senior Backend Engineer, Inference Platform

Together AI San Francisco $160k–$250k/yr Published 9 months ago

TypeScript NVLink Triton CUDA Go

Apply →

Customer Support Engineer (Inference) Remote

Join Together AI as a Customer Support Engineer to tackle complex technical challenges in a fast-paced AI environment.

Together AI San Francisco, CA $160k–$230k/yr Published 2 days ago

TypeScript JavaScript AI/ML Ansible Python

Flexible on stack

Apply →

Staff + Sr. Software Engineer, Cloud Inference Remote Visa

Anthropic San Francisco, CA | Seattle, WA $300k–$485k/yr Published 3 months ago

infrastructure as code AWS TPUs GPUs Rust

Apply →

Product Manager, Strategic Verticals Remote

Cerebras Systems San Francisco, California, United States Published 8 months ago

LLMs TensorRT-LLM vLLM AI/ML TGI

Apply →

Forward Deployed Engineer (Inference & Post-Training) Remote

Together AI San Francisco $270k–$300k/yr Published 3 weeks ago

TensorRT-LLM SGLang LORA vLLM AI/ML

Apply →

Research Engineer, Frontier Speculative Decoding

Together AI San Francisco, New York City $190k–$270k/yr Published 6 months ago

DeepSpeed AI/ML Slurm PyTorch Python

Apply →

Page 1 of 7