Low Latency Infrastructure Jobs in San Francisco

Senior Backend Engineer, Inference Platform

Together AI San Francisco $160k–$250k/yr Published 9 months ago

TypeScript NVLink Triton CUDA Go

Apply →

Senior Network Engineer

Together AI San Francisco $190k–$250k/yr Published 1 year ago

QoS EVPN AWS Juniper cURL

Apply →

LLM Inference Frameworks and Optimization Engineer

Together AI San Francisco, Singapore, Amsterdam $160k–$230k/yr Published 1 year ago

C++ TensorRT-LLM SGLang CUDA vLLM

Apply →

Staff Software Engineer, Node Infra Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$405k/yr Published 1 month ago

Terraform Trainium Go RDMA EFA

Apply →

Staff Backend Software Engineer- (AI Platform)

Databricks San Francisco, California $192k–$260k/yr Published 2 months ago

SGLang vLLM AI/ML APIs GPU

Apply →

Software Engineer- Database Infrastructure

Discord San Francisco Bay Area $160k–$180k/yr Published 1 month ago

C++ ScyllaDB Java Go Rust

Apply →

Senior Platform Engineer, Voice AI

Together AI San Francisco $200k–$260k/yr Published 2 months ago

TTS TypeScript WebSocket g711 STT

Apply →

Principal Software Engineer - Infrastructure Remote

Discord San Francisco Bay Area $400k–$450k/yr Published 3 months ago

ScyllaDB Google Cloud Elixir Rust Cassandra

Apply →

Senior Software Engineer- Database Infrastructure

Discord San Francisco Bay Area $196k–$220.5k/yr Published 7 months ago

C++ ScyllaDB Java Go Rust

Apply →

Staff Software Engineer, Foundational Model Serving

Databricks San Francisco, California $192k–$260k/yr Published 7 months ago

SGLang vLLM AI/ML GPU

Apply →

Member of Technical Staff (AI Inference Engineer)

Perplexity San Francisco Published 1 month ago

NVLink CuTe DSL Nsight Systems Triton JAX

Apply →

Software Engineer, Compute Efficiency Remote Visa

Anthropic San Francisco, CA | New York City, NY $320k–$405k/yr Published 3 months ago

AWS AI/ML Java Go eBPF

Apply →

Staff Platform Engineer, Voice AI

Own the architecture of Together AI's real-time voice platform as a Staff Platform Engineer.

Together AI San Francisco $220k–$280k/yr Published 1 week ago

TypeScript WebSocket g711 WebRTC Rust

Flexible on stack

Apply →

Senior Machine Learning Engineer, Voice AI

Together AI San Francisco $200k–$260k/yr Published 2 months ago

TTS STT H100 TensorRT-LLM ASR

Apply →

ML Infrastructure Engineer, Safeguards Remote Visa

Anthropic San Francisco, CA $320k–$405k/yr Published 11 months ago

AWS Spark JAX Large Language Models transformer architectures

Apply →

Staff Machine Learning Engineer, Voice AI

Join Together AI as a Staff ML Engineer to optimize voice model serving for real-time applications on a high-impact team.

Together AI San Francisco $220k–$280k/yr Published 1 week ago

TTS H100 TensorRT-LLM ASR SGLang

Flexible on stack 60% coding

Apply →

Engineering Manager, CDN Remote

Vercel Hybrid - San Francisco $196k–$336k/yr Published 6 months ago

HTTP TLS Go Lua CDN

Apply →

Research Engineer, Core ML

Together AI San Francisco $200k–$280k/yr Published 3 months ago

LLMs RLAIF SGLang vLLM quantization

Apply →

Software Engineer, AI Gateway Remote

Vercel Hybrid - San Francisco, New York City $196k–$294k/yr Published 3 months ago

TypeScript JavaScript AI/ML distributed systems cloud infrastructure

Apply →

Staff Backend Software Engineer- (AI Platform)

Databricks San Francisco, California $166k–$225k/yr Published 2 months ago

AI/ML model serving CPU inference systems large-scale distributed systems

Apply →