joblaze

Direct from source · No middlemen

Inference Serving Jobs

286 open positions · Updated 1 month ago

Average salary: 275.3k–420.7k/yr

Showing 20 of 286 positions

Search with filters →

Staff + Sr. Software Engineer, Inference Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $300k–$485k/yr Published 7 months ago

AWS Load Balancing AI/ML LLM inference distributed systems

Apply →

Staff Software Engineer, Inference Remote Visa

Anthropic Dublin, IE €295k–€355k/yr Published 2 months ago

AWS Rust Python GCP Kubernetes

Apply →

Sr. Software Engineer, Inference Remote Visa

Anthropic London, UK £225k–£325k/yr Published 2 months ago

AWS Machine Learning distributed systems Rust LLM

Apply →

Senior Performance Engineer, Inference

Cerebras Systems Sunnyvale, CA Published 1 month ago

TensorRT-LLM Triton SGLang CUDA vLLM

Apply →

Engineering Manager, Model Routing & Inference

Cursor San Francisco Published 1 month ago

TensorRT-LLM vLLM AI/ML GPU TGI

Apply →

Staff Software Engineer, Inference Remote Visa

Anthropic London, UK £325k–£390k/yr Published 3 months ago

AWS distributed systems Rust AI accelerator Python

Apply →

Senior Software Engineer, Inference Remote Visa

Anthropic Dublin, IE €235k–€295k/yr Published 1 year ago

AWS Rust Python GCP Kubernetes

Apply →

Staff Software Engineer, Inference Cloud

Cerebras Systems Sunnyvale, CA Published 1 year ago

C++ AI inference Reliability Go distributed systems

Apply →

LLM Inference Performance & Evals Engineer

Cerebras Systems Toronto, Ontario, Canada Published 10 months ago

C++ Triton LLVM AI/ML linear-attention

Apply →

ML Research Engineer (Inference)

Cerebras Systems Bengaluru, Karnataka, India Published 1 month ago

SGLang Machine Learning vLLM PyTorch Transformers

Apply →

Principal Engineer, Inference Cloud

Cerebras Systems Sunnyvale, CA Published 8 months ago

C++ Reliability Machine Learning Go distributed systems

Apply →

Performance Engineer, Inference Systems Remote Visa

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 1 week ago

pandas Load Balancing SQL TPU Python

Flexible on stack

Apply →

Engineering Manager (AI Inference)

Perplexity San Francisco Published 1 month ago

ONNX C++ vLLM Rust TensorRT

Apply →

Staff + Sr. Software Engineer, Inference Deployment Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 3 months ago

Trainium Rust TPU Python GPU

Apply →

Staff + Sr. Software Engineer, Cloud Inference Launch Engineering Remote Visa

Anthropic San Francisco, CA | Seattle, WA $320k–$485k/yr Published 3 weeks ago

infrastructure as code AWS Rust Python GCP

Apply →

Software Engineer, Model Routing & Inference

Cursor New York Published 1 month ago

AI/ML distributed systems real-time data pipelines traffic routing inference serving

Apply →

Principal Engineer, AI Inference Reliability

Cerebras Systems Remote, California, United States; Sunnyvale CA or Toronto Canada Published 7 months ago

C++ Go Rust Python

Apply →

Senior Software Engineer, Model Serving

Databricks San Francisco, California $166k–$225k/yr Published 7 months ago

scheduling Routing AI/ML model serving CPU

Apply →

Staff Inference ML Runtime Engineer

Cerebras Systems Sunnyvale CA or Toronto Canada Published 6 months ago

C++ TensorRT-LLM SGLang vLLM PyTorch

Apply →

Sr. Manager, Engineering - Model Serving

Databricks San Francisco, California $217k–$312.2k/yr Published 7 months ago

AI/ML CPU GPU low-latency APIs real-time serving systems

Apply →

Page 1 of 15