joblaze

Direct from source · No middlemen

Inference Systems Jobs

319 open positions · Updated 1 month ago

Average salary: 303.1k–443.8k/yr

Showing 20 of 319 positions

Search with filters →

Staff + Sr. Software Engineer, Inference Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $300k–$485k/yr Published 7 months ago

AWS Load Balancing AI/ML LLM inference distributed systems

Apply →

Sr. Software Engineer, Inference Remote Visa

Anthropic London, UK £225k–£325k/yr Published 2 months ago

AWS Machine Learning distributed systems Rust LLM

Apply →

Senior Software Engineer, Inference Remote Visa

Anthropic Dublin, IE €235k–€295k/yr Published 1 year ago

AWS Rust Python GCP Kubernetes

Apply →

Staff Software Engineer, Inference Remote Visa

Anthropic Dublin, IE €295k–€355k/yr Published 2 months ago

AWS Rust Python GCP Kubernetes

Apply →

Performance Engineer, Inference Systems Remote Visa

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 1 week ago

pandas Load Balancing SQL TPU Python

Flexible on stack

Apply →

Staff Software Engineer, Inference Remote Visa

Anthropic London, UK £325k–£390k/yr Published 3 months ago

AWS distributed systems Rust AI accelerator Python

Apply →

Technical Program Manager, Inference Performance Remote Visa

Anthropic San Francisco, CA | Seattle, WA $290k–$365k/yr Published 3 months ago

Large Language Models AI/ML compilers inference systems hardware accelerators

Apply →

LLM Inference Performance & Evals Engineer

Cerebras Systems Toronto, Ontario, Canada Published 10 months ago

C++ Triton LLVM AI/ML linear-attention

Apply →

ML Research Engineer (Inference)

Cerebras Systems Bengaluru, Karnataka, India Published 1 month ago

SGLang Machine Learning vLLM PyTorch Transformers

Apply →

Engineering Manager, Model Routing & Inference

Cursor San Francisco Published 1 month ago

TensorRT-LLM vLLM AI/ML GPU TGI

Apply →

Staff Software Engineer, Inference Cloud

Cerebras Systems Sunnyvale, CA Published 1 year ago

C++ AI inference Reliability Go distributed systems

Apply →

Engineering Manager (AI Inference)

Perplexity San Francisco Published 1 month ago

ONNX C++ vLLM Rust TensorRT

Apply →

Senior Performance Engineer, Inference

Cerebras Systems Sunnyvale, CA Published 1 month ago

TensorRT-LLM Triton SGLang CUDA vLLM

Apply →

Staff Inference ML Runtime Engineer

Cerebras Systems Sunnyvale CA or Toronto Canada Published 6 months ago

C++ TensorRT-LLM SGLang vLLM PyTorch

Apply →

ML Systems Performance Engineer

Cerebras Systems Sunnyvale CA or Toronto Canada Published 4 months ago

C++ Python Kernel Optimization HPC Computer Architecture

Apply →

Engineering Manager, Inference ML Runtime

Cerebras Systems Sunnyvale CA or Toronto Canada Published 2 months ago

C++ distributed systems LLM serving frameworks ML systems PyTorch

Apply →

Principal Engineer, Inference Cloud

Cerebras Systems Sunnyvale, CA Published 8 months ago

C++ Reliability Machine Learning Go distributed systems

Apply →

Software Engineer, Model Routing & Inference

Cursor New York Published 1 month ago

AI/ML distributed systems real-time data pipelines traffic routing inference serving

Apply →

Generative AI Inference Engineer Remote

Stability AI United States Published 6 months ago

AWS NVIDIA Nsight Triton TensorRT PyTorch

Apply →

Engineering Manager, Inference Routing and Performance Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 2 months ago

continuous batching coordination planes prefill/decode disaggregation KV caching Trainium

Apply →

Page 1 of 16