joblaze

Direct from source · No middlemen

Inference Jobs

402 open positions · Updated 20 hours ago

Average salary: 244.8k–357.7k/yr

Showing 20 of 402 positions

Research Intern, Inference (Fall 2026)

Join Together AI as a Research Intern to work on cutting-edge distributed inference and optimization for large foundation models.

Together AI San Francisco $58–$63/yr Published 21 hours ago

JAX CUDA Machine Learning PyTorch Python

Flexible on stack

Apply →

Technical Program Manager, Inference Performance Remote Visa

Anthropic San Francisco, CA | Seattle, WA $290k–$365k/yr Published 4 months ago

Large Language Models AI/ML compilers inference systems hardware accelerators

Apply →

Senior Performance Engineer, Inference

Cerebras Systems Sunnyvale, CA Published 2 months ago

TensorRT-LLM Triton SGLang CUDA vLLM

Apply →

ML Research Engineer (Inference)

Cerebras Systems Bengaluru, Karnataka, India Published 2 months ago

SGLang Machine Learning vLLM PyTorch Transformers

Apply →

Principal Engineer, Inference Cloud

Cerebras Systems Sunnyvale, CA Published 8 months ago

C++ Reliability Machine Learning Go distributed systems

Apply →

Staff + Senior Software Engineer, Inference Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $300k–$485k/yr Published 8 months ago

AWS Load Balancing AI/ML LLM inference distributed systems

Apply →

Machine Learning Engineer - Inference

Together AI San Francisco $160k–$230k/yr Published 2 years ago

Cython TensorRT-LLM Triton CUDA vLLM

Apply →

Software Engineer - GenAI inference

Databricks San Francisco, California $142.2k–$204.6k/yr Published 8 months ago

GPU programming CUDA distributed systems cuDNN CUBLAS

Apply →

Staff Software Engineer, Inference Cloud

Cerebras Systems Sunnyvale, CA Published 1 year ago

C++ AI inference Reliability Go distributed systems

Apply →

LLM Inference Performance & Evals Engineer

Cerebras Systems Toronto, Ontario, Canada Published 10 months ago

C++ Triton LLVM AI/ML linear-attention

Apply →

Staff Software Engineer, Inference Remote Visa

Anthropic Dublin, IE €295k–€355k/yr Published 3 months ago

AWS Rust Python GCP Kubernetes

Apply →

Staff Software Engineer - GenAI inference

Databricks San Francisco, California $190.9k–$232.8k/yr Published 8 months ago

memory partitioning GPU programming CUDA AI/ML distributed systems

Apply →

Sr. Software Engineer, Inference Remote Visa

Anthropic London, UK £225k–£325k/yr Published 3 months ago

AWS Machine Learning distributed systems Rust LLM

Apply →

Senior Software Engineer, Inference Remote Visa

Anthropic Dublin, IE €235k–€295k/yr Published 1 year ago

AWS Rust Python GCP Kubernetes

Apply →

Staff Inference ML Runtime Engineer

Cerebras Systems Sunnyvale CA or Toronto Canada Published 6 months ago

C++ TensorRT-LLM SGLang vLLM PyTorch

Apply →

Staff Software Engineer, Inference Remote Visa

Anthropic London, UK £325k–£390k/yr Published 4 months ago

AWS distributed systems Rust AI accelerator Python

Apply →

Generative AI Inference Engineer Remote

Stability AI United States Published 6 months ago

AWS NVIDIA Nsight Triton TensorRT PyTorch

Apply →

Engineering Manager, Model Routing & Inference

Cursor San Francisco Published 2 months ago

TensorRT-LLM vLLM AI/ML GPU TGI

Apply →

Performance Engineer, Inference Systems Remote Visa

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 3 weeks ago

pandas Load Balancing SQL TPU Python

Flexible on stack

Apply →

Engineering Manager, Inference Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $425k–$560k/yr Published 1 year ago

ML framework internals GPU/Accelerator programming Machine Learning AI/ML distributed systems

Apply →

Page 1 of 21