joblaze

Direct from source · No middlemen

Llm Inference Jobs

129 open positions · Updated 1 month ago

Average salary: 222.7k–298.7k/yr

Showing 20 of 129 positions

Search with filters →

LLM Inference Frameworks and Optimization Engineer

Together AI San Francisco, Singapore, Amsterdam $160k–$230k/yr Published 1 year ago

C++ TensorRT-LLM SGLang CUDA vLLM

Apply →

Software Engineer - GenAI inference

Databricks San Francisco, California $142.2k–$204.6k/yr Published 7 months ago

GPU programming CUDA distributed systems cuDNN CUBLAS

Apply →

LLM Inference Performance & Evals Engineer

Cerebras Systems Toronto, Ontario, Canada Published 10 months ago

C++ Triton LLVM AI/ML linear-attention

Apply →

Full Stack LLM Engineer

Cerebras Systems Toronto, Ontario, Canada Published 10 months ago

C++ LLVM PyTorch TensorFlow MLIR

Apply →

Machine Learning Engineer

Together AI San Francisco $160k–$220k/yr Published 1 year ago

TRT SGLang vLLM Go Rust

Apply →

Staff Software Engineer, Inference Remote Visa

Anthropic Dublin, IE €295k–€355k/yr Published 2 months ago

AWS Rust Python GCP Kubernetes

Apply →

Staff Software Engineer - GenAI inference

Databricks San Francisco, California $190.9k–$232.8k/yr Published 7 months ago

memory partitioning GPU programming CUDA AI/ML distributed systems

Apply →

Sr. Manager, Engineering - AI Gateway (LLM Inference) Remote

Databricks New York $228.6k–$314.3k/yr Published 2 months ago

Machine Learning AI/ML Generative AI

Apply →

Sr. Software Engineer, Inference Remote Visa

Anthropic London, UK £225k–£325k/yr Published 2 months ago

AWS Machine Learning distributed systems Rust LLM

Apply →

Staff Software Engineer, Inference Remote Visa

Anthropic London, UK £325k–£390k/yr Published 3 months ago

AWS distributed systems Rust AI accelerator Python

Apply →

Staff + Sr. Software Engineer, Inference Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $300k–$485k/yr Published 7 months ago

AWS Load Balancing AI/ML LLM inference distributed systems

Apply →

Senior Software Engineer, Inference Remote Visa

Anthropic Dublin, IE €235k–€295k/yr Published 1 year ago

AWS Rust Python GCP Kubernetes

Apply →

Principal ML Investigator

Cerebras Systems Sunnyvale, CA Published 5 months ago

AI/ML Dataset Curation reinforcement learning LLM Pretraining sparsity

Apply →

Sr. Staff AI Research TLM - AI Systems

Lead a multidisciplinary research team to advance large-scale machine learning efficiency at Databricks.

Databricks Mountain View, California; San Francisco, California $270k–$340k/yr Published 1 week ago

Large Language Models AI/ML model optimization PyTorch Python

Flexible on stack 60% coding

Apply →

Staff Inference ML Runtime Engineer

Cerebras Systems Sunnyvale CA or Toronto Canada Published 6 months ago

C++ TensorRT-LLM SGLang vLLM PyTorch

Apply →

Machine Learning Engineer - Inference

Together AI San Francisco $160k–$230k/yr Published 1 year ago

Cython TensorRT-LLM Triton CUDA vLLM

Apply →

Engineering Manager (AI Inference)

Perplexity San Francisco Published 1 month ago

ONNX C++ vLLM Rust TensorRT

Apply →

Engineering Manager, Model Routing & Inference

Cursor San Francisco Published 1 month ago

TensorRT-LLM vLLM AI/ML GPU TGI

Apply →

Staff Software Engineer, Foundational Model Serving

Databricks San Francisco, California $192k–$260k/yr Published 7 months ago

SGLang vLLM AI/ML GPU

Apply →

Staff Software Engineer - ML Observability Remote

Datadog Boston, Massachusetts, USA; New York, New York, USA $234k–$300k/yr Published 10 months ago

Large Language Models AI/ML observability tools Generative AI

Apply →

Page 1 of 7