"real time inference" Jobs - Joblaze

Showing 20 of 99 results

Performance Engineer, Inference Systems Remote Visa

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 3 weeks ago

pandas Load Balancing SQL TPU Python

Flexible on stack

Apply →

Member of Technical Staff (Software Engineer) Remote

Cerebras Systems Sunnyvale, CA $169.6k–$175k/yr Published 1 month ago

TypeScript C++ OracleDB JavaScript Git

Apply →

Staff Software Engineer, Inference Remote Visa

Anthropic Dublin, IE €295k–€355k/yr Published 3 months ago

AWS Rust Python GCP Kubernetes

Apply →

ML Performance Benchmarking Engineer Remote

Cerebras Systems Toronto, Ontario, Canada Published 2 months ago

C++ AI/ML Python

Apply →

Staff + Senior Software Engineer, Inference Remote Visa

Join Anthropic's Inference team to design and maintain distributed systems that serve AI models to millions of users worldwide.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 6 days ago

AWS Rust Python GCP Kubernetes

Flexible on stack

Apply →

Staff Software Engineer, Inference Remote Visa

Anthropic London, UK £325k–£390k/yr Published 4 months ago

AWS distributed systems Rust AI accelerator Python

Apply →

Staff + Senior Software Engineer, Inference Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $300k–$485k/yr Published 8 months ago

AWS Load Balancing AI/ML LLM inference distributed systems

Apply →

Senior Software Engineer, Inference Remote Visa

Anthropic Dublin, IE €235k–€295k/yr Published 1 year ago

AWS Rust Python GCP Kubernetes

Apply →

Staff+ Software Engineer, Inference Runtime Remote Visa

Join Anthropic as a Staff Engineer to lead the technical direction of the Inference Runtime for AI systems serving millions of users.

Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY $405k–$485k/yr Published 2 days ago

CUDA Trainium Rust AWS Neuron TPU

Flexible on stack

Apply →

Sr. Software Engineer, Inference Remote Visa

Anthropic London, UK £225k–£325k/yr Published 3 months ago

AWS Machine Learning distributed systems Rust LLM

Apply →

Product Manager, Strategic Verticals Remote

Cerebras Systems San Francisco, California, United States Published 8 months ago

LLMs TensorRT-LLM vLLM AI/ML TGI

Apply →

Senior Software Engineer, Inference Platform Remote

MongoDB Palo Alto $126k–$248k/yr Published 5 months ago

C++ HNSW vLLM Go Faiss

Apply →

Engineering Manager, Inference Routing and Performance Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 2 months ago

continuous batching coordination planes prefill/decode disaggregation KV caching Trainium

Apply →

Site Reliability Engineer - Ops & Automation Remote

Cerebras Systems Sunnyvale CA or Toronto Canada Published 8 months ago

Grafana Prometheus Go Bazel InfluxDB

Apply →

AI Models, Product Manager Remote

Cerebras Systems Sunnyvale, CA Published 5 months ago

SGLang vLLM AI/ML PyTorch Hugging Face

Apply →

Staff + Sr. Software Engineer, Cloud Inference Remote Visa

Join Anthropic as a Staff Software Engineer to design and optimize backend services for cloud inference at scale.

Anthropic San Francisco, CA $320k–$485k/yr Published 1 week ago

Cloud Rust Python Kubernetes

Flexible on stack

Apply →

Sr. Member of Technical Staff Remote

Cerebras Systems Sunnyvale, CA $230k–$250k/yr Published 1 month ago

Terraform AWS CDK AWS CloudFormation AWS Fargate Flask

Apply →

Research Engineer, Interpretability Remote Visa

Anthropic San Francisco, CA $315k–$560k/yr Published 7 months ago

JAX CUDA Interpretability Java Go

Apply →

Research Engineer, Voice Remote Visa

Inflection AI Palo Alto, California, United States $225k–$325k/yr Published 1 month ago

speech synthesis spoken dialogue systems CUDA AI/ML automatic speech recognition

Apply →

Senior/Staff Engineer : Post Silicon- Bring Up Remote

Cerebras Systems Bengaluru, Karnataka, India; Sunnyvale, CA; Toronto, Ontario, Canada $175k–$275k/yr Published 3 months ago

C++ Verilog CI/CD Git AI/ML

Apply →