joblaze

Direct from source · No middlemen

Inference Serving Jobs in New York

47 open positions · Updated 1 month ago

Average salary: 279.6k–397.1k/yr

Showing 20 of 47 positions

Search with filters →

Staff + Sr. Software Engineer, Inference Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $300k–$485k/yr Published 7 months ago

AWS Load Balancing AI/ML LLM inference distributed systems

Apply →

Performance Engineer, Inference Systems Remote Visa

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 1 week ago

pandas Load Balancing SQL TPU Python

Flexible on stack

Apply →

Staff + Sr. Software Engineer, Inference Deployment Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 3 months ago

Trainium Rust TPU Python GPU

Apply →

Software Engineer, Model Routing & Inference

Cursor New York Published 1 month ago

AI/ML distributed systems real-time data pipelines traffic routing inference serving

Apply →

Engineering Manager, Inference Routing and Performance Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 2 months ago

continuous batching coordination planes prefill/decode disaggregation KV caching Trainium

Apply →

Sr. Manager, Engineering - AI Gateway (LLM Inference) Remote

Databricks New York $228.6k–$314.3k/yr Published 1 month ago

Machine Learning AI/ML Generative AI

Apply →

Technical Program Manager, Cloud Inference Remote Visa

Anthropic San Francisco, CA | New York City, NY $290k–$435k/yr Published 1 month ago

AI/ML Google Vertex AI Amazon Bedrock cloud computing Microsoft Foundry

Apply →

Staff Data Scientist, Risk Remote

Gusto San Francisco, CA;New York, NY $133k–$193k/yr Published 2 months ago

AI/ML SQL Python

Apply →

Research Lead, Training Insights Remote Visa

Anthropic Remote-Friendly (Travel Required) | San Francisco, CA; San Francisco, CA | New York City, NY $850k–$850k/yr Published 2 months ago

Large Language Models reinforcement learning inference Pretraining Evaluation Methodologies

Apply →

Staff Software Engineer - AI Research Infrastructure

Develop and run the research stack that powers Databricks AI Research, enabling rapid large-scale experiments.

Databricks New York City, New York; San Francisco, California $199k–$270k/yr Published 2 weeks ago

C++ Ray Java Go Slurm

Flexible on stack

Apply →

Staff Software Engineer - AI Research Infrastructure

Databricks New York City, New York; San Francisco, California $190k–$270k/yr Published 1 month ago

C++ Ray AI/ML Java Go

Apply →

Forward Deployed Engineer Remote

AssemblyAI Remote - San Francisco OR New York $140k–$240k/yr Published 1 month ago

AI/ML React SQL Python

Apply →

Strategy & Analytics Senior Lead, Growth Remote

Faire New York City, NY; San Francisco, CA $185.5k–$255k/yr Published 3 months ago

SQL

Apply →

Software Engineer, Compute Efficiency Remote Visa

Anthropic San Francisco, CA | New York City, NY $320k–$405k/yr Published 3 months ago

AWS AI/ML Java Go eBPF

Apply →

Forward Deployed Research Engineer (FDRE - Clearance) Remote

Poolside AI New York, US Published 1 month ago

Terraform Datadog Grafana Prometheus AI/ML

Apply →

Research Engineer, Evaluations Remote

AssemblyAI Remote - New York $210k–$260k/yr Published 2 months ago

TTS ASR VAD Voice AI Machine Learning

Apply →

Forward Deployed Engineer, Onboarding Remote

AssemblyAI Remote - New York $150k–$200k/yr Published 3 weeks ago

WebSocket JavaScript AI/ML Python streaming

Apply →

AI Research Engineer - Datadog AI Research (DAIR) Remote

Datadog New York, New York, USA $140k–$400k/yr Published 9 months ago

C++ Ray JAX CUDA DeepSpeed

Apply →

Engineering Manager, API Core Remote Visa

Lead the API Core team at Anthropic, focusing on service efficiency and throughput scaling for high-impact AI systems.

Anthropic San Francisco, CA | New York City, NY $405k–$485k/yr Published 1 week ago

Go distributed systems Rust API

Heavy meetings

Apply →

Senior Manager, Growth Data Science Remote

Gusto Denver, CO;San Francisco, CA;New York, NY $217k–$265k/yr Published 1 month ago

AI/ML Data Science

Apply →

Page 1 of 3