joblaze

Direct from source · No middlemen

Llm Inference Jobs in New York

23 open positions · Updated 1 month ago

Average salary: 228.4k–325.1k/yr

Showing 20 of 23 positions

Search with filters →

Sr. Manager, Engineering - AI Gateway (LLM Inference) Remote

Databricks New York $228.6k–$314.3k/yr Published 2 months ago

Machine Learning AI/ML Generative AI

Apply →

Staff + Sr. Software Engineer, Inference Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $300k–$485k/yr Published 7 months ago

AWS Load Balancing AI/ML LLM inference distributed systems

Apply →

Staff Software Engineer - ML Observability Remote

Datadog Boston, Massachusetts, USA; New York, New York, USA $234k–$300k/yr Published 10 months ago

Large Language Models AI/ML observability tools Generative AI

Apply →

Performance Engineer, Inference Systems Remote Visa

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 1 week ago

pandas Load Balancing SQL TPU Python

Flexible on stack

Apply →

Engineering Manager, Inference Routing and Performance Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 2 months ago

continuous batching coordination planes prefill/decode disaggregation KV caching Trainium

Apply →

Applied AI Engineer

Ramp New York, NY (HQ) Published 4 months ago

backend development AI/ML LLM inference web frameworks infrastructure

Apply →

Research Engineer, Frontier Speculative Decoding

Together AI San Francisco, New York City $190k–$270k/yr Published 6 months ago

DeepSpeed AI/ML Slurm PyTorch Python

Apply →

Staff Software Engineer - AI Research Infrastructure

Databricks New York City, New York; San Francisco, California $190k–$270k/yr Published 1 month ago

C++ Ray AI/ML Java Go

Apply →

Staff Software Engineer - AI Research Infrastructure

Develop and run the research stack that powers Databricks AI Research, enabling rapid large-scale experiments.

Databricks New York City, New York; San Francisco, California $199k–$270k/yr Published 2 weeks ago

C++ Ray Java Go Slurm

Flexible on stack

Apply →

Data Scientist, ML (Agentic, CX) Remote

Lead machine learning development for customer experience systems at Robinhood, impacting how customers interact with finance.

Robinhood Menlo Park, CA; New York, NY $158k–$185k/yr Published 2 weeks ago

A/B Testing Machine Learning SQL LLM Python

Flexible on stack

Apply →

Forward Deployed Engineer Remote

AssemblyAI Remote - San Francisco OR New York $140k–$240k/yr Published 1 month ago

AI/ML React SQL Python

Apply →

Research Engineer, Evaluations Remote

AssemblyAI Remote - New York $210k–$260k/yr Published 2 months ago

TTS ASR VAD Voice AI Machine Learning

Apply →

Product Marketing Manager

AssemblyAI Remote - San Francisco Bay Area OR New York $140k–$190k/yr Published 1 month ago

Voice AI AI/ML API

Apply →

Forward Deployed Engineer, Onboarding Remote

AssemblyAI Remote - New York $150k–$200k/yr Published 3 weeks ago

WebSocket JavaScript AI/ML Python streaming

Apply →

AI Native Startups Account Executive

Own a book of AI-native startup accounts and drive revenue across AssemblyAI’s Voice AI infrastructure offerings.

AssemblyAI Remote - San Francisco OR New York $200k–$280k/yr Published 5 days ago

Voice AI API

Apply →

Founding Enterprise Account Executive Remote

AssemblyAI Remote - San Francisco OR New York $300k–$370k/yr Published 1 month ago

Voice AI AI/ML API

Apply →

Manager II, Engineering - AI Platform Training, Serving and Storage (NorAm) Remote

Datadog New York, New York, USA $234k–$300k/yr Published 3 months ago

Ray AI/ML Open Source Tooling AnyScale

Apply →

Research Engineer, Frontier Safety Risk Assessment Visa

Google DeepMind London, UK; New York City, New York, US; San Francisco, California, US $136k–$245k/yr Published 5 months ago

AI/ML Python

Apply →

Data Scientist, Core Data - PhD (2026) Remote

Figma New York, NY • United States; San Francisco, CA • New York, NY $170k–$178k/yr Published 1 month ago

A/B Testing Machine Learning Statistical Modeling SQL Python

Apply →

Staff+ Software Engineer, Backend Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 1 month ago

LLMs SO2 distributed systems cloud infrastructure agentic applications

Apply →

Page 1 of 2