joblaze

Direct from source · No middlemen

Ai Inference Jobs in New York

67 open positions · Updated 1 month ago

Average salary: 299.2k–435k/yr

Showing 20 of 67 positions

Search with filters →

Staff + Sr. Software Engineer, Inference Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $300k–$485k/yr Published 7 months ago

AWS Load Balancing AI/ML LLM inference distributed systems

Apply →

Performance Engineer, Inference Systems Remote Visa

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 1 week ago

pandas Load Balancing SQL TPU Python

Flexible on stack

Apply →

Staff + Sr. Software Engineer, Inference Deployment Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $320k–$485k/yr Published 3 months ago

Trainium Rust TPU Python GPU

Apply →

Engineering Manager, Inference Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $425k–$560k/yr Published 1 year ago

ML framework internals GPU/Accelerator programming Machine Learning AI/ML distributed systems

Apply →

Engineering Manager, Inference Routing and Performance Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 2 months ago

continuous batching coordination planes prefill/decode disaggregation KV caching Trainium

Apply →

Software Engineer, Model Routing & Inference

Cursor New York Published 1 month ago

AI/ML distributed systems real-time data pipelines traffic routing inference serving

Apply →

Research Engineer, Frontier Speculative Decoding

Together AI San Francisco, New York City $190k–$270k/yr Published 6 months ago

DeepSpeed AI/ML Slurm PyTorch Python

Apply →

AI Native Startups Account Executive

Own a book of AI-native startup accounts and drive revenue across AssemblyAI’s Voice AI infrastructure offerings.

AssemblyAI Remote - San Francisco OR New York $200k–$280k/yr Published 3 days ago

Voice AI API

Apply →

Software Engineer, Compute Efficiency Remote Visa

Anthropic San Francisco, CA | New York City, NY $320k–$405k/yr Published 3 months ago

AWS AI/ML Java Go eBPF

Apply →

Data Scientist, Developer Productivity Remote Visa

Anthropic San Francisco, CA | New York City, NY $275k–$370k/yr Published 3 weeks ago

A/B Testing data visualization AI/ML Statistical Modeling SQL

Apply →

Research Engineer, Evaluations Remote

AssemblyAI Remote - New York $210k–$260k/yr Published 2 months ago

TTS ASR VAD Voice AI Machine Learning

Apply →

Forward Deployed Engineer Remote

AssemblyAI Remote - San Francisco OR New York $140k–$240k/yr Published 1 month ago

AI/ML React SQL Python

Apply →

Technical Program Manager, Cloud Inference Remote Visa

Anthropic San Francisco, CA | New York City, NY $290k–$435k/yr Published 1 month ago

AI/ML Google Vertex AI Amazon Bedrock cloud computing Microsoft Foundry

Apply →

Research Lead, Training Insights Remote Visa

Anthropic Remote-Friendly (Travel Required) | San Francisco, CA; San Francisco, CA | New York City, NY $850k–$850k/yr Published 2 months ago

Large Language Models reinforcement learning inference Pretraining Evaluation Methodologies

Apply →

Engineering Manager, API Core Remote Visa

Lead the API Core team at Anthropic, focusing on service efficiency and throughput scaling for high-impact AI systems.

Anthropic San Francisco, CA | New York City, NY $405k–$485k/yr Published 6 days ago

Go distributed systems Rust API

Heavy meetings

Apply →

Forward Deployed Engineer, Onboarding Remote

AssemblyAI Remote - New York $150k–$200k/yr Published 3 weeks ago

WebSocket JavaScript AI/ML Python streaming

Apply →

AI Research Scientist - Datadog AI Research (DAIR)

Datadog New York, New York, USA $140k–$400k/yr Published 1 year ago

multimodal learning Machine Learning DeepSpeed AI/ML reinforcement learning

Apply →

AI Research Engineer - Datadog AI Research (DAIR) Remote

Datadog New York, New York, USA $140k–$400k/yr Published 9 months ago

C++ Ray JAX CUDA DeepSpeed

Apply →

Applied AI Engineer

Ramp New York, NY (HQ) Published 4 months ago

backend development AI/ML LLM inference web frameworks infrastructure

Apply →

Data Scientist, Supply Remote Visa

Anthropic San Francisco, CA | New York City, NY $275k–$370k/yr Published 3 weeks ago

data visualization AI/ML Operations Research SQL Python

Apply →

Page 1 of 4