Llm Inference Jobs in New York - Joblaze

Sr. Manager, Engineering - AI Gateway (LLM Inference) Remote

Databricks

Machine Learning AI/ML Generative AI

New York City, NY, USA

$228.6k–$314.3k/yr

Indexed 3 days ago Apply →

Staff Software Engineer - ML Observability Remote

Datadog

Large Language Models AI/ML observability tools Generative AI

Boston, Massachusetts, USA; New York, New York, USA

$234k–$300k/yr

Indexed 3 days ago Apply →

Research Engineer, Frontier Speculative Decoding

Together AI

DeepSpeed AI/ML Slurm PyTorch Python

San Francisco, New York City

$190k–$270k/yr

Indexed 3 days ago Apply →

AI Solutions Engineer, Post Sales- W&B Remote

Coreweave

TypeScript Pinecone LightGBM Ray Fastai

Livingston, NJ / New York, NY / Philadelphia, PA

$165k–$242k/yr

Indexed 3 days ago Apply →

Forward Deployed Engineer Remote

AssemblyAI

AI/ML React SQL Python

Remote - San Francisco OR New York

$190k–$240k/yr

Indexed 3 days ago Apply →

AI Solutions Engineer, Pre-Sales- W&B Remote

Coreweave

TypeScript Ray AWS JavaScript Slurm

Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA / Philadelphia, PA / San Francisco, CA / Washington, D.C

$165k–$242k/yr

Indexed 3 days ago Apply →

Manager I, Engineering - AI Platform - Annotation & Evaluation Remote Visa

Datadog

AI/ML Data Engineering Software Engineering infrastructure

New York, New York, USA

$187k–$240k/yr

Indexed 3 days ago Apply →

Staff+ Software Engineer, Platform Remote Visa

Anthropic

TypeScript CI/CD pipelines multi-tenant platforms service mesh LLM inference

San Francisco, CA | New York City, NY | Seattle, WA

$405k–$485k/yr

Indexed 3 days ago Apply →

Security Lead, Agentic Red Team

Google DeepMind

C++ AI/ML Go Python

Mountain View, California, US; New York City, New York, US

$248k–$349k/yr

Published 2 months ago Apply →