Real Time Ml Serving Infrastructure Jobs in New York

Staff Backend Software Engineer

Databricks

Ray system observability Sagemaker Azure ML SGLang

New York

$190k–$261.3k/yr

Published 1 month ago Apply →

Sr. Manager, Engineering - AI Gateway (LLM Inference) Remote

Databricks

Machine Learning AI/ML Generative AI

New York

$228.6k–$314.3k/yr

Published 2 weeks ago Apply →

Software Engineer, Infrastructure (8+ YOE) Remote

Airtable

vector databases distributed systems Apache Spark Apache Flink databases

San Francisco, CA; New York, NY; Remote - US (Seattle, WA only)

$196k–$339.9k/yr

Published 2 months ago Apply →

Software Engineer, Infrastructure (2-8 YOE) Remote

Airtable

TiDB AI evals store vector databases RDS MySQL MySQL

San Francisco, CA; New York, NY; Remote - US (Seattle, WA only)

$187k–$260k/yr

Published 2 months ago Apply →

Full-Stack Software Engineer, Reinforcement Learning Remote Visa

Anthropic

TypeScript AWS React Python GCP

San Francisco, CA | New York City, NY

$300k–$405k/yr

Published 3 days ago Apply →

AI Research Engineer - Datadog AI Research (DAIR) Remote

Datadog

C++ Ray JAX CUDA DeepSpeed

New York City, NY, USA

Indexed 3 days ago Apply →

AI Research Engineer – Datadog AI Research (DAIR) Remote

Datadog

C++ Ray JAX CUDA DeepSpeed

New York, New York, USA

$140k–$400k/yr

Indexed 3 days ago Apply →

Engineering Manager, Inference Routing and Performance Remote Visa

Anthropic

continuous batching coordination planes prefill/decode disaggregation KV caching Trainium

San Francisco, CA | New York City, NY

$405k–$485k/yr

Published 1 month ago Apply →

Senior AI Engineer - APM Experiences Remote

Datadog

Datadog APM AI/ML Java Go Python

New York, New York, USA

$187k–$240k/yr

Indexed 3 days ago Apply →

Senior / Staff+ Software Engineer, Voice Platform Remote Visa

Anthropic

gRPC WebAudio AI/ML WebRTC distributed systems

San Francisco, CA | New York City, NY | Seattle, WA

$320k–$485k/yr

Published 2 weeks ago Apply →

AI Solutions Engineer, Post Sales Scale - W&B Remote

Coreweave

LightGBM Ray Fastai AWS scikit-learn

Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA / Philadelphia, PA

$139k–$204k/yr

Indexed 3 days ago Apply →

Senior Production Engineer, Tooling & Frameworks Remote

Coreweave

MLOps vector databases Grafana Data Infrastructure Telemetry

Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA

$139k–$204k/yr

Indexed 3 days ago Apply →

Senior Systems Engineer, OS Automation Remote

Coreweave

Intel bash/sh AMD Grafana ARM

Livingston, NJ / New York City, NY/ Sunnyvale, CA/ Bellevue, WA

$153k–$242k/yr

Indexed 3 days ago Apply →

Staff / Senior Software Engineer, Compute Capacity Remote Visa

Anthropic

Terraform AWS Grafana Prometheus ClickHouse

San Francisco, CA | New York City, NY

$320k–$405k/yr

Published 1 month ago Apply →

AI Solutions Engineer, Pre-Sales- W&B Remote

Coreweave

TypeScript Ray AWS JavaScript Slurm

Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA / Philadelphia, PA / San Francisco, CA / Washington, D.C

$165k–$242k/yr

Indexed 3 days ago Apply →

Technical Program Manager, Safeguards (Infrastructure & Evals) Remote Visa

Anthropic

Datadog cloud systems AI/ML Technical Program Management ML

San Francisco, CA | New York City, NY | Seattle, WA

$290k–$365k/yr

Published 2 months ago Apply →

Senior Workforce Intelligence Manager

Databricks

Databricks AI/BI Tableau AI/ML PowerBI SQL

New York City, New York; San Francisco, California

$191.1k–$262.8k/yr

Published 2 weeks ago Apply →

AI Analytics Engineer (AI & Analytics Platform) Remote

Airtable

LLMs ChatGPT Cursor Snowflake Omni Analytics

San Francisco, CA; Austin, TX; New York, NY

$141.6k–$175.1k/yr

Published 4 weeks ago Apply →

Data Scientist, Algorithms - Lyft Ads Remote

Lyft

Snowflake Spark JAX Presto scikit-learn

New York City, NY, USA

$128k–$160k/yr

Published 4 months ago Apply →

Corporate Account Executive Remote Visa

Roboflow

AI/ML SaaS

New York, NY

$150k–$200k/yr

Published 8 months ago Apply →