"real time ml serving infrastructure" Jobs

Showing 20 of 29 results

Staff Backend Software Engineer

Databricks New York $190k–$261.3k/yr Published 2 months ago

Ray system observability Sagemaker Azure ML SGLang

Apply →

Staff Software Engineer - AI Research Infrastructure

Develop and run the research stack that powers Databricks AI Research, enabling rapid large-scale experiments.

Databricks New York City, New York; San Francisco, California $199k–$270k/yr Published 2 weeks ago

C++ Ray Java Go Slurm

Flexible on stack

Apply →

Staff Software Engineer - AI Research Infrastructure

Databricks New York City, New York; San Francisco, California $190k–$270k/yr Published 1 month ago

C++ Ray AI/ML Java Go

Apply →

Applied Machine Learning Engineer Remote

PermitFlow New York City, NY Published 3 months ago

Pinecone AWS NLP Faiss PyTorch

Apply →

Sr. Manager, Engineering - AI Gateway (LLM Inference) Remote

Databricks New York $228.6k–$314.3k/yr Published 2 months ago

Machine Learning AI/ML Generative AI

Apply →

Full-Stack Software Engineer, Reinforcement Learning Remote Visa

Anthropic San Francisco, CA | New York City, NY $300k–$405k/yr Published 1 month ago

TypeScript AWS React Python GCP

Apply →

Data Scientist, ML (Agentic, CX) Remote

Lead machine learning development for customer experience systems at Robinhood, impacting how customers interact with finance.

Robinhood Menlo Park, CA; New York, NY $158k–$185k/yr Published 2 weeks ago

A/B Testing Machine Learning SQL LLM Python

Flexible on stack

Apply →

AI Research Engineer - Datadog AI Research (DAIR) Remote

Datadog New York, New York, USA $140k–$400k/yr Published 9 months ago

C++ Ray JAX CUDA DeepSpeed

Apply →

Performance Engineer, Inference Systems Remote Visa

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 1 week ago

pandas Load Balancing SQL TPU Python

Flexible on stack

Apply →

Engineering Manager, Inference Routing and Performance Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$485k/yr Published 2 months ago

continuous batching coordination planes prefill/decode disaggregation KV caching Trainium

Apply →

Senior AI Engineer - APM Experiences Remote

Datadog New York, New York, USA $187k–$240k/yr Published 6 months ago

Datadog APM AI/ML Java Go Python

Apply →

Software Engineer, Data Infrastructure Remote

Figma San Francisco, CA • New York, NY • United States $153k–$376k/yr Published 1 year ago

Snowflake Spark Golang Airflow dbt

Apply →

Data Platform Engineer Remote

Figma San Francisco, CA • New York, NY • United States $235k–$376k/yr Published 1 month ago

LLMs AWS Feature Stores Snowflake RAG systems

Apply →

Technical Program Manager, Safeguards (Infrastructure & Evals) Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $290k–$365k/yr Published 3 months ago

Datadog cloud systems AI/ML Technical Program Management ML

Apply →

Software Engineer, Safeguards Labs Remote Visa

Join Anthropic's Safeguards Labs as a Software Engineer to develop reliable AI safety systems in a collaborative environment.

Anthropic San Francisco, CA | New York City, NY $405k–$485k/yr Published 2 weeks ago

AI/ML Python

Flexible on stack

Apply →

Group Product Manager, Agent Security

Google DeepMind Mountain View, California, US; New York City, New York, US; San Francisco, California, US $240k–$334k/yr Published 2 months ago

AI/ML Cybersecurity

Apply →

Corporate Account Executive Remote Visa

Roboflow New York, NY $150k–$200k/yr Published 10 months ago

AI/ML SaaS

Apply →

Performance Engineer, GPU Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $280k–$850k/yr Published 8 months ago

FP8 NVLink Triton JAX CUTLASS

Apply →

Senior+ Software Engineer, Research Tools Remote Visa

Anthropic San Francisco, CA | New York City, NY $300k–$405k/yr Published 6 months ago

TypeScript AI/ML experimentation platforms React full-stack

Apply →

Research Engineer, Evaluations Remote

AssemblyAI Remote - New York $210k–$260k/yr Published 2 months ago

TTS ASR VAD Voice AI Machine Learning

Apply →