joblaze

Direct from source · No middlemen

Inference Infrastructure Jobs in New York

43 open positions · Updated 2 weeks ago

Average salary: 310.7k–429.6k/yr

Showing 20 of 43 positions

Search with filters →
Anthropic
Staff / Senior Software Engineer, Inference Remote Visa
Anthropic
AWS Load Balancing AI/ML LLM inference distributed systems
Published 6 months ago Apply →
Anthropic
Software Engineer, Inference Deployment Remote Visa
Anthropic
Trainium Rust TPU Python GPU
Published 2 months ago Apply →
Anthropic
Engineering Manager, Inference Routing and Performance Remote Visa
Anthropic
continuous batching coordination planes prefill/decode disaggregation KV caching Trainium
Published 1 month ago Apply →
Ramp
Applied AI Engineer
Ramp
backend development AI/ML LLM inference web frameworks infrastructure
Published 3 months ago Apply →
Harvey AI
Staff Software Engineer, Core Infrastructure
Harvey AI
Terraform Datadog Sentry Pulumi Go
Published 4 days ago Apply →
Together AI
Research Engineer, Frontier Speculative Decoding
Together AI
DeepSpeed AI/ML Slurm PyTorch Python
Published 5 months ago Apply →
Anthropic
Staff+ Software Engineer, Observability Remote Visa
Anthropic
Grafana Prometheus Go ClickHouse Rust
Published 1 month ago Apply →
Anthropic
Technical Program Manager, Cloud Inference Remote Visa
Anthropic
AI/ML Google Vertex AI Amazon Bedrock cloud computing Microsoft Foundry
Published 3 days ago Apply →
Anthropic
Software Engineer, Compute Efficiency Remote Visa
Anthropic
AWS AI/ML Java Go eBPF
Published 2 months ago Apply →
Databricks
Sr. Manager, Engineering - AI Gateway (LLM Inference) Remote
Databricks
Machine Learning AI/ML Generative AI
Published 4 weeks ago Apply →
Anthropic
Staff / Senior Software Engineer, Compute Capacity Remote Visa
Anthropic
Terraform AWS Grafana Prometheus ClickHouse
Published 2 months ago Apply →
Datadog
AI Research Engineer - Datadog AI Research (DAIR) Remote
Datadog
C++ Ray JAX CUDA DeepSpeed
Published 8 months ago Apply →
Poolside AI
Forward Deployed Research Engineer (FDRE - Clearance) Remote
Poolside AI
Terraform Datadog Grafana Prometheus AI/ML
Published 1 week ago Apply →
Anthropic
Technical Program Manager, Safeguards (Infrastructure & Evals) Remote Visa
Anthropic
Datadog cloud systems AI/ML Technical Program Management ML
Published 2 months ago Apply →
Anthropic
Staff+ Software Engineer, Backend Remote Visa
Anthropic
LLMs SO2 distributed systems cloud infrastructure agentic applications
Published 3 weeks ago Apply →
Datadog
AI Research Scientist - Datadog AI Research (DAIR)
Datadog
multimodal learning Machine Learning DeepSpeed AI/ML reinforcement learning
Published 1 year ago Apply →
PermitFlow
Applied AI Engineer Remote
PermitFlow
AI/ML Data Pipelines APIs Backend Frontend
Published 2 months ago Apply →
Stripe
Backend Engineer, AI Security Remote
Stripe
AI/ML infrastructure security
Published 1 week ago Apply →
Anthropic
Senior / Staff+ Software Engineer, Voice Platform Remote Visa
Anthropic
gRPC WebAudio AI/ML WebRTC distributed systems
Published 1 month ago Apply →
Anthropic
Research Lead, Training Insights Remote Visa
Anthropic
Large Language Models reinforcement learning inference Pretraining Evaluation Methodologies
Published 1 month ago Apply →
Page 1 of 3

Related searches

inference infrastructure Remote inference infrastructure in London inference infrastructure in San Francisco inference infrastructure in Berlin inference infrastructure in Amsterdam Python in New York Ruby On Rails in New York React in New York Devops in New York Machine Learning in New York Golang in New York Typescript in New York