Direct from source · No middlemen

Evaluation Systems Jobs in New York

312 open positions · Updated 1 month ago

Average salary: 238.5k–346.6k/yr

Showing 20 of 312 positions

Search with filters →
Anthropic

Build evaluation infrastructure for AI safety systems at Anthropic, focusing on real-world misuse detection.

Anthropic San Francisco, CA | New York City, NY $320k–$485k/yr Published 1 month ago
Flexible on stack
Datadog

Join Datadog as a Staff Applied Scientist to lead the evaluation strategy for AI-driven Dashboards in a hybrid work environment.

Datadog New York, New York, USA $276k–$345k/yr Published 1 month ago
Anthropic
Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | New York City, NY $320k–$485k/yr Published 3 months ago
Anthropic
Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | Washington, DC; San Francisco, CA | New York City, NY $230k–$270k/yr Published 4 months ago
Datadog

Define and build measurement systems for AI agent integrations at Datadog, ensuring continuous improvement in agent performance.

Datadog New York, New York, USA $276k–$345k/yr Published 2 months ago
Brex

Own the tools and workflows for Brex's GTM teams, driving efficiency and integrating AI into daily operations.

Brex New York, New York, United States $135.7k–$169.7k/yr Published 1 week ago
Flexible on stack
Mercury

Join Mercury as a Senior Quality Analyst to drive insights-driven quality improvements in customer support using AI-assisted tools.

Mercury Dublin, Ireland; San Francisco, CA, New York, NY, Portland, OR, or Remote within Canada or United States $90.8k–$113.5k/yr Published 1 week ago
Gusto
Gusto San Francisco, CA - Hybrid; Denver, CO - Hybrid; New York, NY - Hybrid $163k–$204k/yr Published 4 months ago
Anthropic

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 2 months ago
Flexible on stack
Harvey AI

Join Harvey AI as a Staff Software Engineer to build indispensable AI agents for legal professionals.

Harvey AI New York $231k–$340k/yr Published 6 days ago
Flexible on stack
Mercury

Lead the data strategy and reporting function within the Customer Support organization at Mercury.

Mercury San Francisco, CA, New York, NY, Portland, OR, or Remote within Canada or United States $154.2k–$192.8k/yr Published 3 weeks ago
Flexible on stack
Harvey AI

Join Harvey AI as a Senior Software Engineer to build indispensable AI agents for legal professionals.

Harvey AI New York $193.4k–$290k/yr Published 6 days ago
Flexible on stack
Anthropic

Join Anthropic as a dedicated education researcher to measure learning and AI fluency in a hands-on role within a small team.

Anthropic San Francisco, CA | New York City, NY $300k–$405k/yr Published 3 weeks ago
Flexible on stack
Page 1 of 16