"evaluation infrastructure" Jobs

234 open tech roles matching “evaluation infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: AI/ML, Python, SQL. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 234 results

Anthropic

Build evaluation infrastructure for AI safety systems at Anthropic, focusing on real-world misuse detection.

Anthropic San Francisco, CA | New York City, NY $320k–$485k/yr Published 1 month ago
Flexible on stack
Anthropic
Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | New York City, NY $320k–$485k/yr Published 3 months ago
Anthropic

Own the infrastructure for machine learning research to detect and mitigate misuse of AI models at Anthropic.

Anthropic San Francisco, CA | New York City, NY $350k–$500k/yr Published 1 week ago
Flexible on stack
Anthropic

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 2 months ago
Flexible on stack
Datadog

Define and build measurement systems for AI agent integrations at Datadog, ensuring continuous improvement in agent performance.

Datadog New York, New York, USA $276k–$345k/yr Published 2 months ago
Datadog

Join Datadog as a Staff Applied Scientist to lead the evaluation strategy for AI-driven Dashboards in a hybrid work environment.

Datadog New York, New York, USA $276k–$345k/yr Published 1 month ago
Block
Block New York, NY, United States of America $160.7k–$283.6k/yr Published 3 months ago
Cockroach Labs

Join Cockroach Labs as a Performance Engineer to enhance database performance and efficiency in a collaborative, high-impact team.

Cockroach Labs New York, NY $180k–$238.1k/yr Published 2 months ago
Flexible on stack
Anthropic

Join Anthropic as a Data Engineer to build data infrastructure that ensures AI systems are safe and beneficial.

Anthropic San Francisco, CA | New York City, NY $1–$2/yr Published 1 week ago
Flexible on stack
Cursor

Build technical content and hands-on experiences to help developers effectively use Cursor's AI coding tools.

Cursor New York Published 4 days ago
Anthropic

Join Anthropic as a Data Engineer to build data infrastructure that ensures AI systems are safe and beneficial.

Anthropic San Francisco, CA | New York City, NY $320k–$405k/yr Published 3 weeks ago
Flexible on stack
MongoDB
MongoDB Austin; New York City; San Francisco; Seattle; United States $127k–$249k/yr Published 4 months ago
Anthropic
Anthropic Remote-Friendly (Travel Required) | San Francisco, CA; San Francisco, CA | New York City, NY $850k–$850k/yr Published 4 months ago
Fireworks AI

Design and maintain large-scale backend infrastructure for a leading generative AI platform at Fireworks AI.

Fireworks AI New York Published 1 month ago
Flexible on stack
Anthropic

Join Anthropic as a Staff+ Software Engineer to build scalable GRC platforms and automate compliance processes.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$405k/yr Published 1 month ago
Flexible on stack
Anthropic

Join Anthropic as a Research Engineer to enhance AI's ability to understand and operate software, contributing to impactful AI systems.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $500k–$850k/yr Published 4 weeks ago
Flexible on stack
Cockroach Labs

Join Cockroach Labs as a Value Engineer to drive financial narratives and ROI models for enterprise customers adopting CockroachDB.

Cockroach Labs London, UK; New York, NY $145k–$190k/yr Published 1 month ago
Anthropic
Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | Seattle, WA | New York City, NY $500k–$850k/yr Published 6 months ago