"evaluation systems" Jobs

1534 open tech roles matching “evaluation systems”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: AI/ML, Python, TypeScript. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 1534 results

Cursor

Lead the Evals team at Cursor to create high-signal evaluation datasets and tools for coding agents.

Cursor San Francisco Published 3 months ago
Heavy meetings
Distyl AI

Join Distyl AI as a Senior AI Engineer to design evaluation frameworks that enhance AI systems in production.

Distyl AI San Francisco $150k–$250k/yr Published 2 months ago
70% coding
Perplexity AI

Build and improve the technical foundations for Answer Quality at Perplexity AI, collaborating with data scientists and engineers.

Perplexity AI San Francisco Published 5 months ago
Flexible on stack
Exa

Join Exa as an ML evals engineer to design and build evaluation frameworks for a groundbreaking AI search engine.

Exa San Francisco, California Published 11 months ago
Flexible on stack
Cartesia

Join Cartesia as a lead researcher to design evaluation frameworks for next-generation AI models.

Cartesia *HQ - San Francisco, CA Published 10 months ago
AI-first team
Vals AI

Join Vals AI as an Evaluations Engineer to evaluate LLM models and contribute to industry-leading benchmarks.

Vals AI San Francisco, United States Published 2 months ago
Flexible on stack
Anthropic

Join Anthropic as a Cyber Evaluations Engineer to design and run evaluations for AI systems, ensuring their safety and robustness.

Anthropic San Francisco, CA | Washington, DC $300k–$405k/yr Published 1 week ago
Flexible on stack
baseten

Join Baseten as a Software Engineer to drive model performance systems at the intersection of HPC and LLM engineering.

baseten San Francisco Published 8 months ago
Flexible on stack
Reflection AI

Conduct critical analysis and develop evaluation frameworks to improve AI model capabilities in a fast-paced startup environment.

Reflection AI San Francisco, CA Published 9 months ago
Town

Build eval systems and quality metrics for a personalized AI assistant at a startup in San Francisco.

Town San Francisco Published 2 weeks ago
Harvey AI

Join Harvey as a Senior Product Operations Manager to build and scale the evaluation engine for a global AI platform.

Harvey AI San Francisco Published 3 months ago
AI-first team
Vals AI

Join Vals AI as a researcher to design and build next-gen AI benchmarks in a fast-paced, innovative environment.

Vals AI San Francisco, United States Published 2 months ago
Flexible on stack
Vals AI

Lead the research efforts at Vals AI to advance the science of evaluation in the AI economy.

Vals AI San Francisco, United States Published 2 months ago
Vals AI

Join Vals AI as a mid-level engineer to build and maintain a platform for evaluating LLMs at scale in a dynamic startup environment.

Vals AI San Francisco, United States Published 2 months ago
Flexible on stack
Judgment Labs

Own end-to-end problems in building and improving AI agent learning infrastructure at Judgment Labs.

Judgment Labs San Francisco Published 2 months ago
Reflection AI

Lead the design and implementation of performance management programs at Reflection AI to support talent development and organizational growth.

Reflection AI San Francisco, CA Published 1 month ago
Mirendil

Join Mirendil as a research engineer to build evaluation infrastructure for frontier AI models.

Mirendil San Francisco $300k–$400k/yr Published 2 months ago
AI-first team
Harvey AI

Own the quality bar for human evaluations at a fast-scaling AI company transforming legal services.

Harvey AI San Francisco $155.4k–$233.2k/yr Published 1 month ago