"evaluators" Jobs

1618 open tech roles matching “evaluators”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: AI/ML, Python, TypeScript. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 1618 results

Handshake

Join Handshake as a Member of Technical Staff to define and build evaluation frameworks for frontier AI systems.

Handshake San Francisco, CA Published 1 month ago
Flexible on stack
Exa

Join Exa as a Product Manager on the Evals team to oversee evaluation data for search models in a cutting-edge AI lab.

Exa San Francisco, California Published 3 weeks ago
Anthropic

Manage partnerships with external evaluators to enhance AI safety practices and support independent evaluations.

Anthropic San Francisco, CA | New York City, NY $290k–$365k/yr Published 5 days ago
Cartesia

Join Cartesia as a lead researcher to design evaluation frameworks for next-generation AI models.

Cartesia *HQ - San Francisco, CA Published 1 year ago
AI-first team
Exa

Join Exa as an ML evals engineer to design and build evaluation frameworks for a groundbreaking AI search engine.

Exa San Francisco, California Published 1 year ago
Flexible on stack
Vals AI

Join Vals AI as an Evaluations Engineer to evaluate LLM models and contribute to industry-leading benchmarks.

Vals AI San Francisco Published 4 months ago
Flexible on stack
Harvey AI

Own the quality bar for human evaluations at a fast-scaling AI company transforming legal services.

Harvey AI San Francisco $155.4k–$233.2k/yr Published 3 months ago
Town

Build eval systems and quality metrics for a personalized AI assistant at a startup in San Francisco.

Town San Francisco Published 2 months ago
Anthropic

Build methods and infrastructure for evaluating AI model safety at Anthropic, a leader in AI research.

Anthropic New York City, NY; San Francisco, CA; Seattle, WA $320k–$485k/yr Published 1 week ago
Flexible on stack 60% coding
Perplexity AI

Join Perplexity AI as a Software Engineer to enhance enterprise agent efficiency and improve automation workflows.

Perplexity AI San Francisco Published 4 weeks ago
Flexible on stack 70% coding
Reflection AI

Conduct critical analysis and develop evaluation frameworks to improve AI model capabilities in a fast-paced startup environment.

Reflection AI San Francisco, CA Published 11 months ago
Anthropic

Join Anthropic as a Cyber Evaluations Engineer to design and run evaluations for AI systems, ensuring their safety and robustness.

Anthropic Remote-Friendly, United States; San Francisco, CA | Washington, DC $300k–$405k/yr Published 2 months ago
Flexible on stack
Mirendil

Join Mirendil as a research engineer to build evaluation infrastructure for frontier AI models.

Mirendil San Francisco $300k–$400k/yr Published 4 months ago
AI-first team
Perplexity AI

Build and improve the technical foundations for Answer Quality at Perplexity AI, collaborating with data scientists and engineers.

Perplexity AI San Francisco Published 7 months ago
Flexible on stack
Fieldguide

Join Fieldguide as a Senior Software Engineer to enhance AI agent quality and reliability in a fast-paced startup environment.

Fieldguide San Francisco, CA Published 2 months ago
Abridge

Lead the product strategy for Abridge's AI/ML evaluation platform, ensuring quality and efficiency across multiple product teams.

Abridge SF Office Published 4 months ago
Nuna

Own the evaluation system for Nuna's AI health coach, building testing harnesses and infrastructure to ensure safety and quality.

Nuna San Francisco Published 3 months ago
Figma

Join Figma as a Researcher in AI Evaluations to enhance AI models and improve product quality through evaluation research.

Figma San Francisco, CA • New York, NY • United States $169k–$250k/yr Published 1 week ago
Harvey AI

Join Harvey AI as a Member of Technical Staff to build data and evaluation systems for legal AI models.

Harvey AI San Francisco $230k–$340k/yr Published 2 weeks ago