"evaluation methodologies" Jobs

157 open tech roles matching “evaluation methodologies”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: AI/ML, Python, SQL. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 157 results

Fieldguide

Lead the integration of audit methodologies in a remote-first startup focused on enhancing trust in global commerce.

Fieldguide San Francisco, CA or Remote (USA) Published 3 weeks ago
Vals AI

Join Vals AI as an Evaluations Engineer to evaluate LLM models and contribute to industry-leading benchmarks.

Vals AI San Francisco, United States Published 2 months ago
Flexible on stack
Vals AI

Lead the research efforts at Vals AI to advance the science of evaluation in the AI economy.

Vals AI San Francisco, United States Published 2 months ago
Vals AI

Join Vals AI as a researcher to design and build next-gen AI benchmarks in a fast-paced, innovative environment.

Vals AI San Francisco, United States Published 2 months ago
Flexible on stack
Distyl AI

Join Distyl AI as an Applied AI Researcher to redefine software usage and drive innovative benchmarking in AI systems.

Distyl AI San Francisco $150k–$250k/yr Published 11 months ago
Reflection AI

Conduct critical analysis and develop evaluation frameworks to improve AI model capabilities in a fast-paced startup environment.

Reflection AI San Francisco, CA Published 9 months ago
Reflection AI

Join Reflection AI as a Forward Deployed Engineer to fine-tune models and work directly with enterprise customers in a dynamic startup environment.

Reflection AI San Francisco, CA Published 4 months ago
Harvey AI

Join Harvey as a Senior Product Operations Manager to build and scale the evaluation engine for a global AI platform.

Harvey AI San Francisco Published 3 months ago
AI-first team
Vals AI

Join Vals AI as a mid-level engineer to build and maintain a platform for evaluating LLMs at scale in a dynamic startup environment.

Vals AI San Francisco, United States Published 2 months ago
Flexible on stack
Harvey AI

Own the quality bar for human evaluations at a fast-scaling AI company transforming legal services.

Harvey AI San Francisco $155.4k–$233.2k/yr Published 1 month ago
Figma

Lead the evaluation of Figma's AI-powered experiences to ensure quality and effectiveness in product features.

Figma San Francisco, CA • New York, NY • United States $258k–$348k/yr Published 2 months ago
Anthropic

Drive model launches and improve coding performance as a Product Manager on Claude Code's model performance team.

Anthropic San Francisco, CA | Seattle, WA $305k–$460k/yr Published 3 months ago
Macroscope

Join Macroscope as an Applied ML Engineer to enhance machine learning systems in a collaborative startup environment.

Macroscope San Francisco $170k–$280k/yr Published 1 month ago
Flexible on stack
OpenGov

Join OpenGov as a Solutions Architect to lead QA and solution design for complex government software implementations.

OpenGov US | California | San Francisco $160k–$180k/yr Published 2 months ago
AI-first team
Reflection AI

Lead the design and implementation of performance management programs at Reflection AI to support talent development and organizational growth.

Reflection AI San Francisco, CA Published 1 month ago
Pinterest

Lead the development of user-centered measurement and metrics at Pinterest, collaborating closely with Data Science and Engineering teams.

Pinterest San Francisco, CA, US; Remote, US $163.6k–$336.9k/yr Published 1 month ago
Flexible on stack
Preference Model

Join Preference Model as a Research Engineer to advance self-directed learning in large language models within a fast-paced startup.

Preference Model San Francisco Published 3 days ago
Flexible on stack
Preference Model

Join Preference Model as a Research Engineer to advance self-directed learning in machine learning with a focus on RL environments.

Preference Model San Francisco Published 2 weeks ago
Flexible on stack
Coreweave

Drive improvements in the experiment tracking platform for leading AI teams as a Senior Product Manager at CoreWeave.

Coreweave Bellevue, WA / San Francisco, CA / Sunnyvale, CA $182k–$242k/yr Published 2 weeks ago