"evaluation pipelines" Jobs

642 open tech roles matching “evaluation pipelines”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: AI/ML, Python, SQL. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 642 results

Exa

Join Exa as an ML evals engineer to design and build evaluation frameworks for a groundbreaking AI search engine.

Exa San Francisco, California Published 1 year ago
Flexible on stack
baseten

Join Baseten as a Software Engineer to build continuous deployment infrastructure for AI products in a fast-growing team.

baseten San Francisco Published 3 months ago
Flexible on stack
Judgment Labs

Join Judgment Labs as a Senior Backend Engineer to build infrastructure for AI agents in a fast-paced, onsite environment in San Francisco.

Judgment Labs San Francisco Published 5 months ago
Abridge

Lead the product strategy for Abridge's AI/ML evaluation platform, ensuring quality and efficiency across multiple product teams.

Abridge SF Office Published 4 months ago
Anthropic

Manage partnerships with external evaluators to enhance AI safety practices and support independent evaluations.

Anthropic San Francisco, CA | New York City, NY $290k–$365k/yr Published 4 days ago
Specter

Join Specter as an applied AI software engineer to transform models into production systems for physical AI applications.

Specter San Francisco Published 2 months ago
Flexible on stack
Vals AI

Join Vals AI as a mid-level engineer to build and maintain a platform for evaluating LLMs at scale in a dynamic startup environment.

Vals AI San Francisco Published 4 months ago
Flexible on stack
Perplexity AI

Build and improve the technical foundations for Answer Quality at Perplexity AI, collaborating with data scientists and engineers.

Perplexity AI San Francisco Published 7 months ago
Flexible on stack
Anthropic

Build methods and infrastructure for evaluating AI model safety at Anthropic, a leader in AI research.

Anthropic New York City, NY; San Francisco, CA; Seattle, WA $320k–$485k/yr Published 1 week ago
Flexible on stack 60% coding
Reflection AI

Join Reflection AI as a Data Quality Engineer to ensure high data standards for AI model training and evaluation.

Reflection AI San Francisco, CA Published 10 months ago
Flexible on stack
baseten

Join Baseten as a Software Engineer to drive model performance systems at the intersection of HPC and LLM engineering.

baseten San Francisco Published 10 months ago
Flexible on stack
baseten

Join Baseten as a Post-Training Applied Researcher to enhance AI models for leading companies in a collaborative environment.

baseten San Francisco Published 1 month ago
Flexible on stack
Reflection AI

Join Reflection AI as a Data Quality Engineer to ensure high-quality data for model training in a mission-driven research lab.

Reflection AI San Francisco, CA Published 10 months ago
Flexible on stack
Mirendil

Join Mirendil as a research engineer to build evaluation infrastructure for frontier AI models.

Mirendil San Francisco $300k–$400k/yr Published 4 months ago
AI-first team
Lightfield

Join Lightfield as a Staff Software Engineer to lead the development of intelligent pipeline generation systems.

Lightfield HQ: San Francisco Published 1 month ago
Flexible on stack 60% coding
Benchling

Join Benchling as a Research Engineer to improve AI models for scientific applications in a fast-paced, collaborative environment.

Benchling San Francisco, CA Published 1 week ago
Cartesia

Join Cartesia as a lead researcher to design evaluation frameworks for next-generation AI models.

Cartesia *HQ - San Francisco, CA Published 1 year ago
AI-first team
Exa

Join Exa as a Forward Deployed Engineer, bridging product, engineering, and customer success in a fast-paced environment.

Exa San Francisco, California Published 1 year ago
AI-first team
Specter

Join Specter as a CV/ML Camera Test Engineer to enhance AI model performance through hands-on experimentation with camera systems.

Specter San Francisco Published 1 month ago
Flexible on stack
baseten

Join Baseten as a Forward Deployed Engineer to architect and deploy high-scale AI applications while collaborating with customers.

baseten San Francisco Published 2 years ago
Flexible on stack 70% coding