"evaluation pipelines" Jobs

2739 open tech roles matching “evaluation pipelines”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, AWS. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 2739 results

Protege

Join Protege as a Forward Deployed Machine Learning Engineer to build the technical foundation for AI training data evaluations.

Protege Remote Published 1 month ago
Meeno

Build an AI-native regulatory intelligence system in a 12-week residency focused on operational decisions in regulated environments.

Meeno Mountain View, CA $10k–$10k/mo Published 10 months ago
Flexible on stack
Reflection AI

Join Reflection AI as a Data Quality Engineer to ensure high-quality data for model training in a mission-driven research lab.

Reflection AI San Francisco, CA Published 8 months ago
Flexible on stack
Arena

Join Arena as a Member of Technical Staff to build data infrastructure for evaluating AI model performance.

Arena Bay Area Published 8 months ago
Flexible on stack
MaintainX

Join MaintainX as a Senior SDET to build shared testing infrastructure and AI-assisted tooling for high-quality software delivery.

MaintainX Toronto Published 2 months ago
Flexible on stack 70% coding
DEFCON AI

Own quality for an AI-enabled decision-support system as a QA Engineer in a fully remote role.

DEFCON AI Remote, USA $135k–$170k/yr Published 3 weeks ago
Flexible on stack
MaintainX

Join MaintainX as a Senior SDET to build a shared quality platform and enhance AI-powered testing across engineering teams.

MaintainX San Francisco Published 4 days ago
Flexible on stack
Reflection AI

Join Reflection AI as a Forward Deployed Engineer to fine-tune models and work directly with enterprise customers in a dynamic startup environment.

Reflection AI San Francisco, CA Published 4 months ago
EliseAI

Join EliseAI as a Senior DevOps Engineer to build and maintain infrastructure that supports reliable software deployment in a fast-paced environment.

EliseAI New York City $230k–$320k/yr Published 8 months ago
Flexible on stack
Mirendil

Join Mirendil as a research engineer to build evaluation infrastructure for frontier AI models.

Mirendil San Francisco $300k–$400k/yr Published 2 months ago
AI-first team
Lilt

Lead quality management for AI deliverables at Lilt, ensuring high standards in a hybrid work environment.

Lilt Boston, MA Published 1 week ago
Anthropic

Join Anthropic as a Tech Lead to build reliable AI evaluation systems in a hybrid work environment.

Anthropic San Francisco, CA $500k–$850k/yr Published 1 month ago
Flexible on stack
Iambic Therapeutics

Join Iambic Therapeutics as a Software Engineer to develop agentic data pipelines for biomedical data using LLMs.

Iambic Therapeutics Remote - US Published 1 week ago
Flexible on stack
Cantina

Join Cantina as a Machine Learning Engineer to lead audio model evaluations and shape the future of social AI.

Cantina Europe $200k–$220k/yr Published 4 months ago
AI-first team
Judgment Labs

Join Judgment Labs as an Applied AI Engineer to build self-improving AI systems using real-world agent interaction data.

Judgment Labs San Francisco Published 8 months ago
Cartesia

Join Cartesia as a lead researcher to design evaluation frameworks for next-generation AI models.

Cartesia *HQ - San Francisco, CA Published 10 months ago
AI-first team
Cursor

Lead a team of engineers to build infrastructure for training and evaluating ML models in a flat, innovative organization.

Cursor San Francisco Published 2 months ago
Heavy meetings
Dialpad

Join Dialpad as a Sr. Software Development Engineer in Test to enhance AI-driven customer experience solutions.

Dialpad Kitchener, Canada CA$149k–CA$173.8k/yr Published 1 week ago
Flexible on stack
Poolside AI

Build a scalable Experiment Platform at Poolside AI, working with a remote-first team to enhance research workflows.

Poolside AI Remote (EMEA/East Coast) Published 1 month ago
Flexible on stack
Postman

Join Postman as an AI Engineer Intern to work on large-scale AI systems with mentorship from senior engineers.

Postman Berkeley, California, United States; San Francisco, California, United States Published 1 month ago
Flexible on stack