"evaluation infrastructure" Jobs

Join Arena as an Infrastructure Engineer to build scalable systems for real-world AI model evaluation.

Join Elastic as an AI QA & Evaluation Engineer to validate and test AI infrastructure and solutions in a fully remote environment.

Join Arena as a Site Reliability Engineer to build core infrastructure for AI model evaluations at scale.

Lead the Evals team at Cursor to create high-signal evaluation datasets and tools for coding agents.

Own quality for an AI-enabled decision-support system as a QA Engineer in a fully remote role.

Join Reflection AI as a Research Software Engineer to build secure infrastructure for sensitive model evaluations in a fast-paced startup environment.

Build an AI-native regulatory intelligence system in a 12-week residency focused on operational decisions in regulated environments.

Join Cartesia as a lead researcher to design evaluation frameworks for next-generation AI models.

Join Anthropic as a Tech Lead to build reliable AI evaluation systems in a hybrid work environment.

Join Judgment Labs as a Senior Backend Engineer to build infrastructure for AI agents in a fast-paced, onsite environment in San Francisco.

Join Sarvam as a Data Scientist to design evaluation frameworks for AI outputs in high-stakes domains.

Join Protege as a Forward Deployed Machine Learning Engineer to build the technical foundation for AI training data evaluations.

Join Qualified Health as a Clinical AI Evaluation Intern to evaluate AI-generated clinical content and impact patient care.

Join Mirendil as a research engineer to build evaluation infrastructure for frontier AI models.

Join MaintainX as a Senior SDET to build shared testing infrastructure and AI-assisted tooling for high-quality software delivery.

Join MaintainX as a Senior SDET to build a shared quality platform and enhance AI-powered testing across engineering teams.

Build and improve the technical foundations for Answer Quality at Perplexity AI, collaborating with data scientists and engineers.