"evaluation infrastructure" Jobs

1393 open tech roles matching “evaluation infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, Kubernetes. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 1393 results

Arena

Join Arena as a Site Reliability Engineer to build core infrastructure for AI model evaluations at scale.

Arena Bay Area Published 1 month ago
Flexible on stack
DEFCON AI

Own quality for an AI-enabled decision-support system as a QA Engineer in a fully remote role.

DEFCON AI Remote, USA $135k–$170k/yr Published 3 weeks ago
Flexible on stack
Judgment Labs

Join Judgment Labs as a Senior Backend Engineer to build infrastructure for AI agents in a fast-paced, onsite environment in San Francisco.

Judgment Labs San Francisco Published 3 months ago
MaintainX

Join MaintainX as a Senior SDET to build shared testing infrastructure and AI-assisted tooling for high-quality software delivery.

MaintainX Toronto Published 2 months ago
Flexible on stack 70% coding
MaintainX

Join MaintainX as a Senior SDET to build a shared quality platform and enhance AI-powered testing across engineering teams.

MaintainX San Francisco Published 5 days ago
Flexible on stack
TRM Labs

Join TRM Labs as a Senior Infrastructure Engineer to build a reliable and secure platform for AI-powered crime investigation solutions.

TRM Labs North America Published 1 year ago
Flexible on stack
Arena

Join Arena as a Backend Engineer to build APIs and services for AI model evaluations in a fast-paced startup environment.

Arena Bay Area Published 1 month ago
Lilt

Lead quality management for AI deliverables at Lilt, ensuring high standards in a hybrid work environment.

Lilt Boston, MA Published 1 week ago
Fal

Own the reliability and security of fal's generative media model APIs in a hybrid ML Engineering/SRE role.

Fal Remote - APAC Published 2 months ago
Flexible on stack
Preference Model

Join Preference Model as a Senior ML Infrastructure Engineer to build scalable infrastructure for post-training research on large language models.

Preference Model San Francisco, United States Published 2 days ago
Flexible on stack
Hebbia AI

Join Hebbia AI as a Senior Infrastructure Engineer to own and optimize our AWS cloud infrastructure and developer platform.

Hebbia AI NYC $160k–$300k/yr Published 2 weeks ago
Flexible on stack
Ambient

Design and optimize AI infrastructure for real-time intelligence at Ambient.ai, enhancing security through advanced AI models.

Ambient Redwood City Published 2 months ago
Flexible on stack 70% coding
Preference Model

Join Preference Model as a Senior ML Infrastructure Engineer to build scalable infrastructure for post-training research on large language models.

Preference Model San Francisco Published 3 days ago
Flexible on stack
Fieldguide

Join Fieldguide as a Senior AI Engineer to build reliable AI agents for audit workflows in a remote-first environment.

Fieldguide San Francisco, CA or Remote (USA) Published 4 months ago
Flexible on stack
Together AI

Own and improve the qualification process for new compute capacity at Together AI, ensuring technical standards are met.

Together AI San Francisco $200k–$250k/yr Published 1 month ago
Flexible on stack
Flock Safety

Lead the end-to-end quality assurance strategy for mechatronic systems in a fast-paced environment supporting first responders.

Flock Safety Atlanta, GA $150k–$180k/yr Published 1 month ago
Flexible on stack
Reflection AI

Join Reflection AI as a Research Program Manager to build foundational infrastructure for model evaluations and safety in AI.

Reflection AI New York, NY Published 4 months ago
EliseAI

Join EliseAI as a Senior DevOps Engineer to build and maintain infrastructure that supports reliable software deployment in a fast-paced environment.

EliseAI New York City $230k–$320k/yr Published 8 months ago
Flexible on stack