"evaluation infrastructure" Jobs

3506 open tech roles matching “evaluation infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, Kubernetes. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 3506 results

GitLab

Join GitLab as a Site Reliability Engineer to ensure the reliability and efficiency of user-facing services in a remote-first environment.

GitLab Remote Published 5 days ago
Flexible on stack
Handshake

Lead the Quality team at Handshake to enhance AI output reliability and evaluation accuracy in a fast-growing AI data business.

Handshake San Francisco, CA Published 2 months ago
Heavy meetings
Arena

Lead the design and development of scalable, high-performance real-time data and API infrastructure for AI evaluation.

Arena Bay Area Published 8 months ago
AI-first team
Preference Model

Join Preference Model as a Senior ML Infrastructure Engineer to build scalable infrastructure for post-training research on large language models.

Preference Model San Francisco Published 3 days ago
Flexible on stack
Fieldguide

Join Fieldguide as a Senior AI Engineer to build reliable AI agents for audit workflows in a remote-first environment.

Fieldguide San Francisco, CA or Remote (USA) Published 4 months ago
Flexible on stack
Together AI

Own and improve the qualification process for new compute capacity at Together AI, ensuring technical standards are met.

Together AI San Francisco $200k–$250k/yr Published 1 month ago
Flexible on stack
Flock Safety

Lead the end-to-end quality assurance strategy for mechatronic systems in a fast-paced environment supporting first responders.

Flock Safety Atlanta, GA $150k–$180k/yr Published 1 month ago
Flexible on stack
Reflection AI

Join Reflection AI as a Research Program Manager to build foundational infrastructure for model evaluations and safety in AI.

Reflection AI New York, NY Published 4 months ago
EliseAI

Join EliseAI as a Senior DevOps Engineer to build and maintain infrastructure that supports reliable software deployment in a fast-paced environment.

EliseAI New York City $230k–$320k/yr Published 8 months ago
Flexible on stack
Echodyne

Join Echodyne as a Test Engineer II to enhance on-radar firmware testing for cutting-edge radar technology.

Echodyne Kirkland, WA $114.3k–$171.0k/yr Published 1 month ago
Flexible on stack
Handshake

Join Handshake as a Software Engineer I to build backend systems that ensure data quality for leading AI labs.

Handshake San Francisco, CA Published 4 days ago
Flexible on stack
Reflection AI

Design and operate large-scale GPU infrastructure for model inference and mid-training workloads at Reflection AI.

Reflection AI San Francisco, CA Published 5 months ago
Flexible on stack
Reliable Robotics Corporation

Lead and grow the Simulation and Test Systems team to enhance aviation safety through advanced simulation and testing technologies.

Reliable Robotics Corporation Mountain View, CA Published 1 week ago
Flexible on stack Heavy meetings
Anthropic

Join Anthropic as a Research Engineer to build evaluation instruments for AI development in a remote-friendly environment.

Anthropic Remote-Friendly (Travel Required) | San Francisco, CA $350k–$850k/yr Published 5 days ago
Flexible on stack
Thumbtack

Join Thumbtack as a Staff Software Engineer to lead the development of AI/ML infrastructure for innovative home improvement solutions.

Thumbtack Remote, United States $212.5k–$275k/yr Published 4 days ago
Applied Intuition

Join Applied Intuition as an AI Performance Engineer to optimize large-scale machine learning workloads in a collaborative environment.

Applied Intuition Sunnyvale Published 1 month ago
Flexible on stack
Arena

Join Arena as a Software Engineer focusing on product security, designing and implementing robust security systems for AI applications.

Arena Bay Area Published 8 months ago
Flexible on stack 70% coding