"evaluation infrastructure" Jobs

3506 open tech roles matching “evaluation infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, Kubernetes. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 3506 results

TRM Labs

Join TRM Labs as a Senior Infrastructure Engineer to build a reliable and secure platform for AI-powered crime investigation solutions.

TRM Labs North America Published 1 year ago
Flexible on stack
Arena

Join Arena as a Backend Engineer to build APIs and services for AI model evaluations in a fast-paced startup environment.

Arena Bay Area Published 1 month ago
Cursor

Lead a team of engineers to build infrastructure for training and evaluating ML models in a flat, innovative organization.

Cursor San Francisco Published 2 months ago
Heavy meetings
Reflection AI

Join Reflection AI as a Forward Deployed Engineer to fine-tune models and work directly with enterprise customers in a dynamic startup environment.

Reflection AI San Francisco, CA Published 4 months ago
Reflection AI

Lead the post-training and evaluation capabilities for large language models in a dynamic AI research lab.

Reflection AI New York, NY Published 10 months ago
Reflection AI

Join Reflection AI as a hands-on technical staff member to enhance model performance through data-driven evaluations and feedback loops.

Reflection AI New York, NY Published 2 weeks ago
Abridge

Lead the product strategy for Abridge's AI/ML evaluation platform, ensuring quality and efficiency across multiple product teams.

Abridge SF Office Published 2 months ago
Anthropic
Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | New York City, NY $320k–$485k/yr Published 4 months ago
Arena

Join Arena as a Member of Technical Staff to build data infrastructure for evaluating AI model performance.

Arena Bay Area Published 8 months ago
Flexible on stack
Lilt

Lead quality management for AI deliverables at Lilt, ensuring high standards in a hybrid work environment.

Lilt Boston, MA Published 1 week ago
Ambient

Design and optimize AI infrastructure for real-time intelligence at Ambient.ai, enhancing security through advanced machine learning models.

Ambient Redwood City Published 3 days ago
Flexible on stack 70% coding
GitLab

Join GitLab as a Site Reliability Engineer to ensure the reliability and efficiency of user-facing services in a fully remote environment.

GitLab Remote, Canada; Remote, US $126.4k–$314.4k/yr Published 2 months ago
Flexible on stack
Qualified Health

Join Qualified Health as a Medical Scribe Intern to evaluate AI-generated clinical content and shape the future of healthcare.

Qualified Health Palo Alto - Hybrid $40–$40/hr Published 2 weeks ago
Judgment Labs

Own end-to-end problems in building and improving AI agent learning infrastructure at Judgment Labs.

Judgment Labs San Francisco Published 2 months ago
baseten

Join Baseten as a Software Engineer to drive model performance systems at the intersection of HPC and LLM engineering.

baseten San Francisco Published 8 months ago
Flexible on stack
Fal

Own the reliability and security of fal's generative media model APIs in a hybrid ML Engineering/SRE role.

Fal Remote - APAC Published 2 months ago
Flexible on stack
Echodyne

Join Echodyne as a Test Engineer II to enhance off-radar software testing for innovative radar technology.

Echodyne Kirkland, WA $114.3k–$171.0k/yr Published 1 month ago
Flexible on stack
Preference Model

Join Preference Model as a Senior ML Infrastructure Engineer to build scalable infrastructure for post-training research on large language models.

Preference Model San Francisco, United States Published 2 days ago
Flexible on stack
Hebbia AI

Join Hebbia AI as a Senior Infrastructure Engineer to own and optimize our AWS cloud infrastructure and developer platform.

Hebbia AI NYC $160k–$300k/yr Published 2 weeks ago
Flexible on stack
Ambient

Design and optimize AI infrastructure for real-time intelligence at Ambient.ai, enhancing security through advanced AI models.

Ambient Redwood City Published 2 months ago
Flexible on stack 70% coding