"evaluation infrastructure" Jobs

516 open tech roles matching “evaluation infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: Python, AI/ML, AWS. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 516 results

Reflection AI

Join Reflection AI as a Research Software Engineer to build secure infrastructure for sensitive model evaluations in a fast-paced startup environment.

Reflection AI New York, NY Published 1 month ago
Flexible on stack
Reflection AI

Join Reflection AI as a hands-on technical staff member to enhance model performance through data-driven evaluations and feedback loops.

Reflection AI New York, NY Published 2 weeks ago
Reflection AI

Lead the post-training and evaluation capabilities for large language models in a dynamic AI research lab.

Reflection AI New York, NY Published 10 months ago
Anthropic
Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | New York City, NY $320k–$485k/yr Published 4 months ago
Reflection AI

Join Reflection AI as a Research Program Manager to build foundational infrastructure for model evaluations and safety in AI.

Reflection AI New York, NY Published 4 months ago
EliseAI

Join EliseAI as a Senior DevOps Engineer to build and maintain infrastructure that supports reliable software deployment in a fast-paced environment.

EliseAI New York City $230k–$320k/yr Published 8 months ago
Flexible on stack
Anthropic

Own the infrastructure for machine learning research to detect and mitigate misuse of AI models at Anthropic.

Anthropic San Francisco, CA | New York City, NY $350k–$500k/yr Published 1 month ago
Flexible on stack
Anthropic

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 3 months ago
Flexible on stack
Tennr

Join Tennr as a Clinical Criteria Escalations Specialist to support the Qualifications team in evaluating medical necessity and documentation requirements.

Tennr New York City Office Published 1 month ago
Coreweave

As an AI Engineer, you'll design and build systems that help engineers resolve real customer issues effectively.

Coreweave Livingston, NJ / New York, NY / Sunnyvale, CA $143k–$210k/yr Published 2 weeks ago
Flexible on stack 70% coding
Reflection AI

Lead the design and implementation of cutting-edge identity and access management systems in a high-stakes AI research environment.

Reflection AI New York, NY Published 2 months ago
Flexible on stack
Anthropic

Lead a team of engineers to optimize Anthropic's inference infrastructure for AI systems.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $405k–$625k/yr Published 1 week ago
Flexible on stack Heavy meetings
Traversal

Join Traversal as an AI Research Engineer to build and scale infrastructure for AI agents diagnosing production incidents.

Traversal New York $180k–$300k/yr Published 3 weeks ago
70% coding
Traversal

Join Traversal as an AI Platform Engineer to build scalable systems that enhance AI performance in complex production environments.

Traversal New York $150k–$300k/yr Published 2 months ago
Doctronic

Join Doctronic as a Senior AI Engineer to build intelligent systems that enhance clinical decision-making in healthcare.

Doctronic New York City Published 1 month ago
Reflection AI

Join Reflection AI as a Forward Deployed Engineer to drive AI solutions for enterprise customers in a hands-on role.

Reflection AI New York, NY Published 9 months ago
Flexible on stack
Anthropic

Join Anthropic as a Staff Software Engineer to build AI-driven educational experiences at scale.

Anthropic San Francisco, CA | New York City, NY $320k–$405k/yr Published 1 month ago
Udio

Join Udio as a Senior Backend Engineer to design and build scalable systems that enhance user experience and data reliability.

Udio New York $180k–$220k/yr Published 10 months ago
Flexible on stack
Reflection AI

Join Reflection AI as a Distributed Systems Engineer to build foundational platforms for open intelligence systems.

Reflection AI New York, NY Published 6 months ago
Flexible on stack