"evaluation infrastructure" Jobs

857 open tech roles matching “evaluation infrastructure”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: AI/ML, Python, TypeScript. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 857 results

Fieldguide

Join Fieldguide as a Senior AI Engineer to build reliable AI agents for audit workflows in a remote-first environment.

Fieldguide San Francisco, CA or Remote (USA) Published 4 months ago
Flexible on stack
Together AI

Own and improve the qualification process for new compute capacity at Together AI, ensuring technical standards are met.

Together AI San Francisco $200k–$250k/yr Published 1 month ago
Flexible on stack
Handshake

Join Handshake as a Software Engineer I to build backend systems that ensure data quality for leading AI labs.

Handshake San Francisco, CA Published 5 days ago
Flexible on stack
Reflection AI

Design and operate large-scale GPU infrastructure for model inference and mid-training workloads at Reflection AI.

Reflection AI San Francisco, CA Published 5 months ago
Flexible on stack
Anthropic

Join Anthropic as a Research Engineer to build evaluation instruments for AI development in a remote-friendly environment.

Anthropic Remote-Friendly (Travel Required) | San Francisco, CA $350k–$850k/yr Published 6 days ago
Flexible on stack
baseten

Join Baseten as a Software Engineer to build continuous deployment infrastructure for AI products in a fast-growing team.

baseten San Francisco Published 1 month ago
Flexible on stack
Anthropic

Own the infrastructure for machine learning research to detect and mitigate misuse of AI models at Anthropic.

Anthropic San Francisco, CA | New York City, NY $350k–$500k/yr Published 1 month ago
Flexible on stack
Harvey AI

Join Harvey as a Senior Product Operations Manager to build and scale the evaluation engine for a global AI platform.

Harvey AI San Francisco Published 3 months ago
AI-first team
baseten

Join Baseten as a Software Engineer to build an AI developer platform that enhances productivity for engineers.

baseten San Francisco Published 1 month ago
Flexible on stack
Anthropic

Join Anthropic as a Performance Engineer to optimize AI inference systems for throughput, latency, reliability, and correctness.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 3 months ago
Flexible on stack
Meter

Join Meter as a Backend Engineer to design and implement a unified data interface for model development in a cutting-edge networking company.

Meter San Francisco $160k–$230k/yr Published 1 year ago
Flexible on stack
Gamma

Own and enhance AI systems at Gamma, focusing on prompts and performance for millions of users.

Gamma San Francisco $180k–$300k/yr Published 10 months ago
Flexible on stack 70% coding
krea.ai

Join Krea as an ML Researcher to finetune diffusion models and enhance AI creative tools in a collaborative environment.

krea.ai San Francisco Published 1 week ago
Flexible on stack
Judgment Labs

Join Judgment Labs as an Applied AI Engineer to build self-improving AI systems using real-world agent interaction data.

Judgment Labs San Francisco Published 8 months ago
Benchling

Join Benchling as a Research Engineer to improve AI models for scientific applications in a fast-paced, collaborative environment.

Benchling San Francisco, CA Published 2 weeks ago
Wispr Flow

Build verification and evaluation layers for AI agents at a startup focused on voice interfaces.

Wispr Flow San Francisco, United States Published 2 days ago
Rox

Join Rox as a Founding Applied Research Engineer to shape the future of applied AI with a focus on real-world production challenges.

Rox San Francisco Published 3 months ago