"llm evaluation" Jobs

496 open tech roles matching “llm evaluation”, taken straight from company career pages — not reposted from other job boards. Most in demand right now: AI/ML, Python, TypeScript. Every listing is re-checked daily and closed roles are removed.

Showing 20 of 496 results

Perplexity AI

Join the Model Behavior team at Perplexity AI to shape AI product responses through context and prompt engineering.

Perplexity AI San Francisco Published 1 month ago
Ambience Healthcare

Build and improve AI systems for clinical products as a Senior Machine Learning Engineer in a hybrid role at Ambience Healthcare.

Ambience Healthcare San Francisco $225k–$300k/yr Published 1 month ago
Flexible on stack 70% coding
Perplexity

Join the Model Behavior team to shape Perplexity’s AI products through context and prompt engineering.

Perplexity San Francisco Published 1 month ago
baseten

Lead and mentor a team of Forward Deployed Engineers to optimize LLM inference workloads for Baseten customers.

baseten San Francisco Published 4 months ago
Flexible on stack Heavy meetings
Reflection AI

Join Reflection AI as a Data Quality Engineer to ensure high data standards for AI model training and evaluation.

Reflection AI San Francisco, CA Published 8 months ago
Flexible on stack
Crucibl

Join Crucibl as a Member of Technical Staff to push the frontier of judgment in AI and shape the future of decision-making.

Crucibl San Francisco, CA Published 1 month ago
Harvey AI

Own the quality bar for human evaluations at a fast-scaling AI company transforming legal services.

Harvey AI San Francisco $155.4k–$233.2k/yr Published 1 month ago
Braintrust Data

Join Braintrust as a backend engineer to build infrastructure for cutting-edge AI development tools in a fast-paced environment.

Braintrust Data San Francisco Published 1 month ago
Flexible on stack
Distyl AI

Join Distyl AI as a Senior AI Engineer to design evaluation frameworks that enhance AI systems in production.

Distyl AI San Francisco $150k–$250k/yr Published 2 months ago
70% coding
krea.ai

Join Krea as an ML Researcher to finetune diffusion models and enhance AI creative tools in a collaborative environment.

krea.ai San Francisco Published 1 week ago
Flexible on stack
Preference Model

Join Preference Model as a Senior ML Infrastructure Engineer to build scalable infrastructure for post-training research on large language models.

Preference Model San Francisco, United States Published 2 days ago
Flexible on stack
Preference Model

Join Preference Model as a Senior ML Infrastructure Engineer to build scalable infrastructure for post-training research on large language models.

Preference Model San Francisco Published 3 days ago
Flexible on stack
Sphere

Lead the development of TRAM, an AI reasoning model for interpreting global trade law in a fast-paced, onsite environment.

Sphere San Francisco HQ Published 11 months ago
Abridge

Lead the product strategy for Abridge's AI/ML evaluation platform, ensuring quality and efficiency across multiple product teams.

Abridge SF Office Published 2 months ago
Langfuse

Join Langfuse as a Developer Relations Engineer to enhance community engagement and represent the company at key events across Europe and the US.

Langfuse Europe or US Published 1 month ago
Flexible on stack
Databricks

Lead a multidisciplinary research team to advance large-scale machine learning efficiency at Databricks.

Databricks Mountain View, California; San Francisco, California $270k–$340k/yr Published 3 months ago
Flexible on stack 60% coding