"evaluation framework" Jobs - Joblaze

Showing 20 of 228 results

Senior Product Operations Manager, Evaluation

Join Harvey as a Senior Product Operations Manager to build and scale the evaluation engine for a global AI platform.

Harvey AI San Francisco Published 1 week ago

AI/ML SQL Python

AI-first team

Apply →

Software Engineer, Safeguards Evals Remote Visa

Build evaluation infrastructure for AI safety systems at Anthropic, focusing on real-world misuse detection.

Anthropic San Francisco, CA | New York City, NY $320k–$485k/yr Published 2 weeks ago

LLMs Data Pipelines Agentic systems distributed systems synthetic data generation

Flexible on stack

Apply →

Safeguards Enforcement Analyst, Safety Evaluations Remote Visa

Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | Washington, DC; San Francisco, CA | New York City, NY $230k–$270k/yr Published 3 months ago

Trust and Safety Dashboards Policy Enforcement Spreadsheets SQL

Apply →

Member of Technical Staff (Model Behavior Architect)

Perplexity San Francisco Published 1 month ago

AI/ML Python

Apply →

Research Economist, Economic Research Remote Visa

Anthropic San Francisco, CA $300k–$405k/yr Published 5 months ago

Large Language Models Machine Learning SQL econometrics Python

Apply →

Research Lead, Training Insights Remote Visa

Anthropic Remote-Friendly (Travel Required) | San Francisco, CA; San Francisco, CA | New York City, NY $850k–$850k/yr Published 3 months ago

Large Language Models reinforcement learning inference Pretraining Evaluation Methodologies

Apply →

Research Engineer / Scientist, Alignment Science Remote Visa

Anthropic San Francisco, CA $350k–$500k/yr Published 1 year ago

LLMs Machine Learning NLP reinforcement learning Python

Apply →

Model Performance Software Engineer, Claude Code Remote Visa

Anthropic San Francisco, CA | New York City, NY $405k–$485k/yr Published 4 months ago

TypeScript Scientific infrastructure developer platforms ML systems reinforcement learning

Apply →

Technical Program Manager, Safeguards (Infrastructure & Evals) Remote Visa

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $290k–$365k/yr Published 4 months ago

Datadog cloud systems AI/ML Technical Program Management ML

Apply →

[Expression of Interest] Research Scientist / Engineer, Honesty Remote Visa

Anthropic New York City, NY; San Francisco, CA $350k–$500k/yr Published 1 year ago

Language Models AI/ML human feedback collection data curation RL environments

Apply →

Applied Research Intern Remote

Labelbox San Francisco Bay Area $35k–$45k/yr Published 10 months ago

Multimodal Models LLMs RLAIF JAX DPO

Apply →

Forward Deployed Engineer, RL Environments Remote

Labelbox San Francisco Bay Area $140k–$200k/yr Published 2 months ago

C++ AWS Gymnasium Firecracker Go

Apply →

Senior Software Engineer, AI Platform

Harvey AI San Francisco $220k–$300k/yr Published 3 months ago

Evaluation Frameworks AI/ML Agentic AI platform primitives model integration

Apply →

Staff Software Engineer, AI Platform

Harvey AI San Francisco $231k–$340k/yr Published 2 months ago

AI/ML Backend infrastructure

Apply →

Research Engineer, Domain Scaling Remote Visa

Join Anthropic as a Research Engineer to enhance AI capabilities in finance, healthcare, and legal domains through applied research and data sourcing.

Anthropic San Francisco, CA | New York City, NY | Seattle, WA $350k–$850k/yr Published 5 days ago

Large Language Models AI/ML reinforcement learning

Apply →

[Expression of Interest] Research Manager, Interpretability Remote Visa

Anthropic San Francisco, CA $350k–$500k/yr Published 7 months ago

LLMs Machine Learning AI/ML Interpretability Transformers

Apply →

Senior Model Risk Manager - AI/ML Remote

Define model governance for AI/ML at Mercury, enhancing frameworks and leading industry conversations on model risk management.

Mercury San Francisco, CA, New York, NY, Portland, OR, or Remote within Canada or United States $200.7k–$250.9k/yr Published 4 weeks ago

AI/ML scikit-learn XGBoost SQL Python

Flexible on stack

Apply →

Forward Deployed Engineer, Applied AI Remote Visa

Anthropic Boston, MA; New York City, NY | Seattle, WA; San Francisco, CA | New York City, NY; Washington, DC $200k–$300k/yr Published 7 months ago

TypeScript AI/ML Java Python

Apply →

Product Manager, Developer Productivity Remote Visa

Join Anthropic as a Senior Product Manager to enhance developer productivity through innovative AI-driven tooling.

Anthropic San Francisco, CA | New York City, NY $385k–$595k/yr Published 1 month ago

CI/CD AI/ML Build Systems developer tooling platform infrastructure

Apply →

Staff Engineer, Enterprise AI Remote

Faire San Francisco, CA $204k–$280.5k/yr Published 1 month ago

Datadog Snowflake AI/ML Java Ruby

Apply →