"evaluation frameworks" Jobs - Joblaze

Showing 20 of 242 results

Senior Product Operations Manager, Evaluation

Join Harvey as a Senior Product Operations Manager to build and scale the evaluation engine for a global AI platform.

Harvey AI San Francisco Published 2 days ago

AI/ML SQL Python

AI-first team

Apply →

Software Engineer, Safeguards Evals Remote Visa

Build evaluation infrastructure for AI safety systems at Anthropic, focusing on real-world misuse detection.

Anthropic San Francisco, CA | New York City, NY $320k–$485k/yr Published 6 days ago

LLMs Data Pipelines Agentic systems distributed systems synthetic data generation

Flexible on stack

Apply →

Member of Technical Staff (Model Behavior Architect)

Perplexity San Francisco Published 1 month ago

AI/ML Python

Apply →

Safeguards Enforcement Analyst, Safety Evaluations Remote Visa

Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | Washington, DC; San Francisco, CA | New York City, NY $230k–$270k/yr Published 3 months ago

Trust and Safety Dashboards Policy Enforcement Spreadsheets SQL

Apply →

Research Engineer, Environment Scaling Remote Visa

Anthropic Remote-Friendly (Travel Required) | San Francisco, CA $350k–$850k/yr Published 4 months ago

Project Management AI/ML reinforcement learning Data Operations

Apply →

Research Economist, Economic Research Remote Visa

Anthropic San Francisco, CA $300k–$405k/yr Published 4 months ago

Large Language Models Machine Learning SQL econometrics Python

Apply →

Research Engineer / Scientist, Alignment Science Remote Visa

Anthropic San Francisco, CA $350k–$500k/yr Published 1 year ago

LLMs Machine Learning NLP reinforcement learning Python

Apply →

Research Lead, Training Insights Remote Visa

Anthropic Remote-Friendly (Travel Required) | San Francisco, CA; San Francisco, CA | New York City, NY $850k–$850k/yr Published 3 months ago

Large Language Models reinforcement learning inference Pretraining Evaluation Methodologies

Apply →

Model Performance Software Engineer, Claude Code Remote Visa

Anthropic San Francisco, CA | New York City, NY $405k–$485k/yr Published 4 months ago

TypeScript Scientific infrastructure developer platforms ML systems reinforcement learning

Apply →

Applied Research Intern Remote

Labelbox San Francisco Bay Area $35k–$45k/yr Published 10 months ago

Multimodal Models LLMs RLAIF JAX DPO

Apply →

[Expression of Interest] Research Scientist / Engineer, Honesty Remote Visa

Anthropic New York City, NY; San Francisco, CA $350k–$500k/yr Published 1 year ago

Language Models AI/ML human feedback collection data curation RL environments

Apply →

[Expression of Interest] Research Manager, Interpretability Remote Visa

Anthropic San Francisco, CA $350k–$500k/yr Published 7 months ago

LLMs Machine Learning AI/ML Interpretability Transformers

Apply →

Applied AI Engineer, Beneficial Deployments Remote Visa

Anthropic San Francisco, CA | New York City, NY $280k–$300k/yr Published 4 months ago

scientific research Evaluation Frameworks AI/ML ed-tech context engineering

Apply →

Software Engineer, AI Platforms Remote

Figma San Francisco, CA • New York, NY • United States $153k–$376k/yr Published 7 months ago

TypeScript AI/ML search infrastructure Ruby developer platforms

Apply →

Technical Program Manager, Marketing Technology Remote Visa

Anthropic San Francisco, CA | New York City, NY $290k–$365k/yr Published 4 months ago

CCPA Marketing Operations data warehouses Data Infrastructure brand measurement

Apply →

Senior Model Risk Manager - AI/ML Remote

Define model governance for AI/ML at Mercury, enhancing frameworks and leading industry conversations on model risk management.

Mercury San Francisco, CA, New York, NY, Portland, OR, or Remote within Canada or United States $200.7k–$250.9k/yr Published 2 weeks ago

AI/ML scikit-learn XGBoost SQL Python

Flexible on stack

Apply →

Research Engineer, AI Observability Remote Visa

Anthropic San Francisco, CA $320k–$405k/yr Published 3 months ago

AI deployment AI training unstructured text ML systems LLM

Apply →

Senior Software Engineer, Agents

Harvey AI San Francisco $165k–$312k/yr Published 4 months ago

agent frameworks Python LLM APIs

Apply →

Forward Deployed Engineer, RL Environments Remote

Labelbox San Francisco Bay Area $140k–$200k/yr Published 2 months ago

C++ AWS Gymnasium Firecracker Go

Apply →

Staff Software Engineer, Agents

Harvey AI San Francisco $231k–$340k/yr Published 1 month ago

agent frameworks Python LLM APIs

Apply →