Evaluation Frameworks Jobs (Remote)

Member of Engineering (Evaluations / Engineering) Remote

Poolside AI Remote (EMEA/East Coast) Published 1 month ago

Datadog AWS Grafana Prometheus Google Pub/Sub

Apply →

Software Engineer, Safeguards Evals Remote Visa

Build evaluation infrastructure for AI safety systems at Anthropic, focusing on real-world misuse detection.

Anthropic San Francisco, CA | New York City, NY $320k–$485k/yr Published 5 days ago

LLMs Data Pipelines Agentic systems distributed systems synthetic data generation

Flexible on stack

Apply →

Safeguards Enforcement Analyst, Safety Evaluations Remote Visa

Anthropic Remote-Friendly (Travel-Required) | San Francisco, CA | Washington, DC; San Francisco, CA | New York City, NY $230k–$270k/yr Published 3 months ago

Trust and Safety Dashboards Policy Enforcement Spreadsheets SQL

Apply →

Staff Research Engineer, Post-training & Evaluation Remote

Reddit Remote - United States $216.7k–$303.4k/yr Published 4 months ago

vLLM lm-eval-harness PyTorch Python MLflow

Apply →

Research Engineer, Environment Scaling Remote Visa

Anthropic Remote-Friendly (Travel Required) | San Francisco, CA $350k–$850k/yr Published 4 months ago

Project Management AI/ML reinforcement learning Data Operations

Apply →

Research Economist, Economic Research Remote Visa

Anthropic San Francisco, CA $300k–$405k/yr Published 4 months ago

Large Language Models Machine Learning SQL econometrics Python

Apply →

Research Engineer / Scientist, Alignment Science Remote Visa

Anthropic San Francisco, CA $350k–$500k/yr Published 1 year ago

LLMs Machine Learning NLP reinforcement learning Python

Apply →

Manager, GRC Subject Matter Experts, Product Remote

Lead the GRC Subject Matter Experts team at Vanta, driving compliance content and framework integration for a growing security platform.

Vanta Remote U.S. Published 3 weeks ago

CCPA SOC 2 ISO 27001 NIST FedRAMP

Apply →

Research Lead, Training Insights Remote Visa

Anthropic Remote-Friendly (Travel Required) | San Francisco, CA; San Francisco, CA | New York City, NY $850k–$850k/yr Published 3 months ago

Large Language Models reinforcement learning inference Pretraining Evaluation Methodologies

Apply →

Model Performance Software Engineer, Claude Code Remote Visa

Anthropic San Francisco, CA | New York City, NY $405k–$485k/yr Published 4 months ago

TypeScript Scientific infrastructure developer platforms ML systems reinforcement learning

Apply →

Applied Research Intern Remote

Labelbox San Francisco Bay Area $35k–$45k/yr Published 10 months ago

Multimodal Models LLMs RLAIF JAX DPO

Apply →

[Expression of Interest] Research Scientist / Engineer, Honesty Remote Visa

Anthropic New York City, NY; San Francisco, CA $350k–$500k/yr Published 1 year ago

Language Models AI/ML human feedback collection data curation RL environments

Apply →

Product GRC SME Remote

Vanta Remote U.S. Published 6 months ago

CCPA SOC 2 ISO 27001 ISO 27701 SaaS

Apply →

[Expression of Interest] Research Manager, Interpretability Remote Visa

Anthropic San Francisco, CA $350k–$500k/yr Published 7 months ago

LLMs Machine Learning AI/ML Interpretability Transformers

Apply →

Value Engineer, Solutions Engineering Remote

Join Cockroach Labs as a Value Engineer to drive financial narratives and ROI models for enterprise customers adopting CockroachDB.

Cockroach Labs London, UK; New York, NY $145k–$190k/yr Published 1 week ago

cloud infrastructure CockroachDB TCO financial modeling ROI

Apply →

Applied AI Engineer, Beneficial Deployments Remote Visa

Anthropic San Francisco, CA | New York City, NY $280k–$300k/yr Published 4 months ago

scientific research Evaluation Frameworks AI/ML ed-tech context engineering

Apply →

Member of Engineering (Reinforcement Learning) Remote

Poolside AI Remote (EMEA/East Coast) Published 1 month ago

JAX Large Language Models reinforcement learning PyTorch Python

Apply →

Lead Product Manager, Enterprise AI & Automation Remote

Lead the Enterprise AI and Automation strategy at Marqeta, driving value across internal operations and employee experience.

Marqeta Remote, USA $136.1k–$170.1k/yr Published 4 days ago

Vendor Management AI/ML Automation Governance Business Technology

Apply →

Software Engineer, AI Platforms Remote

Figma San Francisco, CA • New York, NY • United States $153k–$376k/yr Published 7 months ago

TypeScript AI/ML search infrastructure Ruby developer platforms

Apply →

AI Research Engineer - Datadog AI Research (DAIR) Remote

Datadog Paris, France Published 9 months ago

C++ Ray JAX CUDA DeepSpeed

Apply →