Own the red-teaming and adversarial evaluation pipeline for Reflection’s models to ensure safety and reliability.
Posted by employer 10 months ago
First seen on Joblaze 2 months ago
Last verified on the company career page 1 day ago
Skills & Technologies
Requirements
Not disclosed in this posting: compensation, years of experience, work arrangement.
Benefits
Joblaze summary
In this role, the individual is responsible for overseeing the red-teaming and adversarial evaluation processes for Reflection AI's models, ensuring they are rigorously tested for security and alignment issues. Key skills include a strong foundation in AI safety, particularly in adversarial attacks and automated evaluation systems, alongside solid software engineering capabilities. This position is ideal for someone with an advanced degree in a relevant field and a passion for navigating the complexities of AI safety in a dynamic startup environment. Reflection AI emphasizes a collaborative culture, where team members contribute to shaping the future of open intelligence.
Joblaze insights
Quick facts
From the original posting
Own the red-teaming and adversarial evaluation pipeline for Reflection’s models, continuously probing for failure modes across security, misuse, and alignment gaps.
Work hand-in-hand with the Alignment team to translate safety findings into concrete guardrails, ensuring models behave reliably under stress and adhere to deployment policies.
Validate that every release meets the lab’s risk thresholds before it ships, serving as a critical gatekeeper for our open weight releases.
Develop scalable, automated safety benchmarks that evolve alongside our model capabilities, moving beyond static datasets to dynamic adversarial testing.
Research and implement state-of-the-art jailbreaking techniques and defenses to stay ahead of potential vulnerabilities in the wild.
Graduate degree (MS or PhD) in Computer Science, Machine Learning, or related discipline, or equivalent practical experience in AI Safety.
Deep technical understanding of LLM safety, including adversarial attacks, red-teaming methodologies, and interpretability.
Strong software engineering capabilities with experience building automated evaluation pipelines or large-scale ML systems.
Experience with Reinforcement Learning (RLHF/RLAIF) and how it impacts model safety and alignment is a strong plus.
Thrive in a fast-paced, high-agency startup environment with bias toward action.
Willing to make high-stakes decisions regarding model release and safety thresholds.
Passionate about advancing the frontier of intelligence.
Top-tier compensation: Salary and equity structured to recognize and retain our talent globally.
Standard company text repeated across Reflection AI's postings is omitted here.