Join Anthropic as a Safeguards Enforcement Analyst to protect against AI misuse in biological contexts.
Posted by employer 4 months ago
First seen on Joblaze 4 months ago
Last verified on the company career page 8 hours ago
Joblaze summary
The Safeguards Enforcement Analyst at Anthropic focuses on identifying and mitigating bio-related risks associated with AI systems, ensuring compliance with usage policies through monitoring and investigation. This role requires expertise in biosecurity and experience in content moderation or policy enforcement, particularly in the context of generative AI. It is well-suited for candidates with a background in biological sciences and a strong understanding of dual-use technologies. The position involves collaboration with cross-functional teams to enhance enforcement workflows and safeguard against potential threats.
Quick facts
- Is the Safeguards Enforcement Analyst, Bio Harms role remote?
- It's hybrid — Anthropic expects some on-site time in San Francisco, CA | New York City, NY | Washington, DC.
- What's the salary range?
- Anthropic lists $245,000–$285,000 for this role.
- Where is the role based?
- Anthropic is hiring for this position in San Francisco, CA | New York City, NY | Washington, DC.
- What's the tech stack?
- Joblaze extracted these technologies from the posting: AI/ML, Content Moderation, Data Analysis, Policy Enforcement, SQL, Trust & Safety.
- Does Anthropic sponsor work visas for this role?
- Yes — the posting indicates visa sponsorship is available for the right candidate.
- What seniority level is this role?
- Anthropic targets mid-level candidates for this position.
- Is this full-time or contract?
- Full-time for this Safeguards Enforcement Analyst, Bio Harms role at Anthropic.
From the original posting
About Anthropic
About the role
As an Enforcement Analyst focused on Bio Harms, you will play a critical role in protecting against the misuse of AI systems for biological and related CBRNE harms. You will enforce our Usage Policy with a specific focus on detecting and mitigating bio risks, investigating potential violations, and help continuously strengthen our safeguards. The work sits at the intersection of biosecurity threat analysis and platform enforcement: you will read real model interactions and make fast, well-reasoned calls about whether activity is benign research or a credible attempt at harm.
This role is a fit for someone who understands the dual-use nature of biology and enabling technologies well enough to separate the benign from the malicious. You will own and continuously improve the enforcement monitoring workflows for the bio-harms area, and you will work closely with Policy, Threat Intelligence, Data Science, and Engineering cross-functional partners to accomplish tasks at scale. Safety is core to our mission, and your work will directly protect individuals, communities, and critical systems.
Important context for the role: In this position you may be exposed to and engage with explicit content spanning a range of topics, including material of a sexual, violent, or psychologically disturbing nature. The role also carries a shared on-call responsibility across the Policy and Enforcement teams.
Key responsibilities
- Enforce Usage Policies with a specific focus on detecting and mitigating potential bio risks and harmful use of AI systems.
- Take ownership of enforcement monitoring workflows for the bio-harms area, improving end-to-end detection, investigation, triage, and escalation processes.
- Monitor and analyze platform activity to identify emerging patterns related to biological (and adjacent chemical, radiological, nuclear, and explosive) threats that may require policy updates or enforcement action.
- Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy across a technically complex content surface.
- Conduct thorough investigations of potential violations, gathering and documenting evidence to support enforcement decisions.
- Proactively surface trends and propose improvements to detection methods and review workflows.
- Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for bio-related policy violations.
- Partner with Policy and Threat Intelligence groups to understand potential exploits and contribute to risk-assessment frameworks, and partner with engineers iterating on safety systems.
- Provide enforcement-grounded feedback on policy gaps, and handle escalations and time-sensitive situations related to potential bio-related Usage Policy violations.
Minimum qualifications
- Hold a degree in a bio-related field (e.g., microbiology, molecular biology, biochemistry, public health) and/or relevant professional experience in a related field.
- Possess experience in Trust & Safety, content moderation, or policy enforcement at platform scale, including working with generative AI tools to refine and optimize content review and enforcement workflows.
- Possess experience in utilizing AI tools to develop data dashboards for metrics collection in support of continuous improvement efforts.
- Can analyze complex, ambiguous situations and make well-reasoned, defensible decisions under time pressure.
- Are proactive and self-directed: you spot trends, dig in, and ship improvements on your own initiative.
- Communicate clearly in writing and can translate technical bio concepts for diverse audiences, including both technical and non-technical stakeholders.
Preferred qualifications
- Subject matter expertise in biodefense, biosecurity, WMD/CBRNE non-proliferation, or threat-intelligence.
- An understanding of where real-world biological risk actually lies — adversary intent, acquisition and weaponization pathways, and dual-use concerns, including familiarity with cross-platform threat analysis and open-source intelligence (OSINT) techniques relevant to weapons of mass destruction.
- Proficiency in SQL and/or other data analysis tools to draw insights from large datasets and monitor enforcement workflow health.
- Familiarity with dual-use research of concern (DURC), select agents, and relevant policy frameworks.
The annual compensation range for this role is listed below.
Annual Salary:
$245,000—$285,000 USD
Logistics
Standard company text repeated across Anthropic's postings is omitted here.