Posted by employer 1 year ago
First seen on Joblaze 6 months ago
Last verified on the company career page 23 hours ago
Joblaze summary
In this role, the software engineer on the Safeguards team at Anthropic will focus on developing systems to monitor AI models, detect misuse, and ensure user safety. Key skills include proficiency in Python and Typescript, along with experience in integrity and abuse detection. This position is ideal for seasoned engineers with 5-10 years of relevant experience, particularly those familiar with trust and safety mechanisms in AI. Anthropic emphasizes collaboration and communication, making it a fitting environment for those who thrive in team-oriented settings.
Quick facts
- Is the Staff+ Software Engineer, Safeguards role remote?
- It's hybrid — Anthropic expects some on-site time in San Francisco, CA | New York City, NY.
- What's the salary range?
- Anthropic lists $320,000–$425,000 for this role.
- How much experience is required?
- 5–10 years of relevant experience for this Staff+ Software Engineer, Safeguards role.
- Where is the role based?
- Anthropic is hiring for this position in San Francisco, CA | New York City, NY.
- What's the tech stack?
- Joblaze extracted these technologies from the posting: AI/ML, Fraud Detection, Python, Safety, TypeScript, abuse detection.
- Does Anthropic sponsor work visas for this role?
- Yes — the posting indicates visa sponsorship is available for the right candidate.
- What seniority level is this role?
- Anthropic targets senior candidates for this position.
- Is this full-time or contract?
- Full-time for this Staff+ Software Engineer, Safeguards role at Anthropic.
From the original posting
About Anthropic
About the role
We are looking for software engineers to help build safety and oversight mechanisms for our AI systems. As a software engineer on the Safeguards team, you will work to monitor models, prevent misuse, and ensure user well-being. This role will focus on building systems to detect unwanted model behaviors and prevent disallowed use of models. You will apply your technical skills to uphold our principles of safety, transparency, and oversight while enforcing our terms of service and acceptable use policies.
We have multiple teams that are currently hiring within Safeguards. Team placement occurs after the interview process, taking into account your interests and experience alongside organizational needs. This flexible approach allows us to match talented engineers where they'll have the greatest impact and growth potential.
Responsibilities:
- Develop monitoring systems to detect unwanted behaviors from our API partners and potentially take automated enforcement actions; surface these in internal dashboards to analysts for manual review
- Build abuse detection mechanisms and infrastructure
- Surface abuse patterns to our research teams to harden models at the training stage
- Build robust and reliable multi-layered defenses for real-time improvement of safety mechanisms that work at scale
You may be a good fit if you:
- Bachelor’s degree in Computer Science, Software Engineering or comparable professional experience
- Proficiency in at least one programming language such as Python, Java, etc.
- Ability to work across the stack
- Strong communication skills and ability to explain complex technical concepts to non-technical stakeholders
Strong candidates may also:
- 8+ years of experience in a software engineering position
- Have experience with integrity, spam, fraud, or abuse detection and mitigation
- Have experience building trust and safety detection mechanisms and intervention for AI/ML systems
- Have experience with prompt engineering, jailbreak attacks, and other adversarial inputs
- Have worked closely with operational teams to build custom internal tooling
Deadline to apply: None. Applications will be reviewed on a rolling basis.
The annual compensation range for this role is listed below.
Annual Salary:
$320,000—$485,000 USD
Logistics
Standard company text repeated across Anthropic's postings is omitted here.