Note: The job is a remote job and is open to candidates in USA. Anthropic is a public benefit corporation focused on creating reliable and safe AI systems. They are seeking a Safeguards Enforcement Analyst to manage child safety enforcement workflows and collaborate with various teams to improve detection systems for child exploitation materials.
Responsibilities
- Own the day-to-day operational management of child safety content review workflows, including task routing, queue management, escalation handling, and SLA monitoring
- Serve as the primary point of contact for review partners conducting child safety content review, including onboarding, training, quality assurance, and ongoing relationship management
- Design and improve enforcement workflows to scale effectively as volume grows, while maintaining high accuracy and consistency across review decisions
- Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for CSAM, CSEM, and related child safety policy violations
- Review novel or ambiguous flagged content to drive enforcement decisions and surface policy gaps to the Safeguards policy design team
- Develop and maintain internal documentation, decision trees, and review guidelines that enable accurate and consistent enforcement at scale
- Keep up to date with emerging AI policy enforcement best practices, evolving legal frameworks, and developments in child safety technology, and use these to inform our workflows
- Identify and report trends in misuse patterns to internal stakeholders, including Policy, Legal, and Trust & Safety leadership
- Coordinate reporting obligations to relevant external bodies (e.g., NCMEC) in accordance with applicable law and Anthropic policy
Skills
- Experience in trust & safety, content moderation operations, or policy enforcement with direct exposure to child safety, CSAM/CSEM, or related child protection harm areas
- Experience managing or coordinating content review operations, including quality assurance and workflow management
- Experience standing up and scaling policy enforcement or content review workflows
- Proficiency in SQL and/or other data analysis tools to monitor workflow health, review queue metrics, and surface enforcement trends
- Experience identifying emerging risks and communicating findings to cross-functional stakeholders, such as Product, Policy, Engineering, and Legal teams
- Understanding of the challenges involved in implementing product policies at scale in the content moderation space
- Minimum education: Bachelor's degree or an equivalent combination of education, training, and/or experience
- Required field of study: A field relevant to the role as demonstrated through coursework, training, or professional experience
- Minimum years of experience: Years of experience required will correlate with the internal job level requirements for the position
- Deep subject matter expertise in child safety, child sexual exploitation and abuse (CSEA), or online child protection, including familiarity with CSAM/CSEM classification standards (e.g., COPINE, SAM scale)
- Experience working with or reporting to NCMEC, IWF, or equivalent child safety reporting bodies
- Familiarity with relevant legal and regulatory frameworks, including CSAM reporting obligations, KOSA, COPPA, or equivalent international frameworks
- Experience working with generative AI products, including an understanding of how AI systems can be misused to generate or facilitate CSEA
- Experience designing or evaluating trauma-informed support structures and wellness protocols for content reviewers working with harmful material
- Proficiency in Python for workflow automation or data analysis
- Experience working with hash-matching technologies (e.g., PhotoDNA, CSAI Match) or perceptual hashing tools used in CSAM detection
- Familiarity with age assurance technologies and their role in child safety enforcement
- Experience in a trust & safety role at a technology company, with an understanding of how platform policy intersects with child protection obligations
Benefits
- Provides access to wellness resources and support
- Optional equity donation matching
- Generous vacation and parental leave
- Flexible working hours
- A lovely office space in which to collaborate with colleagues
Company Overview
Company H1B Sponsorship