About the position
This remote contract role applies cyber threat intelligence expertise to help train next-generation AI systems. The work focuses on improving how models assess cyber threats through high-quality, real-world input. Prior AI experience is not required; domain expertise is the primary qualification.
The role includes mapping cyber threat intelligence cases to established taxonomies, especially in surveillance and privacy evaluation; authoring boundary cases involving prohibited surveillance, attribution, and intrusion-adjacent requests; and evaluating threat responses for source reliability, analytic reasoning, stated limitations, and actionable utility. The SME also identifies over-refusals, documents challenging edge cases involving nation-state operations and advanced threats, and provides concise written and verbal feedback to improve AI threat assessment capabilities.
Responsibilities
• Map cyber threat intelligence cases to established taxonomies, especially in surveillance and privacy evaluation domains.
• Author boundary cases illustrating prohibited surveillance, attribution, and intrusion-adjacent requests to clarify permissible and impermissible actions.
• Evaluate and grade submitted threat responses, focusing on source reliability, analytic reasoning, stated limitations, and actionable utility.
• Identify and flag over-refusals so legitimate threat analysis is not unnecessarily declined.
• Document and clarify challenging edge cases involving nation-state operations and other advanced threats.
• Provide concise written and verbal feedback to support continuous improvement of AI threat assessment capabilities.
Requirements
• Expertise in cyber threat intelligence.
• Nation-state threat judgment.
• Ability to distinguish legitimate defensive or analytic activities from impermissible offensive or surveillance-focused requests.
• Expertise relevant to offensive and defensive boundaries.
• Ability to detect over-refusal.
• Proficiency in authoring clear, structured written content in English and communicating complex concepts verbally.
Nice-to-haves
• Substantial cyber threat intelligence experience, particularly involving nation-state operations and advanced cyber threats.
• Background in threat-actor attribution, APT tracking, or exposure to adversary tactics and techniques.
• Experience mentoring, teaching, or leading professionals in threat intelligence disciplines.
• Prior participation in AI system evaluation, red-teaming, or related quality assurance projects.