Note: The job is a remote job and is open to candidates in USA. The client is a globally recognized platform that helps learners and companies build job-ready data and AI skills. The Head of Assessment & Certification Content will own the end-to-end lifecycle of assessment and certification content, establish scoring and quality standards, and build AI-powered workflows to scale content creation, grading, and quality assurance. The role will also align certifications with employer expectations and collaborate with subject-matter experts to keep credentials current.
Responsibilities
- You'll own the full lifecycle of assessment and certification content - from designing the blueprint and writing items, through review, publication, and ongoing upkeep
- You'll set scoring standards and passing thresholds, and safeguard the validity, reliability, and fairness of every exam
- You'll build the AI-powered workflows - prompting, pipelines, evaluation - that draft, grade, and quality-check assessment items so content can scale without sacrificing rigor
- You'll work closely with subject-matter experts to keep certifications current with a fast-moving field, and you'll make sure every credential maps to what hiring managers are actually screening for - so it means something to an employer, not just to the learner
Skills
- A technical background in a STEM field (Computer Science, Data Science, AI, Statistics, Engineering, or similar) - enough to judge whether a technical assessment item is accurate and genuinely tests skill
- Real experience evaluating technical competency - e.g., you've designed coding assessments, run technical interviews, built certification exams, or graded technical coursework
- Demonstrated expertise in assessment design - item writing, scoring, standard-setting, and the validity/reliability/fairness principles behind a credible certification program
- Strong, hands-on experience with agentic AI tools - Claude Code, Cursor, Replit, or similar - and a track record of building AI automation systems
- You should be able to point to a concrete example of roughly 10x'ing your own output using AI
- A clear understanding of what skills hiring managers actually screen for in data/AI roles, and how to translate that into what a certification should measure
- A graduate degree (Master's or PhD) in a related STEM field, or equivalent industry experience with hands-on expertise in data science, machine learning, or software development
- Candidates must be based in and have the right to work in Belgium, the United Kingdom, Portugal, or the United States
- Familiarity with the broader data/AI certification landscape - what makes a credential respected by employers, and where existing programs fall short
- An extensive track record of building sophisticated AI systems and workflows
Benefits
- Fully remote work arrangement
- Full-time employment, direct with the client
Company Overview