Note: The job is a remote job and is open to candidates in USA. JustHr is seeking an HR and People Operations expert to evaluate AI systems by designing realistic tasks based on HR workflows. The role also involves creating objective grading criteria and preparing supporting materials for evaluating AI-generated outputs.
Responsibilities
- Design realistic, multi-step tasks based on HR workflows, including payroll operations, workforce planning, HR policies and employee lifecycle processes
- Develop clear, objective grading criteria that allow consistent evaluation of task outcomes
- Create tasks that require professional judgment and careful interpretation of reference materials
- Prepare supporting materials such as policy documents, payroll reports, headcount data and employment agreements
- Identify tasks that are ambiguous or cannot be evaluated objectively
- Deliver approved tasks on schedule while maintaining the required quality standards
Skills
- 5+ years of hands-on experience in payroll, workforce planning, HR policy or employee lifecycle operations
- Experience creating or applying HR policies, payroll checklists, process documentation, compliance frameworks or training assessments
- Ability to work comfortably with spreadsheets, reports and policy documents simultaneously
- Strong written and spoken English proficiency (B2 minimum)
- C1 preferred
- HR certifications such as SHRM, CIPD, PHR or equivalent
- Previous experience with AI or Large Language Model (LLM) evaluation
Benefits
- Fully remote
Company Overview