Note: The job is a remote job and is open to candidates in USA. 24-MAG offers remote consulting opportunities connecting professionals with technical, evaluation, and project-based workstreams. The AI Content Evaluator will review professional documents, presentations, spreadsheets, and other work products to assess quality and compare AI-generated outputs. The role also requires providing evidence-based written feedback while consistently applying evaluation guidelines.
Responsibilities
- Review documents, presentations, spreadsheets, and other professional materials
- Assess outputs for accuracy, clarity, completeness, organisation, and overall quality
- Identify factual errors, inconsistencies, omissions, and weak reasoning
- Evaluate whether materials meet professional standards for real-world use
- Apply sound judgement across a broad range of everyday subject areas
- Compare and rank AI-generated outputs against defined evaluation criteria
- Determine which response or work product better satisfies the task requirements
- Identify meaningful differences in quality, reasoning, structure, and presentation
- Flag incomplete, misleading, or poorly supported outputs
- Apply evaluation guidelines consistently across varied tasks
- Review written documents for structure, readability, and accuracy
- Evaluate presentation slides for clarity, coherence, and effective communication
- Assess spreadsheets for logical consistency, organisation, and correctness
- Identify formatting issues that reduce usability or professional quality
- Work comfortably across common productivity tools and file formats
- Provide clear, concise, and well-reasoned written feedback
- Explain ratings and preference decisions using specific evidence
- Highlight the most important issues rather than relying on general impressions
- Follow structured rubrics and project guidelines
- Maintain consistent quality standards across diverse evaluation tasks
Skills
- Bachelor's degree or higher
- Based in the **United States or Canada**
- Excellent English reading comprehension and written communication
- Strong analytical judgement across varied professional subject matter
- Exceptional attention to detail
- Ability to identify errors, inconsistencies, formatting problems, and gaps in reasoning
- Comfortable working with documents, presentations, spreadsheets, and common productivity tools
- Able to move efficiently between different topics and content formats
- Comfortable working independently within structured evaluation guidelines
- Part-time independent contractor engagement
- Fully remote within the **United States or Canada**
- Flexible scheduling based on project requirements
- H1-B and STEM OPT support is unavailable for this engagement
- Prior AI, machine learning, or model-evaluation experience is not required
Benefits
- Fully remote within the United States or Canada
- Flexible scheduling based on project requirements
- Project guidelines and evaluation criteria will be provided
Company Overview