We are sharing a specialised part-time consulting opportunity for analytical professionals with strong critical-reading, reasoning, and written-evaluation skills. This role focuses on reviewing AI-generated responses, identifying weaknesses in reasoning and communication, and producing clear, evidence-based assessments against structured evaluation guidelines. Selected contributors will apply careful independent judgement to nuanced written material across a range of topics.
Key Responsibilities
- Response Evaluation
- Review AI-generated responses for quality, accuracy, relevance, and reasoning
- Assess whether responses address the underlying task completely and appropriately
- Identify logical gaps, unsupported conclusions, inconsistencies, and missed nuances
- Evaluate both explicit content and important implications or assumptions
- Apply careful professional judgement rather than relying on surface-level characteristics
- Critical Reading & Reasoning
- Analyse complex written material closely and systematically
- Identify subtle differences in reasoning, interpretation, and argument quality
- Detect implicit meaning, missing considerations, and weak assumptions
- Distinguish substantive errors from minor stylistic issues
- Evaluate whether conclusions are adequately supported by the available information
- Written Evaluation & Rationale
- Produce clear, precise, and well-supported written rationales
- Explain evaluation decisions using specific evidence from the reviewed material
- Provide substantive feedback that goes beyond general or surface-level observations
- Communicate weaknesses and strengths objectively and concisely
- Ensure written assessments remain internally consistent and easy to follow
- Structured Quality Review
- Apply detailed evaluation guidelines accurately and consistently
- Maintain strict attention to task requirements and scoring criteria
- Make independent judgements when responses are ambiguous or closely matched
- Provide critical assessments when quality standards are not met
- Maintain consistency across repeated evaluation tasks
- Independent Task Execution
- Follow detailed project instructions without continuous supervision
- Complete assigned evaluations independently and accurately
- Maintain high standards of concentration and attention to detail
- Adapt to different task formats and evaluation frameworks
- Complete all work without the use of AI writing or assistance tools
Ideal Profile
- Strong analytical and critical-reading skills
- Ability to identify nuance, implicit meaning, reasoning gaps, and unsupported claims
- Excellent written communication and ability to produce precise, evidence-grounded rationales
- Strong attention to detail and ability to apply structured evaluation criteria consistently
- Sound independent judgement and willingness to provide critical assessments where warranted
- Ability to work independently and follow detailed task instructions
- Native English fluency required
- Bachelor's degree from a top-500 globally ranked university is preferred
- Comfortable completing all evaluation and written-feedback work without AI writing tools
Engagement Details
- Part-time independent contractor engagement
- Fully remote
- Flexible scheduling based on project requirements
- Compensation: Up to $60/hour
- Work includes evaluation of AI-generated responses and preparation of structured written feedback
- Use of AI writing tools or other AI assistance is prohibited when completing project work
- Projects may be extended, shortened, or concluded based on project needs and performance
- Work must be completed without using confidential or proprietary information belonging to any employer, client, institution, or other third party
- H1-B and STEM OPT support is unavailable for this engagement
About the Platform
- This opportunity is available through 24-MAG LLC
- We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams
- By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy