We are sharing a specialised part-time consulting opportunity for experienced professionals across Software Engineering, Finance, Data Science, Legal, and related expert domains to contribute to an advanced AI training and evaluation project focused on reasoning quality, prompt design, data annotation, written feedback, and model-output assessment.
Selected professionals will review AI-generated outputs, design challenging domain-specific prompts, annotate data, conduct quality reviews, and provide structured feedback to improve model accuracy, reasoning, and reliability. No prior experience in AI is required.
Key Responsibilities
AI Evaluation & Domain Analysis
Review AI-generated responses for accuracy, logic, relevance, and professional quality
Identify factual errors, weak reasoning, unsupported conclusions, or missing context
Apply domain expertise to complex or ambiguous scenarios
Distinguish substantive errors from acceptable alternative interpretations
Provide structured feedback supporting model improvement
Prompt Design & Data Annotation
Design realistic domain-specific prompts that test reasoning and subject-matter understanding
Refine prompts for clarity, difficulty, and evaluation value
Annotate and classify data according to project guidelines
Identify edge cases requiring deeper interpretation
Support development of reliable training and evaluation datasets
Quality Review & Professional Writing
Review AI outputs, annotations, and evaluation materials for consistency and quality
Support calibration across contributors and project standards
Produce clear, concise, and constructive written feedback
Edit responses for precision, structure, and readability
Collaborate asynchronously with project teams and other subject-matter experts
Ideal Profile
3+ years of professional experience in Software Engineering, Finance, Data Science, Legal, or another relevant expert domain
Strong subject-matter expertise within the applicant's professional field
Demonstrated critical-thinking and analytical skills
Exceptional written English and professional-writing ability
Experience producing high-quality materials such as technical documentation, investment memos, legal memoranda, research papers, or strategy presentations
Experience reviewing or critiquing complex professional work
Strong attention to detail and ability to articulate nuanced feedback clearly
Comfortable working independently in a remote environment
Experience with data annotation, prompt engineering, or AI-output evaluation is advantageous
Background in technology, consulting, finance, law, research, or rigorous academic environments is valuable but not required
No prior AI-training experience is required
Engagement Details
Part-time independent contractor engagement
Fully remote
Compensation: $140–$200/hour
Work will involve AI-output evaluation, prompt design, data annotation, quality assurance, professional writing, domain analysis, and structured feedback
Assignments may vary depending on the contributor's professional domain
Collaboration will occur remotely with project leads and other subject-matter experts
Prior experience with prompt engineering, annotation, or AI evaluation is helpful but not required
Project scope, workload, domain focus, and evaluation standards may evolve depending on project requirements
Work must be completed without using confidential or proprietary information belonging to any employer, client, institution, or other third party
About the Platform
This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.
By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy