Note: The job is a remote job and is open to candidates in USA. 24-MAG is offering a specialized consulting opportunity through a remote technical and evaluation project. The Subject Matter Expert will analyze charts and data visualizations, develop quantitative reasoning tasks, verify calculations, and support AI training and evaluation through expert-reviewed analytical content.
Responsibilities
- Interpret complex charts, graphs, and data visualisations accurately
- Analyse multiple data series, annotations, scales, and statistical elements
- Extract relevant quantitative information from information-rich visualisations
- Identify trends, differences, relationships, and notable patterns
- Apply correct domain terminology throughout analysis
- Develop and solve problems requiring multiple analytical steps
- Perform calculations based on chart-derived information
- Compare values, rates, changes, proportions, and trends
- Check intermediate calculations for consistency and accuracy
- Produce clearly supported numerical conclusions
- Create clear and unambiguous questions based on charts and visual data
- Ensure questions are objectively answerable from the information provided
- Design tasks that require substantive reasoning rather than simple lookup
- Avoid unnecessary ambiguity or subjective interpretation
- Align question difficulty with the complexity of the underlying visualisation
- Develop structured tasks involving calculations, comparisons, and trend analysis
- Create realistic quantitative reasoning scenarios
- Ensure sufficient information is available to reach a definitive answer
- Define clear expected outputs
- Maintain consistency between source visualisations, questions, and solutions
- Use correct terminology for axes, legends, scales, units, and data series
- Accurately interpret confidence intervals and statistical annotations where relevant
- Preserve correct time periods and measurement units
- Avoid unsupported extrapolation or conclusions
- Maintain high standards of technical and quantitative accuracy
- Provide precise final answers
- Document calculation steps clearly
- Explain analytical reasoning in a logical sequence
- Distinguish observed data from derived conclusions
- Ensure solutions can be independently verified
- Apply subject-matter expertise to specialised charts
- Interpret visualisations using appropriate professional terminology
- Identify context-specific relationships and metrics
- Ensure analyses remain consistent with accepted domain conventions
- Translate technical findings into clear written explanations
- Develop high-quality analytical examples for AI training
- Evaluate whether generated answers are numerically and conceptually correct
- Identify reasoning, interpretation, or terminology errors
- Provide structured feedback supporting model improvement
- Contribute expert-reviewed quantitative tasks to evaluation workflows
- Review tasks for ambiguity and unnecessary complexity
- Confirm calculations and expected answers
- Check that questions can be answered using the supplied information
- Verify consistency of terminology, units, and data interpretation
- Maintain strong quality standards across analytical deliverables
- Collaborate asynchronously with project coordinators and reviewers
- Respond clearly to feedback and revision requests
- Communicate technical reasoning effectively in written and verbal formats
- Support consistent evaluation standards across contributors
- Work independently while meeting project quality requirements
Skills
- Bachelor's degree or equivalent professional experience in a relevant quantitative or technical domain
- At least 2 years of professional, academic, or research experience working with charts or quantitative data
- Strong chart-interpretation skills
- Demonstrated ability to perform multi-step quantitative reasoning
- Ability to interpret charts with multiple series, annotations, scales, or statistical features
- Strong understanding of units, axes, legends, confidence intervals, and time-series interpretation
- Ability to design unambiguous and objectively answerable questions
- Strong written analytical communication skills
- Ability to explain calculations clearly in English
- Experience in Medicine & Biostatistics, Finance & Economics, Engineering & Physics, Earth Sciences & GIS, Data Science & Statistics, Operations & Manufacturing, or a comparable domain is highly relevant
- Strong attention to detail and analytical rigour
- No prior AI-training or model-evaluation experience is required
- Experience authoring technical assessments, benchmark questions, analytical exercises, or structured evaluation tasks is advantageous
- Advanced degree, professional credential, or significant industry specialisation is highly desirable
- Experience collaborating with distributed technical or research teams is beneficial
Benefits
- Fully remote
Company Overview