Biology Reasoning Evaluator

About OpenTrain OpenTrain is the #1 platform for finding and building careers in AI training and data labeling. OpenTrain AI hires and contracts contributors for projects that help improve modern AI systems, with flexible opportunities available worldwide. Create a free OpenTrain account to build your profile and apply in minutes for this contract opportunity. • Worldwide opportunity • Part-time contractor engagement • Pay: $80 USD per hour About AI Training Work AI training is the human side of building artificial intelligence. Expert contributors review model outputs, identify errors, write stronger examples, and provide structured feedback so AI systems can produce more accurate and useful answers. In this project, your biological expertise will help evaluate whether AI-generated explanations are scientifically correct, methodologically sound, well reasoned, and clearly communicated. • Work directly on the quality of emerging AI systems • Use your subject-matter expertise to assess model reasoning • Remote, flexible work in a fast-growing technology field The Biology Reasoning Evaluator Role OpenTrain AI is seeking Biology Reasoning Evaluators with a PhD in Biology or a closely related life science. You will review AI-generated biology responses and assess biological correctness, reasoning depth, clarity, and scientific rigor. The work covers biological reasoning, methods, and evaluation. You will also examine study design, methodology, statistics, calculations, interpretation, and factual claims across complex biology content. • Contractor, part-time role • Less than 20 hours per week listed; minimum availability is 17–20 hours per week • Preferred cadence is approximately 8 hours per day during active sprints • English-language work What You'll Do You will apply detailed evaluation rubrics consistently while making precise judgments about AI-generated biological content. The work requires careful scientific reasoning, fact-checking, and clear written explanations. • Review AI-generated biology responses • Assess biological correctness, reasoning depth, and clarity • Identify conceptual and methodological flaws • Evaluate study design, statistics, calculations, and interpretation • Fact-check scientific claims using reputable public sources • Draft exemplar explanations and model solutions • Rate and compare multiple responses using detailed rubrics • Apply evaluation criteria consistently with attention to reproducibility • Use precise terminology and provide step-by-step scientific reasoning when required Requirements This role requires advanced academic and research expertise in biology or a closely related life science. A PhD is required, and a degree from a Top-100 university is preferred. You must be able to review complex scientific material critically and communicate your reasoning in clear, rigorous English at a C1 or higher level. • PhD in Biology or a closely related life science • Top-100 university preferred • Peer-reviewed publication record as a first or co-author • Experience creating or critically reviewing manuscripts, advanced curricula, protocols, grant sections, or computational analyses • Breadth across areas such as molecular and cell biology, genetics and genomics, biochemistry, and physiology • Strong experimental design and statistics literacy • Exceptional scientific writing and correct use of terminology • Strong fact-checking skills with reputable public sources • Meticulous attention to detail and reproducibility • C1+ English writing proficiency Preferred Experience and Qualification Process Prior experience with data labeling, reinforcement learning from human feedback, or AI model evaluation is helpful but not required. Onboarding includes paid qualification and project exams before active project work. • Prior data-labeling experience is a bonus • Prior RLHF experience is a bonus • Prior AI model-evaluation experience is a bonus • Paid 1–2 hour qualification exam • Paid 1–2 hour project exam Who Should Apply Apply if you are a published biology researcher who enjoys dissecting complex arguments, finding subtle scientific errors, and explaining the correct reasoning clearly. This opportunity is especially suited to contributors with broad biology knowledge and strong judgment across experimental methods, quantitative analysis, and interpretation. • Biology PhD holders with research and publication experience • Scientists experienced in reviewing complex biological content • Researchers who can distinguish valid reasoning from plausible-sounding errors • Experts who value precise, consistent, evidence-based evaluation How to Apply Create a free profile on OpenTrain and submit your application for consideration. If selected, you will complete the paid qualification and project exams as part of onboarding, then contribute as an OpenTrain AI contractor on active project sprints. • Create a free OpenTrain account • Submit your application and professional background • Complete the paid qualification exam • Complete the paid project exam • Begin project work when approved and assigned