Job Description:
• Review and assess AI-generated responses from a health coaching agent for safety, regulatory compliance, and clinical content accuracy
• Work asynchronously on a dedicated review platform
• Perform short, structured evaluations to help train and refine AI models for patient-facing health guidance
• Score AI agent responses against a pre-defined rubric across a large volume of items
• Identify responses that could cause patient harm, including missed red flags, unsafe advice, and failure to escalate or signpost to care
• Assess factual correctness, completeness, and guideline alignment of clinical content
• Provide brief, specific rationale for failed responses and general improvement guidance
Requirements:
• Active RN license for US
• Minimum 2 years of clinical nursing practice
• Strong grounding in clinical guidelines, patient safety, and scope-of-practice boundaries
• Proven accuracy and consistency in clinical documentation or review work
• Comfortable using structured review tools and digital platforms
• Native or near-native written English
• Right to work in the country of residence
• Ability to work as an independent contractor
Benefits:
• Flexible Work Arrangements: Part-time, remote and fully asynchronous
• Competitive Compensation: Hourly rate
• Professional Development: Hands-on experience in AI evaluation and model fine-tuning, shaping how AI is deployed in patient care