Note: The job is a remote job and is open to candidates in USA. Turing is hiring Legal Experts to evaluate and improve AI models’ understanding and reasoning about U.S. law. The role involves reviewing legal responses, applying evaluation rubrics, identifying reasoning gaps, providing annotations and feedback, and collaborating with researchers and project managers.
Responsibilities
- Review and evaluate AI-generated responses to U.S. legal hypotheticals across multiple areas of law
- Apply a structured legal rubric to assess issue spotting, accuracy, reasoning, and application of law
- Identify gaps, edge cases, and blind spots in legal reasoning, helping define benchmarks for legal AI performance
- Provide detailed, high-quality annotations and written feedback to refine AI models
- Collaborate with researchers and project managers to align evaluation standards and project goals
Skills
- Juris Doctor (J.D.) from an accredited U.S. law school
- Bar admission (active/inactive)
- 3+ years of U.S. legal practice or teaching experience
- Strong reasoning skills across core areas of U.S. law
- Excellent written communication and attention to detail
- High ethical standards
- Interest in AI
Benefits
- Opportunity to work on cutting-edge AI projects with leading LLM companies.
- Flexible, fully remote work arrangement.
- Learn how to use AI to advance the legal field.
Company Overview
Company H1B Sponsorship