Note: The job is a remote job and is open to candidates in USA. Lexitas Legal Talent Solutions is a leader in legal publishing, seeking multiple attorneys for a project involving the testing of a Large Language Model (LLM) for AI-generated summaries of US court opinions and legal content. The role involves creating inputs for the LLM, analyzing outputs, and providing feedback on accuracy and content.
Responsibilities
- Creating inputs/prompts for an LLM and analyzing outputs from the model for model training
- Evaluating outputs for specific legal content against a set of required elements and for accuracy of both the summary content and any statutory rules or case citations contained within the output
- Providing assessment rating feedback and additional feedback commentary as necessary
Skills
- Law degree and active bar admission in the US required
- At least 1-3 years' experience; some courtroom experience strongly preferred
- Strong legal research and legal analysis skills in addition to high degree of familiarity with US legal content/documents
- Working knowledge of Excel spreadsheets
- Ability to work with multiple software-based tools
- Capable of providing a large volume of work in accordance with quotas that may be set
- Experience in providing high quality feedback rating analysis as well as additional comments on products being tested
- Some courtroom experience strongly preferred
Company Overview