Note: The job is a remote job and is open to candidates in USA. Lucas James Talent Partners is recruiting on behalf of UL Research Institutes for an AI Research Engineer at the Digital Safety Research Institute. This role focuses on designing, developing, and evaluating AI safety assessment systems, particularly in natural language processing, and aims to enhance the safety assessments of frontier AI systems.
Responsibilities
- Studies incident reports implicating LLMs or NLP algorithms and hypothesize root causes
- Conducts literature and open-source reviews in NLP or LLM Designs, plans, and creates NLP or LLMs assessments - expanding digital safety best practices
- Applies technical, diagnostic, and troubleshooting skills
- Codes or trains text analytics needed to run NLP or LLM assessments
- Prepares written component documentation for technical audiences
- Publishes assessment research results, on-line, using Digital Safety lab tools, and in peer-reviewed conferences and journals
- Works closely with team members to ensure that all processes are accurate and technically sound
Skills
- Demonstrates mastery level knowledge of NLP and LLM safety and how safety assessments can protect the public from LLM harms
- Solves AI assessment research challenges independently and efficiently
- Engages software engineering teams who build tools to help DSRI researchers scale their assessments to perform rapidly at scale
- Looks ahead to needed research and development next steps, for better analytics to assess LLM or NLP outputs
- Begins developing relationships within the broader safety community
- Ph.D. in computer science or related field, focused on NLP or LLMs
- 3 years of relevant experience, post Ph.D
Benefits
- Eligible for bonus compensation
- Comprehensive medical, dental, vision, and life insurance plans
- Generous 401k matching structure of up to 5% of eligible pay
- Invest an additional 4% into your retirement saving fund after your first year of continuous employment
- Depending on your role, you may be able to discuss flexible working arrangements with your manager
- Paid time off, including vacation, holiday, sick, and volunteer days
Company Overview