Note: The job is a remote job and is open to candidates in USA. eDataBae is seeking analytical professionals to support an AI quality evaluation project focused on personalized AI interactions. The role involves designing and evaluating conversational prompts, reviewing AI-generated responses, assessing personalization and accuracy, and providing structured feedback.
Responsibilities
- Create and evaluate multi-turn conversational prompts
- Review AI responses for accuracy, relevance, and helpfulness
- Compare responses and identify quality differences
- Evaluate personalization and potential incorrect inferences
- Provide clear, structured evaluation feedback
Skills
- Strong written and spoken English
- Excellent analytical and critical-thinking skills
- Strong attention to detail
- Ability to evaluate AI responses objectively
- Comfortable working independently
- Access to a desktop/laptop and reliable internet
- Candidates must be based in one of the following states: Alabama, Arizona, Colorado, Florida, Idaho, Iowa, Kentucky, Michigan, Minnesota, Mississippi, Missouri, Montana, New York, North Carolina, North Dakota, Oklahoma, Pennsylvania, South Carolina, South Dakota, Texas, Virginia, Wisconsin, Wyoming
- Experience in AI evaluation, data annotation, content moderation, research, linguistics, or related fields is preferred
Company Overview