Note: The job is a remote job and is open to candidates in USA. Great Value Hiring is seeking a Product Manager/Product Owner to evaluate AI-generated product and technical content. The role involves scoring responses, documenting detailed rationales, identifying inaccuracies and instruction failures, and collaborating asynchronously with project managers and reviewers to maintain assessment quality.
Responsibilities
- Assess and compare AI-generated responses to a variety of writing prompts, including specifications, release notes, user-facing copy, and stakeholder updates
- Score each response based on clarity, tone, adherence to instructions, and usefulness for the intended audience
- Write detailed rationales explaining the reasoning behind each score, focusing on whether the content meets prompt requirements and audience needs
- Identify and document cases where fluent writing fails to answer the question, or complete responses are unsuitable for users
- Spot factual inaccuracies, inconsistencies, and instances where content exceeds or misses prompt constraints
- Collaborate virtually and asynchronously with project managers and reviewers to ensure consistency and quality in assessments
Skills
- Professional experience as a Product Manager or certified Product Owner, with a strong record in cross-functional product development
- Native-level English fluency and exceptional written communication skills
- Extensive experience authoring and evaluating specifications, PRDs, acceptance criteria, release notes, or decision documents
- Demonstrated ability to judge whether content is appropriately tailored for executives, technical stakeholders, or end users
- Proven skill in providing actionable, written feedback on technical or user-facing documentation
- Attention to detail, critical analysis skills, and the ability to work independently while meeting remote project deadlines
- Familiarity with model evaluation, RLHF, or annotation is a plus, but not required
Benefits
- Collaborate virtually and asynchronously with project managers and reviewers
- Ability to work independently while meeting remote project deadlines
Company Overview