Note: The job is a remote job and is open to candidates in USA. Weekday AI is supporting an AI research initiative that evaluates how effectively AI systems perform real-world digital product design work. The UI/UX Design Expert will define evaluation criteria, assess AI-generated and human-created design work, and provide rigorous written feedback on usability, accessibility, visual quality, interaction patterns, and product effectiveness.
Responsibilities
- Develop clear, objective, task-specific grading criteria for digital product and UX deliverables, including: + Design systems and component libraries + Responsive interfaces, dashboards, and web applications + End-to-end product journeys such as onboarding, checkout, booking, and account management + Customer portals and logged-in experiences + UX writing and product content + Design-to-development and production handoff
- Evaluate AI-generated and human-created design work against established criteria
- Provide detailed, evidence-based written explanations for each evaluation, clearly identifying strengths, weaknesses, usability issues, and areas for improvement
- Apply consistent standards so that evaluations are objective, reproducible, and aligned with real-world product expectations
- Incorporate feedback from senior reviewers and continuously refine evaluation approaches
- Assess designs from the perspective of usability, accessibility, visual quality, interaction patterns, business objectives, and end-user needs
- Submit your resume, portfolio, or relevant professional background
- Qualified candidates may be asked to complete a brief design assessment or provide additional information about their experience
- Selected professionals will receive further details about the project, evaluation process, and onboarding requirements
- Fully remote engagement
- Flexible project-based schedule
- Work focused on digital product, UI/UX, and design evaluation
- Collaboration with an experienced research and review team
- Engagement is structured as an independent contractor opportunity
- Work can be completed remotely and generally on a flexible schedule
- Projects may be extended, shortened, or concluded based on project requirements and performance
- Work will not require access to confidential or proprietary information belonging to any current or former employer, client, or institution
- Payments are made weekly through supported payment platforms based on services rendered
- Candidates must meet all applicable eligibility requirements for the engagement
Skills
- The ideal candidate brings hands-on experience designing digital products, strong knowledge of modern UX practices, and the ability to distinguish thoughtful, production-ready design from superficial or incomplete work
- 5+ years of professional experience in product design, UI/UX, UX design, or design systems for real-world digital products
- Experience working with leading digital-product or UX studios, product-led organizations, e-commerce platforms, marketplaces, or technology companies with sophisticated digital experiences
- Relevant experience in one or more areas such as: + Product / UI Designer + UX Designer or UX Lead + Design Systems Designer + UX Writer / Content Designer + Digital Product or Business Analyst
- Strong command of interaction design, visual design, responsive layouts, design systems, prototyping, usability principles, and end-to-end product flows
- Hands-on proficiency with Figma and familiarity with production and engineering handoff processes
- Ability to critically evaluate design decisions and articulate feedback at the level expected from a senior design or UX lead
- Excellent written communication skills, with the ability to clearly explain why a design does or does not meet professional standards
- Strong attention to detail and the ability to apply consistent evaluation criteria across different design solutions
- Comfortable receiving feedback and having professional judgment reviewed and calibrated against other experts
- Fully remote engagement
- Flexible project-based schedule
- Candidates must meet all applicable eligibility requirements for the engagement
- Prior experience with AI training, AI evaluation, or human-data projects is a plus
Benefits
- Fully remote engagement
- Flexible project-based schedule
- Collaboration with an experienced research and review team
Company Overview