Note: The job is a remote job and is open to candidates in USA. An unnamed client is seeking Business Analysts to evaluate and compare responses generated by multiple AI chatbots. The role involves applying predefined criteria, documenting findings, and providing objective assessments.
Responsibilities
- Review, analyze, and compare responses generated by multiple AI chatbots
- Evaluate chatbot responses based on predefined criteria, including accuracy, relevance, completeness, clarity, consistency, and overall quality
- Gather, analyze, and document business requirements and translate them into clear evaluation guidelines
- Conduct structured assessments and provide objective, evidence-based judgments
- Analyze workflows, processes, and data to identify gaps, inconsistencies, and areas for improvement
- Prepare reports, summaries, and supporting documentation to communicate evaluation findings
- Collaborate with project managers and cross-functional teams to clarify requirements and resolve assessment-related questions
- Track task progress, quality metrics, and deliverables to ensure timely completion
- Identify recurring issues in chatbot responses and share actionable observations
- Maintain high standards of accuracy, consistency, confidentiality, and documentation throughout the project
Skills
- Bachelor's degree in Business Administration, Finance, Computer Science, or a related field
- At least 3 years of experience as a Business Analyst or in a similar analytical role
- Strong analytical thinking, problem-solving, and decision-making skills
- Excellent written and verbal communication skills
- Proficiency in Microsoft Excel, SQL, Power BI, Tableau, or similar analytical tools
- Experience with requirement gathering, process mapping, and business documentation
- Ability to work effectively with cross-functional teams and manage multiple priorities
- Strong attention to detail and the ability to make consistent, objective assessments
- Ability to follow detailed instructions, meet deadlines, and work independently in a remote environment
- Candidates based in the United States
- Candidates must be based in the United States and comply with the applicable country-specific eligibility guidelines
- Familiarity with Agile or Scrum methodologies
Benefits
- Opportunity to contribute to projects focused on AI evaluation and chatbot response quality
- Fully remote work arrangement
- Exposure to structured AI assessment and quality assurance processes
- Opportunity to work on projects with broader business and technological applications
Company Overview