QA Engineer 2 - MyWP Attribution

 We’re reinventing the market research industry. Let’s reinvent it together.

At Numerator, we believe tomorrow’s success starts with today’s market intelligence. We empower the world’s leading brands and retailers with unmatched insights into consumer behavior and the influencers that drive it.

QA Test Engineer – Automation & Manual (Attribution)

Core Tech Stack: Selenium, Azure DevOps, Jira, Excel, SQL, Power BI, AI-enabled testing tools

Key Responsibilities

General

• Execute and validate existing pipeline scripts in UAT ahead of Champion testing to identify defects early, minimize downstream impact, and support smooth testing progression using Selenium.

• Communicate effectively with the Scrum team, providing clear feedback on test execution and outcomes.

• Analyze, review, and test platform features in lower environments, reporting outcomes, and supporting sign-off scenarios.

• Log platform defects in Azure DevOps with clear reproduction steps to support efficient investigation and resolution.

• Ensure test scripts are completed within agreed sprint timelines for the UAT environment.

• Provide timely updates on outstanding scripts across QC and UAT environments.

• Contribute to the continuous improvement of existing test scripts and processes.

Regression Tests

• Maintain the UAT regression test suite to reflect platform changes following implementation.

• Lead Show & Tell sessions for tested stories, highlighting risks, issues, and areas requiring attention.

• Demonstrate new functionality to business stakeholders in preparation for UAT.

• Analyze UAT test results and escalate issues in a timely manner.

• Support final test sign-off prior to promotion of features into Production.

Automation Support

• Coordinate work items for automation activity based on regression test scenarios and agreed priorities.

• Ensure that automated scripts are regularly reviewed and updated to maintain accurate coverage.

• Maintain the automated test tracker and provide accurate progress updates.

Required Skills and Experience

• Proven experience in manual and regression testing within Agile delivery environments.

• Experience using Azure DevOps and Jira for defect management and test support activities.

• Working knowledge of Selenium.

• Ability to document test cases, defects, and outcomes with a high level of accuracy and attention to detail.

• Strong communication and collaboration skills, with the ability to work effectively across cross-functional teams.

Preferred Skills and Experience

• Exposure to automated testing frameworks and scripting would be advantageous.

• Understanding UAT processes and regression testing cycles would beneficial.

AI Adoption and Capability Development

Whilst AI tools are not currently a core requirement of the role, the successful candidate will be expected to demonstrate awareness of emerging AI capabilities and a willingness to support the adoption of approved tools that enhance regression testing, improve efficiency, and contribute to continuous improvement within the QA function.

Required

• Must demonstrate openness to adopting approved AI-enabled solutions within the organization’s technology landscape.

• Must be able to provide clear context, objectives, and constraints when using AI-enabled tools.

• Must possess strong analytical and problem-solving skills, with the ability to break complex testing challenges into structured tasks.

• Must be able to assess, validate, and fact-check AI-generated outputs, applying sound judgement and appropriate human oversight.

• Must demonstrate awareness of responsible AI principles, including data quality, governance, and the limitations of AI-enabled solutions.

Preferred

• Previous exposure to machine learning, generative AI, or automation concepts relevant to QA and business environments would be advantageous.

• Experience in data interpretation and basic analysis, including confidence working with structured and unstructured data, is preferred.

• An understanding of data quality standards and governance principles in support of AI-enabled use cases is desirable.

• The ability to identify automation opportunities and apply a problem-first approach to process improvement would be beneficial.

Nice to Have

• Familiarity with analytical and reporting tools such as Excel, SQL, and Power BI would be an advantage.

• Practical AI literacy, including awareness of tool limitations and the need for validation and human review, would beneficial.

• A curious, test-and-learn mindset and willingness to experiment with new approaches in a controlled environment would be valued.

• Experience of collaborating effectively across product, engineering, and business teams would be advantageous.

 

Performance Measures

Quality Metrics

• Test Case Execution Rate: Complete 95% of planned test cases within sprint timelines.

• Defect Reporting Accuracy: Ensure 100% of reported defects include detailed reproduction steps and screenshots.

• Regression Coverage: Maintain 100% coverage for updated UAT test suites post-implementation.

Delivery and Collaboration

• Show & Tell Participation: Conduct at least one demo per sprint for tested stories.

• Defect Resolution Turnaround: Log and communicate defects within 24 hours of identification.

• Cross-Team Engagement: Achieve full attendance in sprint ceremonies and UAT sessions.

Automation Support

• Automation Tracker Updates: Update tracker within 24 hours of any script changes.

• Automation Coverage: Ensure baseline automated coverage for critical regression scenarios (minimum 50% coverage).

• Scheduling Accuracy: Schedule automation tasks for all regression items within one business day of identification.

Continuous Improvement and Team Contribution

• Contribute to continuous improvement by proposing at least one process improvement initiative per quarter to enhance QA efficiency.

• Participate actively in knowledge-sharing activities to support team capability development and best practice adoption.

Proven manual and regression testing experience in Agile; Azure DevOps and Jira; Selenium; strong communication and collaboration; openness to AI-enabled tools; analytical and problem-solving skills.

Key Responsibilities

• executing test scripts
• logging defects
• maintaining regression suites

Skills & Tools

Selenium, Azure DevOps, Jira, Microsoft Excel, SQL, Power BI

Job Details

• Category: Quality Assurance
• Seniority: Mid Level
• Commitment: Full Time
• Workplace: Remote — India
• Languages: English

About Numerator

A market intelligence company empowering brands and retailers with consumer behavior insights. — Industry: Information Technology