Test Metrics and Reporting Analyst
Responsibilities
• Work with team to establish testing metrics and targets.
• Set up testing tools and processes to accurately capture and report on testing metrics.
• Retrieve test data daily to understand trends in all phases of testing.
• Gather testing data and metrics to generate reports and dashboards at the project level.
• Track testing schedule and progress.
• Track defect resolution progress.
• Consolidate data from different projects and vendors.
• Analyze data to generate daily reports on testing progress, trends, and potential risks.
• Prepare reports on test metrics.
• Generate and distribute End of Day Reporting.
• Create data models for future testing efforts and measurable targets.
• Implement continuous improvements to testing processes and methodologies based on data analysis and feedback.
• Facilitate daily cross-vendor status calls with the state client and vendor partners, presenting testing progress, trends, and risks, answering questions directly, and driving follow-up on action items.
• Validate the accuracy of all figures and formatting before reports and dashboards are distributed and communicate risks proactively without waiting for direction.
Qualifications
• Minimum of 5 years of experience in test management, data analysis, or a related field within an enterprise setting, including experience in a Medicaid or state health and human services environment.
• Proven experience in analyzing testing metrics and generating comprehensive reports on testing progress and risks.
• In-depth understanding of testing process assessments and the ability to identify deviations and manage corrective actions from start to finish.
• Significant experience with test data consolidation and a strong knowledge of test management and defect tracking tools (e.g., JIRA, HP ALM).
• Relevant certifications in quality assurance, project management, or testing (e.g., ISTQB, PMP, or CSTE) preferred.
• Demonstrable knowledge and experience with enterprise-level testing standards and audit requirements.
• Proven experience in training and educating team members and stakeholders on testing metrics, tools, and strategies.
• Excellent analytical, problem-solving, and communication skills.
• Demonstrated experience leading or facilitating status calls with multiple vendors and client leadership and producing executive-ready dashboards.
• Ability to work independently with minimal supervision, take ownership of deliverables, and incorporate feedback.