Note: The job is a remote job and is open to candidates in USA. CACI is seeking a Mid-Level QA / Test Automation Engineer to support an agile software modernization program for Java-based applications hosted in Amazon Web Services. The role plans, executes, documents, and automates testing across applications, APIs, databases, integrations, and AWS environments while supporting defect resolution, CI/CD quality gates, and release readiness.
Responsibilities
- Review user stories, acceptance criteria, Java application designs, API specifications, data mappings, and AWS environment documentation to identify test conditions and expected results
- Create, execute, and maintain manual test cases for functional, system, regression, smoke, integration, API, database, data validation, and user acceptance testing
- Develop, enhance, and maintain automated test scripts, reusable components, test data, locators, and regression suites using appropriate automated testing tools
- Use automated testing tools to test web user interfaces, REST or SOAP APIs, databases, and end-to-end business processes, as applicable
- Execute automated tests across AWS-hosted test environments; analyze results, logs, screenshots, and execution evidence; troubleshoot failures; and maintain tests as the Java applications evolve
- Test Java-based application components and their interactions with AWS services, APIs, databases, authentication services, data exchanges, legacy systems, workflows, reports, and downstream systems
- Validate application behavior across AWS environments and use available application, cloud, and pipeline logs to support defect isolation and root-cause analysis
- Prepare and manage test data, capture test evidence, maintain requirements traceability, and document testing outcomes
- Log defects with clear reproduction steps, expected and actual results, severity, AWS environment details, and supporting evidence; participate in defect triage and verify fixes
- Collaborate with Java developers, Product Owners, Scrum Masters, AWS and DevSecOps engineers, integration and data teams, security specialists, vendors, and business stakeholders throughout the sprint and release lifecycle
- Support automated test execution in CI/CD pipelines, scheduled regression runs, and release validation; investigate failures and improve test reliability with senior QA and DevSecOps staff
- Contribute to test estimates, sprint planning, test coverage reviews, release-readiness assessments, quality metrics, and continuous improvement of AWS and automated testing practices
Skills
- Must be able to obtain and maintain a Federal Public Trust; candidates must receive approved adjudication before onboarding
- Bachelor's degree required
- Four (4) years of experience in software quality assurance, application testing, system testing, or a related technical role
- Hands-on experience testing Java-based web applications, services, APIs, integrations, and data flows
- Hands-on experience developing, maintaining, executing, and troubleshooting automated tests using one or more automated testing tools or frameworks
- Experience creating reusable automated test components, managing test data and locators, applying validations, and interpreting automated test results
- Experience testing applications deployed in AWS environments and working with cloud-hosted application components, APIs, databases, logs, and multiple test environments
- Hands-on experience creating and executing functional, system, regression, integration, API, smoke, database, data validation, and user acceptance tests
- Experience with defect tracking, test management, requirements traceability, test evidence, test data preparation, and defect retesting
- Working knowledge of the software development lifecycle, agile delivery, DevSecOps concepts, version control, AWS-based CI/CD pipelines, and release management
- Ability to interpret Java application behavior, user stories, acceptance criteria, business rules, API contracts, data mappings, and technical design documentation
- Ability to troubleshoot test failures, analyze automated test execution results and application or AWS logs, isolate defects, and clearly communicate findings and quality risks
- Strong documentation, analytical, collaboration, and communication skills
- Ability to manage assigned testing responsibilities with moderate supervision in a fast-paced environment with competing priorities and release timelines
- Percentage of Travel Required: Up to 10%
- Minimum Clearance Required to Start: Public Trust
- Candidates with an active Public Trust or suitability determination are preferred
- Experience supporting Java application or platform modernization in an enterprise or government environment
- Experience using Subject7 for web, REST or SOAP API, database, reusable-component, data-driven, scheduled, parallel, or CI/CD-integrated test automation
- Familiarity with common AWS services used by Java applications, such as Amazon EC2, Amazon S3, Amazon RDS, AWS Lambda, Amazon CloudWatch, or related services
- Ability to read basic Java, SQL, JSON, XML, and application logs to support testing and defect investigation
- Experience with Jira, Confluence, Git, Jenkins, AWS CodePipeline, Azure DevOps, or comparable delivery and test-management tools
- Exposure to Section 508 accessibility requirements and automated or manual accessibility testing practices
- Familiarity with containerized Java applications, security testing, performance testing, or AWS observability tools
- ISTQB, Subject7, AWS, agile, testing, automation, cloud, or security certification
Benefits
- A unique flexible time off benefit
- Access to robust learning resources
- Healthcare benefits
- Wellness benefits
- Financial benefits
- Retirement benefits
- Family support benefits
- Continuing education benefits
- Time off benefits
Company Overview