Senior QA Automation Engineer
College Board– Technology –AIServices Infrastructure
Location:This is a fully remote role. Candidates who live near CB offices have theoptionof being fully remote or hybrid (Tuesday and Wednesday in office).
Type:This is a full-time position
About the Team
We'rea small, close-knit team enabling AI services for specific departments withinCollegeBoard, working at the intersection of Product, Engineering, and Psychometrics.You'llhelp build and evolve software that supportsCollegeBoard's large-scale assessment programs, ensuringaccurate, reliable outcomes for the students and educators who rely on them.We'recurrently building and evolving this capability internally, with a focus on improving efficiency, reliability, and the day-to-day experience of thestudents andlarge educator workforce involved in this process.Being small meanseveryone has real influence:you'llwear multiple hats, partner closely with Product and Psychometrics, and help shape a broader ecosystem of scoring and orchestration services as it takes shape.
Aboutthe Opportunity
As a SeniorQAAutomation Engineer, you will be helping to develop andvalidatecritical components that will enhance learning opportunities and feedback for millions of students, while also contributing to the needs of educators. For this team, you will be the primary quality-focused engineer, ensuring that solutions coming out of the team are well-crafted and meet the needs of all stakeholders from both a functional and technical standpoint. You will also be asked to help explorenew technologies,identifyopportunities thatbenefitTechnology as a whole, andparticipateinAI-driven SDLC processes.
In this role, you will:
Design & Implementation (60%)
Design and implement testing strategies,including agenticAI, to provide automated validation of quality metrics and gates within the system.Identifyappropriate testingstrategies to apply for differing scenarios and processes.Provideexpertguidanceonfunctional and data-oriented risks.
Help ensure that system components are built with security as a high priority.
Maintain the highest engineering standards in collaboration with product owners, architects, and stakeholders, in support of our systems and services
Understand new product capabilities and decompose the implementation into specific functional changes for verification
Createappropriate mockservices to ensure zero dependency, where possible, with other teams
Provide entry and exit points for automated services that other engineers may use to ensure their own quality before it reaches the team level.
Build solutions using the best practices of Agile, CI/CD, and DevOps.
Team Operations & Success (20%)
Participatein andpossiblyleadAgile ceremonies. Contribute to development ofnew processesfor agentic-centered development.
Participateand leadpeer reviews of software engineering artifactsfor both design and code
Assistin the resolution of production issues
Be a fierce advocatefordevelopment standards and security policies and procedures
Adopt the continuous integration and continuous delivery (CI/CD) practice of rapidly implementing, testing, and delivering high-quality code based on the team’s DevOps model
Continuously develop the skillsrequiredto work as part of the Agile team in a poly-skilled development environment
Contribute to SDLC process design when appropriate
Systems Analysis and Development(20%)
Develop andmaintaina thorough understanding of the customer’s business processes and operations
Work closely withArchitects and Engineers toevaluatefeature requests,providelevel-of-effortestimates,and contribute toplanning.
Analyze and conduct testing todeterminethe most efficient approaches for our systems and benchmark current approaches
About you, youhave:
~7+years of experience in software systems, testing, qualityassuranceand scripting/development
Working experience with quality tools, such as Cucumber, Jest, Postman, etc.
Familiarity with advanced testing strategies such as using test doubles (stubs, fakes, shims, mocks)
Basic understanding of performance testing and the mechanics of operating one
Experience applying AI for both development and testing purposes
Experience testing codeand scripting withinanAmazon Web Servicesenvironment(Lambda, Step Functions, S3, Dynamo, etc.)
Experience with CI/CD and DevOps, infrastructure and how role access works
Experience working in Agile methodologies
Proven ability to pitchnew ideasand implement improved systems and processes
Strong oral and written communication skills and analytical ability
Able to function independently and in a collaborative environment
Ability to travel 3-5 times a year to our NYC or Reston, VA office
All roles at College Board require:
A passion for expanding educational and career opportunities and mission-driven work
Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and comfort with learning and applying new digital tools independently and proactively.
Clear and concise communication skills, written and verbal
A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receivingtimely, respectful feedback, and continuously improving through iterative learning and user input.
A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking.
A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success
Authorization to work in the United States
About Our Process
Application review will beginimmediatelyand will continue until the position is filled.This role is expected to accept applications for a minimum of 5 business days.· While the hiring process may vary, it generallyincludes:resume and application submission, recruiter phone/video screen, hiring manager interview, performance exercise such as live coding, a panel interview, a conversation with leadership and reference checks.
What We Offer
AtCollegeBoard, we offer more than a paycheck- we provide a meaningful career, a supportive team, and a comprehensive package designed to help you thrive.We’rea self-sustaining nonprofit that believes in fair and competitive compensation grounded in your qualifications, experience, impact, and the market.
A Thoughtful Approach to Compensation
The hiring range for this role is $153,000–$166,000.
Your exact salary will depend on your location, experience, and how your background compares to others in similar rolesatthe College Board.
We aim to make our best offer upfront, rooted in fairness, transparency, and market data.
We adjust salaries by location to ensure fairness, no matter where you live.
You’llhave open, transparent conversations about compensation, benefits, and whatit’slike to workatCollegeBoard throughout your hiring process. Check outourcareers pagefor more.
Originally posted on