Note: The job is a remote job and is open to candidates in USA. IDPrivacy is building a next-generation privacy-first platform for online advertising. The AI QA Engineer will design and implement end-to-end code and content testing processes, execute manual and automated regression testing, and test AI-generated content for accuracy and hallucinations. The role also involves debugging, defect tracking, requirements review, and collaboration with engineering and product teams throughout the software development lifecycle.
Responsibilities
- Developing an overarching approach to QA and then designing processes to implement that approach
- Developing and executing exploratory and automated regression testing to ensure code quality
- Developing and executing exploratory and regression testing for AI-generated content to ensure its accuracy and remove hallucination
- Designing and implementing tests, debugging, and defining corrective actions
- Review system requirements and track quality assurance metrics (e.g., defect densities and open defect counts)
- Monitor all stages of software development to identify and resolve system malfunctions to meet quality standards
- QA System conceptualization and design
- Review and analyze system specifications
- Collaborate with developers and product managers to develop effective strategies and test plans
- Execute test cases (manual or automated) and analyze results
- Evaluate product code according to specifications
- Create logs to document testing phases and defects
- Report bugs and errors to development teams
- Help troubleshoot issues
- Conduct post-release/post-implementation testing
- Work with cross-functional teams to ensure quality throughout the software development lifecycle
- Attend weekly project meetings, leadership calls, and external client calls as needed
- Perform other duties as assigned by the supervisor
Skills
- • 4+ years of professional experience and a bachelor's degree in computer science, engineering, or a related field
- • Understanding of testing and debugging of LLMs and LLM-derived products
- • Highly organized and disciplined around QA testing, debugging, and bug prioritization
- • Proven experience as a quality assurance tester or similar role
- • Experience in project management and QA methodologies
- • Familiarity with agile frameworks and regression testing
- • Ability to document and troubleshoot errors
- • Working knowledge of test management software (e.g., QTest, Zephyr) and SQL
- • Excellent communication skills
- • Attention to detail
- • Analytical mind and problem-solving aptitude
- • Experience with automated testing tools (e.g., Selenium, QTP, JMeter)
- • Knowledge of programming languages (e.g., Java, Python) is a plus
- • Experience in performance testing
- • Familiarity with continuous integration tools (e.g., Jenkins, Bamboo)
Company Overview