Note: The job is a remote job and is open to candidates in USA. Codefeast is seeking a QA Engineer to support AI training and evaluation workflows. The role involves testing software, reviewing AI-generated outputs, validating model behavior, creating evaluation artifacts, and providing feedback to improve LLM performance and software reliability.
Responsibilities
- Contribute to LLM training and evaluation workflows by testing software, reviewing AI-generated outputs, and validating model behavior
- Assess outputs for functional correctness, accuracy, reliability, edge-case handling, and adherence to requirements
- Create and review test cases, test scenarios, evaluation criteria, bug reports, and quality benchmarks for AI-driven workflows
- Provide detailed feedback to improve LLM performance, software quality, and reliability across complex technical tasks
Skills
- 3–8 years of professional experience in QA, Software Testing, Quality Engineering, or related roles
- Strong experience with manual and automated testing, test case design, debugging, API testing, and regression testing
- Proficiency with Python, JavaScript, Java, or similar languages, along with tools such as Selenium, Playwright, Cypress, or equivalent
- Experience with or strong interest in LLM evaluation, AI-assisted testing, prompt engineering, or AI training workflows
Company Overview