About the Company
DataAnnotation works with more than 100,000 experts to train and improve leading AI models. The company offers flexible, remote project opportunities for contributors to help evaluate AI systems and improve their performance.
About the Role
DataAnnotation is seeking contributors with strong software development skills to evaluate AI-generated code through real-world engineering tasks. In this role, you will work with advanced AI models, assess the quality of their code, and test their ability to solve complex programming problems.
The position focuses on agentic coding, code review, and adversarial testing to identify weaknesses in AI-generated solutions. Your findings and written explanations will help improve the reliability, security, and performance of future coding agents.
Key Responsibilities
Use advanced AI models to complete real-world software engineering tasks, including bug fixes, API extensions, and feature development.
Evaluate AI-generated code against production software standards.
Identify bugs, explain technical failures, and assess the quality of AI-generated reasoning.
Conduct adversarial testing to uncover insecure code, false test results, and incorrect solutions.
Document findings and provide clear written feedback to support AI model training and improvement.
Required Qualifications
Professional software development experience or substantial open-source experience delivering production-quality code.
Strong written English skills, with the ability to explain technical findings clearly.
Ability to evaluate code quality, identify defects, and assess software behavior.
A formal degree is not required. Candidates are evaluated based on their practical skills and experience.
Compensation and Work Arrangement
Compensation: Up to $150+ per hour, depending on task difficulty and specialization.
Work Arrangement: Remote.
Schedule: Flexible, with project-based work availability.
DataAnnotation states that many contributors earn an additional $100,000–$200,000 annually, while some make this work their full-time income. Actual earnings depend on available tasks, specialization, and individual participation.