About the Company
DataAnnotation helps train advanced AI models by working with experts across technical and professional fields. Contributors evaluate AI-generated work and provide feedback to improve model performance.
About the Role
As a DevOps Engineer - AI Trainer, you will evaluate AI coding agents by testing their ability to solve real-world software engineering tasks. You will analyze generated code, identify bugs and security issues, assess reasoning, and document failures to help improve the next generation of AI systems. This is a remote, flexible opportunity for professionals with strong software development experience.
Key Responsibilities
Use advanced AI coding models to complete engineering tasks, including fixing bugs, extending APIs, and developing features.
Review AI-generated code against production-quality engineering standards and identify errors or weaknesses.
Evaluate AI reasoning and explain why a proposed solution succeeds or fails.
Test AI-generated code for security vulnerabilities, unreliable solutions, and falsely reported test results.
Document findings and provide clear written feedback to improve AI model performance.
Required Qualifications
Professional software development experience or substantial open-source experience delivering production-quality code.
Strong written English skills to explain technical findings clearly and accurately.
Ability to analyze code, identify issues, and assess the quality of engineering solutions.
No formal degree required; practical skills and demonstrated experience are the priority.
Salary & Benefits
Compensation of up to $150+ per hour, depending on task difficulty and specialization.
Flexible, remote work.
Opportunity to contribute to AI model training projects, with workload and earnings depending on available tasks and individual participation.