About The Role
Rex.zone is hiring for remote data annotator jobs serving Denver-area searches. You will follow detailed annotation guidelines to produce high-quality training data for NLP and computer vision projects, including RLHF preference ranking, prompt evaluation, content safety labeling, and QA evaluation that improve downstream model performance.
What You Will Do
• Label and validate data for NLP tasks (named entity recognition, classification, sentiment/intent tagging)
• Annotate computer vision data (bounding boxes, segmentation, attribute labeling)
• Perform RLHF-style preference ranking, compare model responses, and write short rationales aligned to policy and safety
• Complete prompt evaluation and QA evaluation workflows to ensure training data quality
• Run consistency checks, participate in peer review, and escalate taxonomy/guideline gaps
Required Qualifications
• 3+ years in data annotation, data labeling, QA evaluation, or related data operations
• Ability to interpret detailed guidelines and maintain accuracy at throughput
• Understanding of inter-annotator agreement and quality metrics (audit pass rate, calibration results)
• Clear written communication for edge cases and RLHF judgments
Preferred Qualifications
• Experience with RLHF, LLM evaluation, and preference ranking
• Familiarity with content safety labeling and policy-based decisions
• Experience supporting AI labs, tech startups, enterprises, BPOs, or annotation vendors
Compensation
Competitive hourly rate: $30–$50/hr (based on experience, task complexity, and quality outcomes).