About Rex.zone
Rex.zone connects skilled annotators with AI labs, tech startups, BPOs, and annotation vendors to help build LLM training pipelines at scale. This is a
remote
,
full-time
role available to candidates in the US, including Denver, with schedules handled online through Rex.zone.
About The Role
As a Senior Data Annotator, you will label and evaluate multimodal training data used in AI/ML products. You will deliver strong training data quality by following rubrics, documenting edge cases, and supporting model performance improvement through consistent, policy-aware decisions.
What You Will Do
Produce and review high-quality data labeling and data annotation outputs across text, image, and conversational datasets
Perform RLHF ranking / preference labeling for large language model evaluation
Execute prompt evaluation and response grading using project rubrics
Apply named entity recognition (NER) and span labeling with clear boundary rules
Complete computer vision annotation tasks (bounding boxes, polygons, keypoints) as needed
Run QA evaluation, error categorization, and spot checks to improve training data quality
Escalate ambiguous cases, write edge-case notes, and propose rubric clarifications
Join calibration sessions to maintain inter-annotator agreement
Required Qualifications
Prior experience in data annotation or data labeling for AI/ML systems
Strong attention to detail and consistent annotation guidelines compliance
Comfort with NLP tasks and rubric-based evaluations
Ability to document decisions clearly and communicate edge cases
Availability for full-time remote work aligned to project schedules
Preferred Qualifications
Experience with large language model evaluation and LLM training pipelines
Experience with content safety labeling or safety taxonomies
Mentoring/quality champion experience or leading calibration
Compensation
Hourly pay range:
$30–$50/hr
(USD).
Workplace:
Remote
(US-based).