About The Role
Remote data annotator jobs in Phoenix at Rex.zone focus on producing high-quality training data for AI systems across NLP, computer vision, and LLM training pipelines. You will perform data labeling, RLHF-based preference ranking, prompt evaluation, and QA evaluation to improve model performance and training data quality.
What You Will Do
• Label data for NLP tasks such as text classification, intent, sentiment, toxicity, and named entity recognition
• Perform large language model evaluation by scoring relevance, factuality, completeness, instruction-following, and safety
• Execute RLHF-style preference ranking by comparing and ranking model outputs
• Annotate computer vision data using bounding boxes, polygons, keypoints, and segmentation
• Complete QA evaluation using audits, inter-annotator agreement targets, and rework when needed
• Follow annotation guidelines compliance, document edge cases, and support calibration sessions
Requirements
• Strong written English and attention to detail
• Ability to follow complex guidelines and self-audit work for consistency and accuracy
• Preferred: experience with data labeling tools, prompt evaluation, content safety labeling, or QA processes
Work Model
This is a full-time Remote role performed online with secure workflows. Open to candidates in the US, including Phoenix-based applicants.