Overview
Rex.zone is hiring a Remote Data Labeling Specialist aligned to Raleigh-based job seekers. Work is performed remotely within the US. You will produce and verify high-quality labeled datasets used to train and evaluate AI models in real products, supporting LLM training pipelines and evaluation loops.
What You Will Work On
• Label and review multi-modal data (text, images, audio, video) for AI training and evaluation
• Complete NLP tasks such as classification and named entity recognition (NER)
• Perform computer vision annotation including bounding boxes and segmentation
• Support content safety labeling and policy-aligned decisions
• Conduct LLM evaluation tasks such as RLHF preference ranking and prompt evaluation
Key Responsibilities
• Deliver accurate labels aligned to annotation guidelines and complex rubrics
• Execute QA evaluation workflows (spot checks, gold set validation, sampling audits, inter-annotator agreement)
• Document edge cases, rationales, and disagreement resolution to improve training data quality
• Maintain throughput targets while preserving precision and consistency across batches
• Protect data privacy and follow content and safety policies
Required Qualifications
• 2+ years in data labeling, data annotation, QA evaluation, or AI data operations
• Strong attention to detail and proven annotation guidelines compliance
• Comfortable making consistent decisions across edge cases (mid-senior expectations)
• Experience with RLHF-style ranking, LLM evaluation, or prompt evaluation preferred
Compensation
$30–$50 per hour (base pay; varies by project and scope).
How To Apply
Apply via Rex.zone with a resume highlighting labeling domains, QA metrics, and any RLHF/LLM evaluation experience.