Senior Data Labeling Jobs in Atlanta (Remote, Full-Time)
Rex.zone is hiring a Mid-Senior Data Labeling Specialist to lead high-accuracy labeling and AI/ML evaluation work supporting production LLM training pipelines. You will drive training data quality through annotation guidelines compliance, RLHF-style preference ranking, prompt evaluation, and rigorous QA evaluation across NLP, computer vision, and content safety domains.
What You Will Work On
NLP labeling (classification, named entity recognition/NER, entity linking)
LLM evaluation with calibrated rubrics (prompt evaluation, response ranking, preference data for RLHF workflows)
Computer vision annotation (bounding boxes, polygons, segmentation) and image/video labeling
Policy-driven content safety labeling using taxonomy-based guidelines
Core Responsibilities
Execute complex annotation tasks with consistent, guideline-driven decisions
Own training data quality and evaluation rigor through QA evaluation (spot checks, audits, sampling, inter-annotator agreement)
Document edge cases and rationales; resolve disagreements and improve consistency
Write, refine, and enforce annotation guidelines and error taxonomies
Support calibration sessions and contribute to rubric design for large language model evaluation
Required Qualifications
Mid-Senior experience in data labeling/data annotation/AI evaluation with strong accuracy and throughput
Demonstrated discipline in QA evaluation, guideline adherence, and measurable quality targets
Familiarity with NLP and/or computer vision annotation; comfort in remote, metrics-driven environments
Why This Role
Your work supports AI labs, tech startups, BPOs, and annotation vendors by delivering reliable labeled data and evaluation signals that improve model performance.
Apply with examples of guideline-driven work and data quality ownership.