Senior Data Labeling Jobs in San Diego (Remote)
Rex.zone is hiring an experienced, Mid-Senior Data Labeling Specialist to improve training data quality across NLP, computer vision, content safety, and LLM evaluation workflows. This is a
full-time
, fully
remote
role designed for annotators who can handle complex edge cases and drive consistent, high-signal labeling outcomes.
What You Will Do
Execute senior-level data labeling for NLP, computer vision, and content safety datasets
Perform RLHF preference ranking and large language model evaluation
Run QA evaluation audits for annotation guidelines compliance and consistency
Handle complex edge cases (ambiguity, long-context, policy-sensitive content)
Create clear written rationales to support adjudication and error analysis
Calibrate with teammates using gold sets, adjudication, and disagreement analysis
Suggest tooling/workflow improvements to increase accuracy and throughput
Maintain privacy, security, and content-handling best practices while remote
Required Qualifications
Mid-Senior experience in data labeling, data annotation, or ML data operations
Strong ability to follow and refine annotation guidelines with high precision
Experience with QA evaluation, audit sampling, and quality scoring methods
Familiarity with RLHF, preference ranking, or prompt evaluation for LLM pipelines
Comfort with NLP tasks such as named entity recognition and classification
Strong written reasoning for label justifications and adjudication notes
Ability to work independently in a remote, full-time environment
Preferred Qualifications
Computer vision annotation (bounding boxes, polygons, segmentation, keypoints)
Content safety labeling (hate/harassment, self-harm, sexual content, regulated goods)
Multilingual labeling or dialect-aware evaluation
Exposure to evaluation metrics, taxonomy building, or red teaming workflows
Compensation
Competitive hourly pay:
$30–$50/hr
(based on skills alignment, evaluation complexity, and quality performance).
Target market: San Diego, US (role is remote).
How To Apply
Apply via Rex.zone to be matched to senior data labeling projects aligned with your skills. You may be asked to complete a skills screening focused on training data quality, QA evaluation, and RLHF-style judgments.