Remote Data Annotation Jobs Dublin (Remote)
Rex.zone is hiring mid-senior data annotators to support AI training workflows, including data labeling, RLHF evaluation, prompt evaluation, and training data QA. You will follow structured rubrics, resolve edge cases, and deliver high-quality labeled datasets that improve model performance across real-world LLM training pipelines.
Key Responsibilities
• Deliver accurate labels and evaluations across text, image, and safety datasets
• Perform RLHF preference ranking (pairwise comparisons) and preference judgments
• Conduct prompt response evaluation for helpfulness, factuality, and policy compliance
• Complete named entity recognition (NER) and intent/classification tasks
• Annotate computer vision data (e.g., bounding boxes, polygons, segmentation) as required
• Execute rubric-based QA evaluation; elevate ambiguous edge cases with clear rationales
• Participate in calibration sessions to reduce inter‑annotator variance and improve agreement
• Document decisions to improve annotation guidelines and audit readiness
• Meet throughput targets while maintaining consistency, precision, and quality
Required Qualifications
• Mid-senior experience in data annotation, QA evaluation, or AI data operations
• Strong written English and high attention to detail
• Proven ability to follow rubrics and maintain annotation guidelines compliance
• Familiarity with NLP concepts (classification, NER) and/or computer vision annotation
• Comfort working remotely with feedback cycles, quality audits, and production tooling
Preferred Qualifications
• Hands‑on experience with RLHF workflows, LLM evaluation, or prompt evaluation
• Exposure to content safety labeling and policy-driven annotation
• Experience with calibration, adjudication, and inter‑annotator agreement processes
• Ability to write clear rationales that reduce disagreement and improve guidelines
Compensation
$30–$50 per hour (base salary, hourly).