Robotic Manipulation Task Evaluator is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers grade trajectory choices, perception assumptions, and safety envelopes; flag failure modes; and document the corrected behavior so the modeling team can train on it.
Why this role matters
Robotics review systems run in the physical world, where a confident-looking failure can hurt someone. AuraOne uses experienced robotics and operations reviewers to grade outputs against perception, motion, and safety constraints.
Responsibilities
• Review robotics review outputs against current safety standards and operating envelopes for Robotic Manipulation Task Evaluator assignments.
• Grade perception, motion, and decision logic on a structured rubric.
• Flag near-miss and unsafe trajectories with severity tags that match incident taxonomies.
• Capture the corrected behavior or reference trajectory so the modeling team can train on it.
• Adjudicate disputed cases against published standards or firm operating procedures.
• Maintain reviewer-quality scores in inter-rater calibration cycles.
Qualifications
• Hands-on experience with robotic, autonomous, or teleoperated systems. Operating, supervising, or evaluating them for Robotic Manipulation Task Evaluator work.
• Comfort reasoning about perception, motion planning, and physical safety envelopes.
• Familiarity with structured incident taxonomies and severity scoring.
• Clear written reasoning that names the failure mode and the standard being applied.
• Reliable async availability for at least 10 hours per week.
Example tasks
• Grade a robotics review model's chosen trajectory and flag any near-miss or unsafe motion.
• Score a perception output against ground-truth labels and rate the failure category.
• Adjudicate a disputed safety call between two reviewers using firm operating procedures.
• Audit a 25-trajectory batch for rubric consistency and report drift to the program lead.
Nice to have
• Background in robotics engineering, autonomy operations, or industrial safety.
• Prior experience reviewing AI-assisted robotics tooling and its failure modes.
• Familiarity with simulation environments and trajectory-replay tooling.
Skills
• Robotics evaluation
• Perception review
• Motion safety
• Incident taxonomy
• Robotics review
• Embodied AI
• Safety review
• Robotic
• Manipulation
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.