Adjudicator – Disagreement Resolution, Guideline Governance

Role Overview

• Resolve label disagreements from multi-rater overlap and QA escalations.
• Use side-by-side comparisons, guideline references, and evidence frames/clips to decide final truth.
• Classify disagreement causes (definition ambiguity, visibility limits, procedural variance, annotator error).
• Maintain adjudication logs and update guidelines/decision trees with approved changes.
• Escalate to clinical reviewer when needed; prepare concise packets for decision.
• Ensure adjudicated outputs feed back into training/calibration and pre-label improvement.

Requirements

• 5–10+ years in annotation operations with deep experience in complex labeling tasks.
• Strong judgment and consistency; able to apply guidelines rigorously.
• Excellent written communication; can document rationale cleanly.
• Surgical/clinical familiarity preferred; clinician-in-the-loop experience is a plus.