Quality Auditing: Review annotated data (images, text, video, or audio) based on defined guidelines, perform random and targeted 25% sampling (initial), identify errors, inconsistencies, and edge cases
Error Analysis & Reporting: Categorize errors (e.g., labeling, bounding box accuracy, classification mistakes), track QA metrics such as accuracy rate, defect rate, and rework volume, provide daily/weekly QA reports with actionable insights
Feedback & Coaching: Deliver structured feedback to annotators, conduct calibration sessions to ensure alignment on guidelines, support Team Leads in coaching low-performing annotators
Guideline Adherence & Improvement: Ensure strict compliance with annotation guidelines and client requirements, flag ambiguous cases and recommend guideline improvements, collaborate with Ops/Training teams to refine SOPs
Process Improvement: Identify trends and recurring quality issues, recommend workflow enhancements to improve accuracy and efficiency, support pilot runs and new workflow validation
Requirements
Bachelor’s degree or equivalent experience
1–2 years experience in QA, data annotation, or BPO operations (preferred)
Strong attention to detail and analytical skills
Experience reviewing datasets (image, text, or video) is a plus
Familiarity with annotation tools (e.g., CVAT, Labelbox, etc.) is an advantage