Lead the team that manually codes grants and organizations using Candid’s taxonomy, the Philanthropy Classification System, with a focus on scaling operations and improving classification accuracy and consistency.
Partner with subject matter experts to develop and maintain additional ontologies, taxonomies, and semantic models that enable knowledge representation and reasoning across applications, including AI applications.
Design and implement quality control processes and metrics to ensure coding quality and strong inter-rater reliability, including guidance for handling ambiguous edge cases.
Monitor and address data quality drift, including maintaining annotator calibration and detecting shifts in labeling standards over time.
Collaborate with Candid’s data science team to evaluate AI models (including LLMs) used for autocoding tasks.
Coordinate efforts to generate the training data needed to build effective AI/ML solutions.
Build strong relationships with key teams across Candid to understand how knowledge engineering can support their needs and advance desired outcomes.
Requirements
7+ years of experience in taxonomy development, data annotation operations, knowledge management, or related fields
3+ years managing teams that perform manual data coding, classification or annotation work
Proven experience designing and implementing taxonomies, ontologies, or classification systems used across multiple applications
Experience designing annotation guidelines or codebooks that achieve high inter-annotator agreement
Demonstrated ability to balance quality with throughput when scaling coding operations
Demonstrated ability to translate complex domain knowledge into structured frameworks
Experience working cross-functionally with technical teams, product managers, and subject matter experts
Excellent communication skills across technical and non-technical audiences
Experience with AI/ML applications and their use in classification or coding tasks
Familiarity with semantic web technologies, knowledge graphs, or linked data
Experience with data annotation and training data generation for machine learning models
Background in the nonprofit or philanthropic sector a bonus
Willingness to perform other duties and special projects as needed/requested.
Benefits
Health insurance (medical, dental, vision)
Retirement contribution with additional option for a match
Paid life insurance and AD&D
Paid leave time (PTO, compassionate leave, volunteer, holiday, parental)
Short-term and long-term disability
Pre-tax transit
Flexible spending accounts
Supplemental insurance
Summer hours
Public Service Loan Forgiveness (PSLF) program eligible employer