Key skills
AICollaboration
About this role
Role Overview
- Evaluate AI outputs related to finance, investment, and economic content
- Perform structured scoring, comparison, classification, and judgment tasks
- Assess factual accuracy, numerical correctness, relevance, and risk
- Identify hallucinations, misleading financial guidance, unsupported claims, or regulatory concerns
- Validate and refine evaluation rubrics and edge-case handling
- Perform adjudication where raters disagree
- Conduct error analysis and qualitative reviews of model behavior
- Partner with LILT research, product, and customer teams on evaluation design
- Support red-teaming, financial risk analysis, and model readiness assessments
Requirements
- Native or professional fluency in one or more supported languages is required
- English fluency is required for guidelines, feedback, and collaboration
- Deep domain expertise in finance, investment, or economics
- Strong judgment and ability to apply criteria consistently
- Comfort working with structured evaluation workflows
- Ability to explain reasoning clearly, especially in ambiguous or high-risk cases
- Reliability, professionalism, and respect for quality standards
Benefits
- Compensation communicated upfront per project or task type
- Flexible participation on a contract basis
- Opportunities for recurring work based on performance and demand