Keystone Recruitment is seeking a detail-oriented Business Analyst to support structured evaluation and annotation workflows focused on quality and accuracy. The role involves performing evaluations, fact-checking information, and providing justifications aligned with established standards.
Responsibilities:
- Perform side-by-side (SxS) evaluations, comparing outputs for quality, accuracy, relevance, and reasoning
- Conduct fact-checking to validate claims and identify inconsistencies
- Provide detailed, objective, and structured justifications for evaluation decisions
- Follow defined evaluation frameworks and quality standards consistently
- Use browser-based tools and extensions to support analysis
- Execute simple command-line instructions when required for workflow support
- Document findings clearly and communicate insights when necessary
Requirements:
- Strong comfort using computers and browser-based tools in a professional setting
- Experience working with browser extensions and online research tools
- Ability to run basic command-line commands (no advanced programming required)
- Strong analytical and critical thinking skills
- High attention to detail with the ability to justify decisions objectively
- Clear written communication skills in English
- Based in North America, Central America, the Caribbean, or South America
- Previous experience in evaluation, annotation, QA, or audit-related roles
- Familiarity with data quality review, content evaluation, or model output assessment
- Background in business analysis, operations, or process improvement