Generalist AI Evaluation Specialist

The UVA VEC is seeking highly analytical professionals to join their cutting-edge AI research initiative as Generalist Experts. In this role, you will evaluate AI-generated responses, assess reasoning quality, and provide structured feedback to improve the performance of advanced AI systems.

Responsibilities:

• Review and evaluate AI-generated responses across a wide range of topics
• Assess reasoning quality, factual accuracy, clarity, and completeness
• Identify logical gaps, inconsistencies, and areas for improvement
• Provide detailed written feedback supported by evidence and clear rationale
• Apply evaluation frameworks and guidelines consistently across tasks
• Contribute to the development of safer, more reliable AI systems