Senior Go Software Engineer (AI Evaluation)

The UVA VEC is focused on a high-impact AI evaluation initiative aimed at enhancing the reliability and performance of conversational systems in software engineering. The Senior Go Software Engineer will analyze AI-generated code, validate correctness, and provide feedback to improve system performance.

Responsibilities:

• Evaluate AI-generated responses to coding and software engineering problems
• Execute and validate code to verify correctness and performance
• Identify logical errors, inefficiencies, and edge case failures
• Annotate outputs with detailed feedback on strengths and weaknesses
• Assess code readability, maintainability, and algorithmic soundness
• Perform fact-checking using reliable technical references
• Apply standardized evaluation frameworks and scoring guidelines
• Ensure outputs align with expected engineering and conversational standards

Requirements:

• 5+ years of professional experience in software engineering or related fields
• Strong expertise in Go programming language
• Ability to solve medium to hard algorithmic problems independently
• Experience executing, testing, and debugging production-level code
• Strong understanding of data structures, algorithms, and system design principles
• High attention to detail in reviewing technical reasoning and outputs
• Fluent English communication skills
• Experience using LLMs in coding workflows and understanding their limitations
• Ability to follow structured evaluation frameworks and guidelines
• Bachelor's degree or higher in Computer Science or related discipline
• Experience contributing to open-source projects with accepted contributions
• Familiarity with multiple programming languages or paradigms
• Experience in model evaluation, RLHF, or data annotation
• Background in competitive programming or technical assessments
• Experience reviewing code in production environments
• Ability to explain complex technical concepts clearly to varied audiences