The UVA VEC is focused on a high-impact AI evaluation initiative aimed at enhancing the reliability and performance of conversational systems in software engineering. The Senior Go Software Engineer will analyze AI-generated code, validate correctness, and provide feedback to improve system performance.
Responsibilities:
- Evaluate AI-generated responses to coding and software engineering problems
- Execute and validate code to verify correctness and performance
- Identify logical errors, inefficiencies, and edge case failures
- Annotate outputs with detailed feedback on strengths and weaknesses
- Assess code readability, maintainability, and algorithmic soundness
- Perform fact-checking using reliable technical references
- Apply standardized evaluation frameworks and scoring guidelines
- Ensure outputs align with expected engineering and conversational standards
Requirements:
- 5+ years of professional experience in software engineering or related fields
- Strong expertise in Go programming language
- Ability to solve medium to hard algorithmic problems independently
- Experience executing, testing, and debugging production-level code
- Strong understanding of data structures, algorithms, and system design principles
- High attention to detail in reviewing technical reasoning and outputs
- Fluent English communication skills
- Experience using LLMs in coding workflows and understanding their limitations
- Ability to follow structured evaluation frameworks and guidelines
- Bachelor's degree or higher in Computer Science or related discipline
- Experience contributing to open-source projects with accepted contributions
- Familiarity with multiple programming languages or paradigms
- Experience in model evaluation, RLHF, or data annotation
- Background in competitive programming or technical assessments
- Experience reviewing code in production environments
- Ability to explain complex technical concepts clearly to varied audiences