Senior C Software Engineer (AI Evaluation)

The UVA VEC is focused on a high-impact AI initiative aimed at enhancing the reliability and performance of conversational systems. They are seeking a Senior C Software Engineer to evaluate AI-generated C programming tasks, validate outputs, and ensure technical accuracy in systems-level programming contexts.

Responsibilities:

• Evaluate AI-generated responses to C programming and systems-level engineering tasks for correctness and reasoning quality
• Execute and test code to validate outputs and ensure functional accuracy
• Analyze memory usage, pointer safety, and performance characteristics
• Identify bugs, undefined behavior risks, and edge case failures
• Annotate responses with detailed feedback on accuracy and clarity
• Assess algorithmic efficiency and low-level implementation quality
• Ensure explanations align with best practices in systems programming
• Apply standardized evaluation frameworks, benchmarks, and taxonomies

Requirements:

• Bachelor's, Master's, or PhD in Computer Science or a related field
• 5+ years of professional experience in software engineering or systems programming
• Advanced proficiency in C, including memory management and pointer operations
• Strong understanding of operating systems concepts and low-level debugging
• Ability to independently solve medium to hard-level algorithmic problems
• Experience compiling, running, and debugging code in real environments
• Strong analytical skills for evaluating correctness, efficiency, and safety
• Familiarity with large language models and their strengths and limitations
• High attention to detail and structured evaluation approach
• Fluent English communication skills
• Experience contributing to open-source projects with accepted pull requests
• Exposure to model evaluation, RLHF, or data annotation workflows
• Background in competitive programming or technical assessments
• Experience reviewing production-level or systems codebases
• Familiarity with multiple programming paradigms or ecosystems
• Ability to explain complex low-level concepts to non-technical audiences