Software Engineer - AI Research Annotation

Keystone Recruitment is seeking a Software Engineer specializing in AI Research Annotation. The role involves applying software engineering expertise to enhance model reasoning by reviewing AI-generated code and documenting problem-solving processes.

Responsibilities:

• Review AI-generated code trajectories on SWE-bench style tasks
• Reconstruct step-by-step reasoning explaining solution approaches
• Annotate decision points, debugging strategies, and technical choices
• Use full codebase context (issues, tests, PRs) for accurate documentation
• Ensure annotations reflect authentic software engineering practices

Requirements:

• 2+ years hands-on software development experience
• Strong proficiency in Python, JavaScript/TypeScript, or similar languages
• Experience debugging complex codebases and resolving issues
• Familiarity with Git workflows, pull requests, and issue tracking
• Ability to articulate technical reasoning clearly in writing
• Computer Science/Software Engineering degree (Bachelor's+)
• Experience with open-source contributions or repository analysis
• Understanding of software development lifecycles and testing
• Comfort working with technical documentation and specifications