Software Engineering, Part-Time AI Evaluation - Remote (United States)

OpenTrain AI connects experienced professionals with paid, part-time AI training work. In this role, software engineers create realistic coding tasks, evaluate AI-generated solutions, develop reference solutions, and document and review technical work.

Responsibilities:

• Build reproducible environments and realistic coding tasks for bug fixes, new features and legacy-code improvements
• Analyze defects and performance bottlenecks across varied codebases, then judge whether the AI's solution handles them correctly
• Implement maintainable reference solutions that improve clarity, efficiency and reliability
• Document your technical reasoning and review other contributors' code and submissions for accuracy and clarity

Requirements:

• Significant hands-on expertise in at least one of Python 3, Java, Rust, Go, C++ or TypeScript
• Strong understanding of algorithms, data structures and software engineering principles, with the ability to debug complex systems, resolve defects, improve performance and refactor large or legacy codebases
• Professional fluency in English and the ability to explain technical concepts and document engineering decisions clearly