Java Software Engineer | Remote

Crossing Hurdles is seeking a Software Engineer for Code QA to craft developer prompts and evaluate AI outputs. The role involves collaborating with research teams and applying software engineering expertise to ensure quality and consistency of evaluation tasks.

Responsibilities:

• Craft realistic, chat-style developer prompts covering code review, debugging, error diagnosis, configuration, and related scenarios
• Source and adapt real pull requests and engineering discussions to create authentic evaluation tasks
• Write clear, technically accurate model responses that demonstrate strong reasoning and explanation quality
• Evaluate AI outputs based on logic, clarity, and technical judgment rather than executable correctness
• Apply software engineering expertise to ensure prompts and responses reflect real-world developer workflows
• Contribute to structured evaluation datasets used to assess AI reasoning and communication quality
• Collaborate asynchronously with research teams to refine task quality and consistency

Requirements:

• Strong experience in software engineering, technical research, or educational content development
• Bachelor's degree in Software Engineering, Computer Science, or a related field
• Strong proficiency in one or more languages such as Python, JavaScript, Java, or C++
• Hands-on experience with debugging, testing, and validating code
• Strong technical writing skills with high attention to detail
• Ability to work independently in a fully remote, project-based environment