System Engineer | $30/hr Remote

Crossing Hurdles is looking for a STEM Master’s/Ph.D. Research Report Evaluator to evaluate AI-generated research reports across multiple domains. The role involves annotating reports, identifying issues, and providing evidence-based justifications for evaluations.

Responsibilities:

• Evaluate AI-generated research reports across multiple domains
• Read and understand research queries to assess report intent and scope
• Annotate reports using PDF tools (e.g., Adobe Acrobat), highlighting key evidence
• Identify issues such as weak sources, broken links, and inconsistencies
• Score reports across multiple quality dimensions using a structured rubric
• Provide clear, evidence-based written justifications for evaluations
• Submit annotated reports and evaluation results via provided tools

Requirements:

• Graduate student (Master's or PhD candidate)
• 1–3 years of experience in a relevant or adjacent domain
• Strong English reading comprehension and writing skills
• Experience reading research papers, white papers, or analytical reports
• Familiarity with domains such as technology, healthcare, education, science, economics, or social sciences
• Comfortable using PDF annotation tools and online survey platforms
• Strong attention to detail and ability to provide structured feedback
• Experience with evaluation, annotation, or data labeling tasks is a plus