Crossing Hurdles is seeking a STEM Master’s/Ph.D. Research Report Evaluator. The role involves evaluating AI-generated research reports, annotating them, and providing evidence-based justifications for evaluations.
Responsibilities:
- Evaluate AI-generated research reports across multiple domains
- Read and understand research queries to assess report intent and scope
- Annotate reports using PDF tools (e.g., Adobe Acrobat), highlighting key evidence
- Identify issues such as weak sources, broken links, and inconsistencies
- Score reports across multiple quality dimensions using a structured rubric
- Provide clear, evidence-based written justifications for evaluations
- Submit annotated reports and evaluation results via provided tools
Requirements:
- Graduate student (Master's or PhD candidate)
- 1–3 years of experience in a relevant or adjacent domain
- Strong English reading comprehension and writing skills
- Experience reading research papers, white papers, or analytical reports
- Familiarity with domains such as technology, healthcare, education, science, economics, or social sciences
- Comfortable using PDF annotation tools and online survey platforms
- Strong attention to detail and ability to provide structured feedback
- Experience with evaluation, annotation, or data labeling tasks is a plus