Senior Data Scientist / Data Engineer (AI Evaluator) - $120-$180/hr

Mercor is partnering with a leading AI research lab to improve how frontier AI systems perform complex, real-world data science and data engineering workflows. The role involves creating realistic tasks, defining evaluation criteria, assessing AI-generated work, and revising submissions based on reviewer feedback.

Responsibilities:

• Design highly realistic and challenging data science/engineering tasks (exploratory analyses, ML pipelines, ETL/pipeline design, SQL/Python workflows, and A/B test write-ups)
• Define "what good looks like" by establishing precise, task-specific criteria for complex data deliverables
• Evaluate AI-generated outputs using consistent, evidence-based judgment to ensure assessments are reproducible and defensible
• Iterate on submitted work based on structured feedback from senior reviewers

Requirements:

• You must be currently based in the United States, United Kingdom, Canada, Australia, or New Zealand, and hold a Bachelor's degree from an English-speaking country
• 4+ years of professional Data Science, Data Engineering, or ML experience
• You must have mid-senior to senior experience at a FAANG+ / Magnificent 7+ firm , a top-tier quantitative fund / financial institution, a top consulting firm, or a Fortune 100 company
• Titles such as Applied Scientist, Research Scientist, and ML Engineer also qualify
• Exceptional command of Python, SQL, statistical modeling, machine learning, experimentation, and causal inference
• Proven ability to turn messy, real-world data into rigorous analyses and robust pipelines
• Excellent written English to explain highly technical findings clearly