Research Engineer - Benchmarks

Firecrawl is an AI infrastructure company that converts web content into data for AI agents. The Research Engineer will independently design, operate, and publish rigorous weekly benchmarks of data providers, owning datasets, ground truth, scoring, automation, and public releases. The role will also integrate benchmark results into Alexandria’s provider-selection system.

Responsibilities:

• Design and run head-to-head benchmarks of data providers against verified ground truth. For example:
• Build and maintain the test datasets and ground truth, and keep them from going stale or leaking
• Own the automated harness and the weekly benchmark release. Every run has to be reproducible, versioned, and defensible
• Measure what buyers actually care about: accuracy, coverage, freshness, speed, and cost
• Work with marketing to ship public leaderboard pages that are useful and hold up under scrutiny
• Close the loop into Alexandria so benchmark results change which provider gets called for what
• Keep expanding the categories we benchmark, inside Alexandria and beyond it