About this role
Mendable is a company focused on providing efficient web data extraction solutions. They are seeking a Research Engineer specializing in Search/Information Retrieval (IR) to own and enhance the search and indexing systems that are critical to their product Firecrawl.
Responsibilities:
- Build and operate search indexes at massive scale
- Design, build, and maintain the indexing infrastructure that powers Firecrawl's core product
- You'll handle billions of documents and care about every millisecond of latency and every byte of storage
- Own the full stack from ingestion to serving
- Ingestion, processing, indexing, ranking, query understanding, and serving
- When something breaks at 3am, you know where to look because you built it
- Solve ranking, relevance, and query understanding
- Make sure the right content surfaces for the right queries
- You'll build and iterate on ranking models, relevance scoring, and query parsing systems that directly impact product quality
- Tackle freshness, dedup, and incremental indexing
- You'll build systems that keep our index fresh without re-crawling everything, deduplicate content intelligently, and handle incremental updates at scale without rebuilding from scratch
- Run experiments and ship results to production
- You design experiments, measure results rigorously, and ship winners to production fast
- Collaborate closely with the team
- Work directly with the RL-focused Research Engineer and the engineering team to connect search/IR improvements with model training and the broader product roadmap