Key skills
Python web scrapingData extraction expertiseData processingLLMsEnglish proficiencySelf-directed work ethicJavaScriptPythonAIData EngineeringSelenium
About this role
Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project and drive specialized data scraping workflows within their hybrid AI + human system. In this freelance role, you'll handle data scraping tasks requiring technical precision for web extraction and processing, ensuring accuracy and reliable delivery of structured datasets.
Responsibilities:
- Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets
- Leverage internal tools (Apify, OpenRouter) alongside custom workflows to accelerate data collection, validation, and task execution while meeting defined requirements
- Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript-rendered content and changing site behavior
- Enforce data quality standards through validation checks, cross-source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery
- Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes
Requirements:
- At least 1 year of relevant experience in data analysis, AI automation, data engineering, or software development is desirable
- Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus
- Python web scraping: Build reliable scraping scripts using BeautifulSoup, Selenium (or equivalents) for multi-level sites, dynamic JS content (infinite scroll, AJAX), and API endpoints via provided proxy
- Data extraction expertise: Navigate complex hierarchical structures (regions → companies → details), handling archived pages and varied HTML formats
- Data processing: Clean, normalize, and validate scraped data; deliver high-quality datasets in well-structured formats (CSV, JSON, Google Sheets) with clear, consistent presentation
- Hands-on experience with LLMs and AI frameworks to enhance automation and problem-solving
- Strong attention to detail and commitment to data accuracy
- Self-directed work ethic with ability to troubleshoot independently
- English proficiency: Upper-intermediate (B2) or above (required)