Stay up-to-date with best practices and technologies related to data acquisition and web scraping.
Generate data analyses based on captured data or data provided in databases.
Process captured data and make it available for consumption in development and production data stores.
Assist in maintaining and continuously improving data normalization and delivery pipelines.
Perform performance analyses regarding the data being captured and/or made available.
Develop Python scripts to perform web scraping of specific websites as requested by commercial or business teams.
Review the production queue to identify the next site to be mapped, create the corresponding script, test it in the development environment, and validate the collected data.
Collaborate with other areas of the company to understand data needs and ensure acquired datasets meet established requirements.
Validate acquired data to ensure quality and consistency, correcting any errors or inconsistencies identified.
Connect to AWS servers to perform data captures.
Drive continuous improvement of data acquisition processes to increase efficiency and data quality.
Receive and distribute acquisition requests among the team.
Create reports on the progress of requests handled by the acquisition team.
Assist in the development of the acquisition team.
Conduct training for members of the acquisition team.

Data Acquisition Lead

Key skills