About this role

Develop scalable scrapers.
Define resilient scraping strategies, unblock websites for scraping.
Improve observability in the system.
Develop back-end solutions for scraping & parsing problems of various magnitudes.
Maintain the current system and develop new features related to scraping & parsing.

Experience working with Python.
Understanding of computer science, including data structures, algorithms, computability and complexity.
Version Control skills using Git.
Knowledge on how to unblock websites for scraping.
Is able to use different scraping techniques & open-source tools to build scrapers.
Is comfortable with using Dev Tools.
Network (TLS/SSL) knowledge.
Worked with browser automations.
Knows their way around asynchronous programming.
Nice to have:
Web development knowledge.
Knows how to use CSS Selectors / XPaths for parsing.
Experience working with Go & C++.
Worked on browser source code.
Knowledge of any front-end framework.
Experience working with Pydantic, FastAPI, SQLAlchemy.
Has experience working with Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana and monitoring tools like Grafana, Prometheus.
Experience with machine learning that is scraping domain-specific.
Has experience in building scalable systems.

Web Scraping Engineer, Python

Key skills