Staff Data Engineer

VirtusLab is a company focused on fostering a friendly atmosphere and providing self-development opportunities. They are seeking a Staff Data Engineer to lead technical initiatives, design scalable data systems, and mentor engineers while engaging with clients to provide technical consulting and solutions.

Responsibilities:

• Proven experience building web crawling or large-scale data systems from scratch
• Strong architectural skills in designing scalable, fault-tolerant distributed systems
• Track record leading complex technical initiatives and driving architecture direction for teams
• Demonstrated ability to evolve production systems incrementally while maintaining reliability
• Experience mentoring engineers at all levels and promoting a collaborative culture
• Deep background in large-scale data engineering (terabytes daily)
• Hands-on experience with cloud data warehouses (BigQuery, Snowflake)
• Experience with Apache Kafka, Kubernetes (GKE/EKS), and orchestration tools (Airflow)
• Familiarity with multi-cloud environments (GCP + AWS)
• Expertise in designing and operating ETL/ELT pipelines
• Deep expertise in web crawling technologies and advanced scraping (Scrapy or similar)
• Experience in extracting structured/unstructured web data and SERP extraction
• Knowledge of proxy infrastructure management, anti-bot detection, and ethical crawling
• Familiarity with crawling vendors and AI/LLM-based extraction approaches
• Support the VirtusLab U.S. and international teams by lending senior technical expertise to client-facing activities, including technical discovery sessions, workshops, and solution architecture
• Conduct requirements analysis and solution discovery, identifying business and technical needs
• Provide technical consulting and advisory services, recommending appropriate data architectures aligned with customer goals
• Prepare and review technical sections of commercial offers, including solution descriptions, statements of work (SoWs), project estimates, timelines, and delivery models

Requirements:

• Proven experience building web crawling or large-scale data systems from scratch
• Strong architectural skills in designing scalable, fault-tolerant distributed systems
• Track record leading complex technical initiatives and driving architecture direction for teams
• Demonstrated ability to evolve production systems incrementally while maintaining reliability
• Experience mentoring engineers at all levels and promoting a collaborative culture
• Deep background in large-scale data engineering (terabytes daily)
• Hands-on experience with cloud data warehouses (BigQuery, Snowflake)
• Experience with Apache Kafka, Kubernetes (GKE/EKS), and orchestration tools (Airflow)
• Familiarity with multi-cloud environments (GCP + AWS)
• Expertise in designing and operating ETL/ELT pipelines
• Deep expertise in web crawling technologies and advanced scraping (Scrapy or similar)
• Experience in extracting structured/unstructured web data and SERP extraction
• Knowledge of proxy infrastructure management, anti-bot detection, and ethical crawling
• Familiarity with crawling vendors and AI/LLM-based extraction approaches
• Support the VirtusLab U.S. and international teams by lending senior technical expertise to client-facing activities, including technical discovery sessions, workshops, and solution architecture
• Conduct requirements analysis and solution discovery, identifying business and technical needs
• Provide technical consulting and advisory services, recommending appropriate data architectures aligned with customer goals
• Prepare and review technical sections of commercial offers, including solution descriptions, statements of work (SoWs), project estimates, timelines, and delivery models