Key skills
ApacheAzureETLPySparkPythonSparkSQLELTData EngineeringData WarehousingData LakeDatabricksApache SparkAzure SQLBlob StorageCollaborationRemote Work
About this role
Role Overview
- Design, develop, and maintain scalable data pipelines using Microsoft Azure and Databricks (Spark).
- Build and optimize ETL/ELT workflows in Databricks, leveraging PySpark and SQL for large-scale data processing.
- Integrate and land various data sources—including internal, licensed third-party, and public datasets—into the global data lake.
- Develop and maintain Delta Lake architectures to ensure reliable, high-performance data storage and processing.
- Collaborate with business analysts, data scientists, and engineering teams to define data requirements and deliver high-quality data products.
- Use Python and SQL to automate data ingestion, transformation, and validation processes.
- Monitor, troubleshoot, and optimize Databricks jobs and clusters for performance, scalability, and cost efficiency.
- Implement data quality, governance, and security best practices across the platform.
- Participate in documentation, code reviews, and knowledge sharing across a global team.
Requirements
- 5+ years of professional experience in data engineering or similar roles.
- Strong hands-on experience with Databricks, including Apache Spark (PySpark/SQL) and Delta Lake.
- Proven experience building scalable data pipelines in Azure (ADF, Synapse, Blob Storage, Azure SQL, Functions, etc.).
- Proficiency in Python and SQL for data engineering and transformation tasks.
- Experience working with large-scale, distributed data processing systems.
- Solid understanding of data modelling, data warehousing, and modern data lake architectures.
- Experience integrating multiple data sources, including structured and unstructured data.
- Strong problem-solving, documentation, and collaboration skills.
Tech Stack
- Apache
- Azure
- ETL
- PySpark
- Python
- Spark
- SQL
Benefits
- Digital-First Approach: Great talent knows no borders! You can work from wherever you are — we hire and collaborate with professionals worldwide.
- Remote Work Model: Balance your professional and personal life with our flexible working conditions, empowering you to deliver your best from anywhere.
- Exciting Projects: Dive into impactful projects across industries that challenge and spark creativity.
- Boost Your Expertise: Grow your career with continuous learning, development opportunities, and hands-on experience.
- Join the Best Team Ever: Collaborate with our diverse and cross-cultural team of passionate technologists and creative thinkers.