ApacheAzureETLPySparkPythonSparkSQLELTData EngineeringData WarehousingData LakeDatabricksApache SparkAzure SQLBlob StorageCollaborationRemote Work
About this role
Role Overview
Design, develop, and maintain scalable data pipelines using Microsoft Azure and Databricks (Spark).
Build and optimize ETL/ELT workflows in Databricks, leveraging PySpark and SQL for large-scale data processing.
Integrate and land various data sources—including internal, licensed third-party, and public datasets—into the global data lake.
Develop and maintain Delta Lake architectures to ensure reliable, high-performance data storage and processing.
Collaborate with business analysts, data scientists, and engineering teams to define data requirements and deliver high-quality data products.
Use Python and SQL to automate data ingestion, transformation, and validation processes.
Monitor, troubleshoot, and optimize Databricks jobs and clusters for performance, scalability, and cost efficiency.
Implement data quality, governance, and security best practices across the platform.
Participate in documentation, code reviews, and knowledge sharing across a global team.
Requirements
5+ years of professional experience in data engineering or similar roles.
Strong hands-on experience with Databricks, including Apache Spark (PySpark/SQL) and Delta Lake.
Proven experience building scalable data pipelines in Azure (ADF, Synapse, Blob Storage, Azure SQL, Functions, etc.).
Proficiency in Python and SQL for data engineering and transformation tasks.
Experience working with large-scale, distributed data processing systems.
Solid understanding of data modelling, data warehousing, and modern data lake architectures.
Experience integrating multiple data sources, including structured and unstructured data.
Strong problem-solving, documentation, and collaboration skills.
Tech Stack
Apache
Azure
ETL
PySpark
Python
Spark
SQL
Benefits
Digital-First Approach: Great talent knows no borders! You can work from wherever you are — we hire and collaborate with professionals worldwide.
Remote Work Model: Balance your professional and personal life with our flexible working conditions, empowering you to deliver your best from anywhere.
Exciting Projects: Dive into impactful projects across industries that challenge and spark creativity.
Boost Your Expertise: Grow your career with continuous learning, development opportunities, and hands-on experience.
Join the Best Team Ever: Collaborate with our diverse and cross-cultural team of passionate technologists and creative thinkers.