Key skills
AzureCloudETLPySparkPythonSparkSQLAIMachine LearningELTBIPower BIDatabricks
About this role
Role Overview
- Design and lead scalable, cloud-native data platforms
- Build high-performance pipelines using Python and SQL
- Collaborate with machine learning teams
- Emphasize architecture, governance, and best practices
- Create robust ETL/ELT pipelines
- Lead projects focusing on data architecture and AI-driven data workflows
Requirements
- 7+ years of experience in supporting ETL and ELT development
- Experience with Azure Fabric, Databricks, Azure OneLake, Spark, Delta Lake
- Skills in data architecture, Azure Data Bricks, Azure Synapse, PySpark, SQL
- Knowledge of Delta Lake concepts, Power BI, Azure Data Factory (ADF)
- Proficiency in Python, SQL ETL/ELT strategy, and orchestration
- Preferred degree in Computer Science/Information Technology
Tech Stack
- Azure
- Cloud
- ETL
- PySpark
- Python
- Spark
- SQL