Stott and May is collaborating with a digital client to hire an experienced Data Engineer for the development and optimization of an Azure-based data platform. The role involves building and enhancing data pipelines, designing ELT processes, and collaborating with various teams to ensure performance and reliability.
Responsibilities:
- Build and enhance pipelines using ADF, Databricks, Synapse / Fabric
- Design ELT for analytics and downstream consumption
- Work with large structured and semi structured datasets
- Collaborate with analytics, platform, and product teams
- Support performance, reliability, and cost optimization
- Contribute to Azure lakehouse / warehouse architecture
Requirements:
- Strong Azure Data Engineering experience
- Production ADF and/or Synapse / Fabric
- Databricks with Spark or PySpark
- Solid Azure platform knowledge (ADLS, Key Vault, IAM, networking)
- Strong SQL and Python
- Agile delivery experience
- dbt exposure
- Streaming / near real-time data
- ML or data science support
- Terraform or Bicep