Scalence L.L.C. is seeking an Azure Data Lake Engineer to enhance their data engineering capabilities. The role focuses on optimizing data feeds, implementing automated solutions, and ensuring data quality while collaborating with the MDL community.
Responsibilities:
- Assess existing MDL data tables and create a structured inventory
- Conduct data feed reviews with the MDL community
- Improve data structures, performance, and documentation
- Support the identification of relevant Marketing & non Marketing data products
- Implement and test new data feeds; ensure quality and consistency
- Align with data stakeholders and support enablement
- Replace manual uploads with automated pipelines
- Develop concepts and PoCs for data quality checks (top 20 tables)
- Execute in depth quality reviews and implement corrective actions
- Document lineage, transformations, and table-level metadata
- Set up data dictionaries, PII-handling concepts, and taxonomy standards
- Contribute to ER model development and artefact standardization
- Coordinate across the MDL community
- Support access requests, platform education, and use-case repository updates
Requirements:
- 3-7 years of experience required
- Strong data engineering background (3–5+ years)
- Proficiency with Azure data lake, SQL, Databricks, and modern data pipelines
- Experience with data lineage, metadata, documentation, and data quality frameworks
- Ability to structure complex datasets and communicate with cross-functional teams
- Experience with SAP Data Lake, SAP Datasphere, BDC, or Collibra
- Background in Marketing data or large-scale data lake optimization