Azure Data Lake Engineer

Diverse Lynx is a company focused on providing equal employment opportunities and promoting a diverse workforce. They are seeking an Azure Data Lake Engineer to optimize data feeds, enhance data structures, and ensure data quality through automation and documentation.

Responsibilities:

• Data Feed Review & Optimization
• Assess existing MDL data tables and create a structured inventory
• Conduct data feed reviews with the MDL community
• Improve data structures, performance, and documentation
• Support the identification of relevant Marketing & non Marketing data products
• Implement and test new data feeds; ensure quality and consistency
• Align with data stakeholders and support enablement
• Replace manual uploads with automated pipelines
• Develop concepts and PoCs for data quality checks (top 20 tables)
• Execute in depth quality reviews and implement corrective actions
• Document lineage, transformations, and table-level metadata
• Set up data dictionaries, PII-handling concepts, and taxonomy standards
• Contribute to ER model development and artefact standardization
• Coordinate across the MDL community
• Support access requests, platform education, and use-case repository updates

Requirements:

• Strong data engineering background (3–5+ years)
• Proficiency with Azure data lake, SQL, Databricks, and modern data pipelines
• Experience with data lineage, metadata, documentation, and data quality frameworks
• Ability to structure complex datasets and communicate with cross-functional teams
• Experience with SAP Data Lake, SAP Datasphere, BDC, or Collibra
• Background in Marketing data or large-scale data lake optimization