Diverse LynxRemote
Azure Data Lake Engineer
United States of America
Full Time
3 weeks ago
$60 - $65 USD
H1B Sponsor Likely
Key skills
Azure Data LakeSQLDatabricksData LineageMetadata ManagementData Quality FrameworksData EngineeringMarketing DataSAP Data LakeSAP DatasphereCollibraData LakeAzureRepositorySAP
About this role
Diverse Lynx is a company focused on providing data engineering solutions, and they are seeking an Azure Data Lake Engineer. The role involves optimizing data feeds, implementing new data structures, and ensuring data quality and documentation within the organization.
Responsibilities:
- Data Feed Review & Optimization
- Assess existing MDL data tables and create a structured inventory
- Conduct data feed reviews with the MDL community
- Improve data structures, performance, and documentation
- Support the identification of relevant Marketing & non Marketing data products
- Implement and test new data feeds; ensure quality and consistency
- Align with data stakeholders and support enablement
- Replace manual uploads with automated pipelines
- Develop concepts and PoCs for data quality checks (top 20 tables)
- Execute in depth quality reviews and implement corrective actions
- Document lineage, transformations, and table-level metadata
- Set up data dictionaries, PII-handling concepts, and taxonomy standards
- Contribute to ER model development and artefact standardization
- Coordinate across the MDL community
- Support access requests, platform education, and use-case repository updates
Requirements:
- Strong data engineering background (3–5+ years)
- Proficiency with Azure data lake, SQL, Databricks, and modern data pipelines
- Experience with data lineage, metadata, documentation, and data quality frameworks
- Ability to structure complex datasets and communicate with cross-functional teams
- Experience with SAP Data Lake, SAP Datasphere, BDC, or Collibra
- Background in Marketing data or large-scale data lake optimization