Senior Data Engineer

Diverse Lynx is seeking a Senior Data Engineer for a long-term remote contract based in Minneapolis, Minnesota. The role focuses on developing data pipelines and solutions using Databricks, Azure services, Microsoft Fabric, SQL, Python, PySpark, Power BI, and data modeling techniques, including AI-driven insights and data virtualization.

Responsibilities:

• Databricks, Azure Data Factory, Databricks workflows, PySpark, Python, Databricks SQL, SQL ,Microsoft Fabric ,Azure Synapse Analytics, Power BI
• Config driven data pipelines
• Databricks Genie conversational tool for AI driven insights using no code/low-code and code completion options using GitHub Copilot
• Data Modeling: Star Schema and Snowflake Schema
• Open table formats: Delta Lake and Iceberg
• Cloud technologies: Azure is preferred
• Data virtualization schemes

Requirements:

• Microsoft Fabric
• Azure Synapse Analytics
• Azure Data Factory (ADF)
• SQL
• Power BI
• Databricks, Databricks workflows, PySpark, Python, Databricks SQL
• Data Modeling
• Open table formats: Delta Lake and Iceberg
• Data virtualization schemes
• Databricks, Azure Data Factory, Databricks workflows, PySpark, Python, Databricks SQL, SQL ,Microsoft Fabric ,Azure Synapse Analytics, Power BI
• Config driven data pipelines
• Databricks Genie conversational tool for AI driven insights using no code/low-code and code completion options using GitHub Copilot
• Data Modeling: Star Schema and Snowflake Schema
• Cloud technologies: Azure is preferred