Data Engineer W2 candidates only

Mega Cloud Lab is looking for a Data Engineer to join their team. The role involves building and managing data pipelines, utilizing tools like Databricks and Azure Data Factory, and implementing data modeling techniques such as Star Schema and Snowflake Schema.

Responsibilities:

• Config driven data pipelines
• Databricks Genie conversational tool for AI driven insights using no code/low-code and code completion options using GitHub Copilot
• Data Modeling: Star Schema and Snowflake Schema
• Open table formats: Delta Lake and Iceberg
• Cloud technologies: Azure is preferred
• Data virtualization schemes

Requirements:

• 6+ Years Databricks
• Azure Data Factory
• Databricks workflows
• PySpark
• Python
• Databricks SQL
• Config driven data pipelines
• Databricks Genie conversational tool for AI driven insights using no code/low-code and code completion options using GitHub Copilot
• Data Modeling: Star Schema and Snowflake Schema
• Open table formats: Delta Lake and Iceberg
• Data virtualization schemes
• Cloud technologies: Azure