Azure Databrick Engineer

Polar IT is seeking an Azure Databrick Engineer for a remote position. The role involves integrating ETL pipelines into Databricks, supporting data warehousing, and optimizing SQL-based ETL processes.

Responsibilities:

• Integrating ETL pipelines into Databricks for transformation/analytics
• Supporting operational and analytics workloads
• Clear documentation of schemas, ETL flows, and data mappings
• Building, optimizing, and supporting SSIS-based ETL pipelines
• Writing complex SQL / T‑SQL (stored procedures, functions, performance tuning)
• Troubleshooting ETL failures and performance bottlenecks

Requirements:

• Native Databricks technologies
• Metadata-driven ingestion framework
• Databricks Integration Experience - Integrating ETL pipelines into Databricks for transformation/analytics
• Databricks notebooks, Spark workloads, or structured pipelines
• Data warehouse design (facts/dimensions, ingestion patterns)
• Supporting operational and analytics workloads
• Clear documentation of schemas, ETL flows, and data mappings
• SQL + SSIS development skills
• Building, optimizing, and supporting SSIS-based ETL pipelines
• Writing complex SQL / T‑SQL (stored procedures, functions, performance tuning)
• Troubleshooting ETL failures and performance bottlenecks
• Azure Databricks strongly preferred
• Healthcare experience is preferred