Senior Data Engineer
Columbia, TN
Job Summary:
We are seeking a highly experienced Data Engineer with 10+ years of experience. The ideal candidate will have deep expertise in designing, architecting, and building data warehouses from scratch, and hands-on proficiency with both cloud and on-premises data platforms.
Key Responsibilities:
- Lead the design, and implementation of enterprise data warehouses from the ground up.
- Work with business stakeholders to understand insurance data domains such as policies, quotes, and claims.
- Implement end to end data platform migration from On-prem SQL Server to Snowflake.
- Develop and maintain data pipelines, ETL/ELT processes, and data integration workflows using Azure Data Factory (ADF), Databricks, and Storage Accounts and Azure Key Vault.
- Integrate and manage data across multiple sources including MongoDB, DB2, Guidewire Systems and CRM/MDM systems.
- Provide technical leadership, mentoring, and guidance to team members while contributing as an independent contributor.
- Work in Agile development environments, participating in sprint planning, stand-ups, and retrospectives.
- Ensure data quality, governance, and security standards are maintained across all platforms.
Required Qualifications:
- 10+ years of professional experience in data engineering, data warehouse development, or related roles.
- Insurance industry experience, specifically with policies, quotes, claims, or related domains.
- Proven ability to design, architect, and build data warehouses from scratch.
- Hands-on experience with Azure Data Stack:
- ADF (pipelines, orchestration, data flows)
- Databricks
- Storage Accounts
- Key Vaults
- Hands-on experience with Snowflake (SnowSQL, Snowpark, Snow pipe, Streams & Tasks, Dynamic Tables, Cortex AI).
- Experience with On-Prem SQL Server, MongoDB, and DB2.
- Experience in Agile development environments.
- Ability to work independently while providing leadership to projects and teams.