Design, implement, maintain and enhance data integrations in Databricks and Azure Data Factory.
Merge and cleanse data to provide a reliable and curated data layer.
Engage effectively and proactively with multiple stakeholders to understand requirements.
Assess and implement suitable data solutions to meet business needs.
Maintain a comprehensive documentation suite for our data engineering implementations and provide training where necessary to support team members and stakeholders to self-serve their own usage of the data and MI/Reporting.
Monitor batch and act on failures, identifying root causes.
Refine business requirements into development tasks, estimating their complexity and dependencies.
Requirements
Strong analytical skills with a focus on data.
A code-first approach.
Understanding of continuous integration/continuous development principles.
Experience with data engineering principles (data ingestion, data transformation, etc.)
Proficiency in TSQL.
Experience working with Microsoft Azure Data Lake Storage, Microsoft Azure Data Factory, Databricks.
Familiarity with team collaboration, both in person and in code.
Immense curiosity, high energy and desire to go the extra mile to make a difference; Good communication skills.
Fluent in English, verbally and written.
A Computer Science degree or data related qualification (nice to have).
Experience with PowerBI platforms or similar; Hands-on experience in the Insurance Sector or Financial Services (nice to have).