Senior Data Engineer – Azure Databricks

Billigence is a boutique data consultancy with global reach, helping organisations transform the way they work with data. They are seeking an experienced Senior Data Engineer to support the delivery of scalable enterprise data pipelines as part of a global engineering team focused on Azure Databricks.

Responsibilities:

• Build and optimise data pipelines within Azure Databricks
• Support migration of existing Azure Synapse notebook pipelines
• Design scalable data models and storage patterns within Delta Lake
• Integrate historical data from on-premise data warehouses
• Build new ingestion pipelines from SQL Server stored procedures
• Implement scalable ingestion frameworks and reusable pipeline patterns
• Collaborate with global data engineering teams across the UK and India
• Contribute to best practices and platform standards for future pipeline development

Requirements:

• Strong experience working as a Data Engineer or Senior Data Engineer
• Hands-on experience with Azure Databricks
• Strong understanding of Delta Lake architecture
• Experience with Azure Synapse, Spark, and modern cloud data platforms
• Strong SQL and experience working with enterprise data systems
• Experience building data pipelines and ETL/ELT frameworks
• Ability to work effectively in distributed global teams
• Experience within Financial Services or regulated industries is beneficial