Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks, and other relevant services
Develop and maintain the company's data architecture, including data models, schemas, and data dictionaries
Integrate data from various sources, ensuring data quality and consistency, and prepare it for analytical and operational use
Follow consistency of data governance policies and processes to ensure data security, privacy, and compliance
Collaborate with other data professionals, including data scientists, analysts, and business team members, to understand data requirements and develop solutions to meet those needs
Stay up to date with the latest tools and technologies and see opportunities to enhance Manulife's data infrastructure
Requirements
4 or more years of relevant industry experience as Data Engineer
Experience in building and operationalizing Data pipelines in cloud MS Azure using Azure Data Factory, Azure Databricks
Experience in automating data pipelines and familiarity with DevOps and CICD pipelines
Good working knowledge on MS azure services (SQL Queries, ADLS gen 2, ADF, Databricks, Synapse, SQL Server)
Good knowledge of data warehousing concepts and relational data modelling
Familiarity with programming in both compiled languages (Java, Scala) and scripting languages (Python, SQL, R)
Understanding of Agile scrum methodologies and experience of working in an Agile team
Amenable to work on a hybrid set-up (3x onsite per week)
Amenable to work on a night shift schedule (with flexibility for mid shift depending on business need)