Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks, and other relevant services
Develop and maintain the company's data architecture, including data models, schemas, and data dictionaries.
Integrate data from various sources, ensuring data quality and consistency, and prepare it for analytical and operational use
Follow consistency of data governance policies and processes to ensure data security, privacy, and compliance.
Collaborate with other data professionals, including data scientists, analysts, and business team members, to understand data requirements and develop solutions to meet those needs.
Stay up to date with the latest tools and technologies and see opportunities to enhance Manulife's data infrastructure.
Ability to learn and implement best practices of big data and cloud computing to ensure solutions are scalable, efficient, and effective.
Requirements
4 or more years of relevant industry experience as Data Engineer
Experience in building and operationalizing Data pipelines in cloud MS Azure using Azure Data Factory, Azure Databricks.
Experience in automating data pipelines and familiarity with DevOps and CICD pipelines
Good working knowledge on MS azure services (SQL Queries, ADLS gen 2, ADF, Databricks, Synapse, SQL Server) to design a data ecosystem.
Good knowledge of data warehousing concepts and relational data modelling
Familiarity with programming in both compile languages (Java, Scala) and scripting languages (Python, SQL, R)
Understanding of Agile scrum methodologies and experience of working in an Agile team, with exposure to and working understanding of collaboration tools like Teams, JIRA, Mural
Experience in Data processing, performance analysis, tuning and capacity planning
Tech Stack
Azure
Cloud
ETL
Java
Python
Scala
SQL
Benefits
health, dental, mental health, vision, short
and long-term disability, life and AD&D insurance coverage
adoption/surrogacy and wellness benefits
employee/family assistance plans
various retirement savings plans (including pension and a global share ownership plan with employer matching contributions)
financial education and counseling resources
generous paid time off program including holidays, vacation, personal, and sick days