Building and maintaining robust and scalable data pipelines that automate the collection, transformation, and storage of data from various sources
Ensuring seamless integration of data from different sources into a unified data warehouse or data lake, facilitating easy access and analysis
Designing, implementing, and managing databases and data storage solutions that can handle large volumes of data efficiently
Putting in place systems and resources to secure the correctness, uniformity, and safeguarding of data company-wide
Monitoring system performance and making improvements as needed to ensure data systems are running efficiently and effectively
Working with data scientists, analysts, and other collaborators to understand data requirements and deliver solutions that meet business needs
Staying up to date with emerging technologies and tools in data engineering and recommending their adoption where appropriate to improve data processes and infrastructure
Requirements
5 to 7 years of experience in data engineering or a related field
3 to 5 years of experience in developing and managing Azure Data Pipelines
demonstrable experience with Databricks, including building and maintaining data pipelines
proficient in ETL (Extract, Transform, Load) processes and standard methodologies
experience with Informatica for data integration and transformation tasks
proficiency in using reporting tools like Power BI and Cognos for data visualization and reporting
solid understanding of data architecture and database management systems
strong programming skills in languages such as Python, SQL, or Scala
excellent problem-solving abilities and attention to detail
ability to work collaboratively in a team-oriented setting and communicate effectively with technical and non-technical collaborators
experience with data quality and data governance practices to ensure data integrity and security across the organization
familiarity with performance monitoring and optimization techniques for large-scale data systems
Tech Stack
Azure
Cognos
ETL
Informatica
Python
Scala
SQL
Benefits
health, dental, mental health, vision insurance
short
and long-term disability coverage
life and AD&D insurance
adoption/surrogacy and wellness benefits
employee/family assistance plans
retirement savings plans (including pension and global share ownership plan with employer matching contributions)
financial education and counseling resources
generous paid time off program in Canada including holidays, vacation, personal, and sick days