See's Candies is a leader in the confectionery industry, known for producing high-quality candy and providing superior customer service. They are seeking a Data Engineer to support their enterprise analytics platform by building, maintaining, and enhancing data pipelines and data lake infrastructure within Azure, ensuring reliable data availability for reporting and analytics needs.
Responsibilities:
- Build and manage Data Lake ingestion and staging of data from various disparate sources for analytics and storage purposes using Azure Data Factory
- Design and implement Data Lake lifecycle processes that support effective data provisioning capabilities to support enterprise project requirements
- Implement and manage ELT routines using Azure Data Factory to extract, load, and transform data into Azure SQL Data Warehouse
- Provide Databricks and ML platform support, assisting analysts with data preparation and pipeline integration for advanced analytics use cases
- Prepare, manage, and optimize curated data sets within the data lake and data warehouse to support machine learning, forecasting, and advanced analytics initiatives
- Perform end-to-end data testing and validation to confirm the accuracy, completeness, and integrity of data delivered for analytics and reporting
- Ensure that the business intelligence and analytics platform is accurate, available, performant, and secure
- Diagnose, fix, improve, and automate complex issues across the data and analytics stack to ensure maximum uptime and performance
- Support data analysts by ensuring reliable data pipelines, data availability, and backend support for reporting and analytical models
- Participate in all phases of the analytics project process, including technical requirements gathering, design, development, testing, and implementation
- Provide well-documented data pipelines, infrastructure, and processes with attention to detail
- Responsible for identifying opportunities to enhance technology and innovation that will improve the effectiveness of the data and analytics platform
Requirements:
- Bachelor's degree or higher in Computer Science, Engineering, Technology or related field; equivalent related work experience may be considered in lieu of degree
- Solid knowledge of Azure analytics components such as Azure Data Lake Storage, Azure Data Factory, Databricks, Azure SQL, Synapse / SQL Data Warehouse, Azure Analysis Services, Azure ML and Power BI Services required
- Experience developing Power BI data models and reports
- 4+ years' experience in business data warehouse and analytics / BI architectures, including design and development across multiple technologies and analytical platforms
- 2+ years' experience in analytical development leveraging Azure analytics components end-to-end
- Experience supporting data pipelines, data preparation, or analytical workflows used for machine learning or AI-driven analytics initiatives
- Experience delivering analytics development, including backlog planning, building, testing, and delivery
- Experience working in a retail and/or manufacturing organization; food and beverage experience a plus
- Proven ability to learn new technologies quickly and manage change efficiently, proactively, and in a positive manner