CRB is a firm specializing in innovative solutions for life sciences and food and beverage industries. They are seeking a Senior Data Engineer to assist in delivering internal data and business intelligence initiatives, design and implement ETL processes, and develop data models to enhance organizational value.
Responsibilities:
- Elicit data related business requirements from stakeholders and develop or approve associated technical specifications
- Design, implement, and maintain ETL processes to facilitate warehousing and systems integration needs
- Develop and enhance data models to deliver value to the organization
- Maintain, monitor, optimize, and troubleshoot/resolve issues with existing processes
- Contribute to the development of standard methods and best practices for the transformation and preparation of data for reporting, analytics, and self-service activities
- Contribute to reporting and visualization projects as needed
- Apply data team best practices regarding documentation, access, and security
- Participate in discipline related internal and external project communication and coordination
- Implement data quality checks and validation processes
- Incorporate data classification into ETL processes and data masking techniques to ensure model security
- Elicit and participate in code reviews with other members of the team
- Ensure the accuracy, completeness, and reliability of data used for analysis
- Design and implement robust data architectures to support scalable and maintainable data pipelines
- Research and adopt new technologies and methodologies to keep the data infrastructure modern and efficient
- Develop strategies for integrating data from disparate sources into a cohesive and comprehensive data ecosystem
- Automate data processes to improve efficiency and reduce manual intervention
- Ensure compliance of data protection regulations and ensure confidentiality of sensitive information
- Mentor junior data engineers and contribute to their professional growth within the organization
- Travel as required for project development and execution
Requirements:
- Bachelor's Degree or equivalent experience
- 7+ years of experience working with Microsoft SQL databases and warehousing tools, including SQL Server, Azure SQL, and Synapse SQL
- 7+ years of experience developing ETL processes using Microsoft technologies, such as SSIS, Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric
- 7+ years' experience developing Microsoft Analysis Services Tabular, Power BI, or Fabric semantic data models
- Experience leveraging medallion architecture design patterns
- Proficiency using Azure Gen2 Storage, Synapse, Fabric, Spark Notebooks, REST API's, Databricks and related technologies
- Expert proficiency in Data Warehousing methodologies and concepts to store and model the data (Kimball)
- Expert proficiency authoring SQL queries, tables, views, stored procedures, and functions
- Experience using software development management tools such as Azure DevOps
- Experience using Python and PowerShell required
- Extreme attention to detail and accuracy a must
- Excellent verbal/written communication skills required
- Comfortable working and collaborating within a fully remote team
- Experience with provisioning data related resources and components in Azure preferred
- Experience with Redgate Monitoring or Azure Log Analytics is a plus
- Familiarity with D365 ERP modules (e.g., Finance and Operations, Customer Engagement) preferred
- Understanding of D365 data structures, entities, and integration points preferred
- Experience with R language preferred
- Microsoft DP-203 Certification is a plus