Data Engineer III

Role Overview

• Design, implement, and maintain scalable and efficient data infrastructure and pipelines
• Extract data from complex and diverse data sources
• Build and manage data repositories
• Design and develop data pipelines to ingest, transform, and load data from various sources into the data ecosystem
• Collaborate with Analytics Engineers and other cross-functional teams to ensure the data infrastructure meets the organization's needs, and support data-driven initiatives and enterprise decision-making
• Write complex SQL queries to move data from various source systems (i.e. flat files, SQL Server databases, XIS files, JSON files, etc.) into the data environments
• Create reconciliation processes to ensure data is loaded into the ODS completely and accurately
• Create error handling and logging processes in the data environments
• Collaborate with Analytics Engineers and Data Owners to understand their data requirements and identify and prioritize opportunities to improve efficiencies and processes through integration
• Design and implement integration flows and enhancements, including APIs and/or file-based integrations
• Monitor performance activities and troubleshoot, resolve, and report integration issues to impacted teams and stakeholders
• Partner with the Analytics Engineers to ensure that the data is properly loaded into the data environments
• Act as a mentor to less experience Data Engineers
• Make necessary optimizations to ensure reliability and efficiency
• Identify and implement data quality and data governance processes to ensure data integrity and compliance with regulatory requirements
• Maintain a customer-first mentality in collaboration with stakeholders, leaders, and fellow engineers.

Requirements

• Bachelor’s degree in Engineering (any field), Information Systems, Computer Science, or a closely related field of study
• Seven (7) years of experience in the job offered or as a SQL Server, Data Warehousing Developer, Mobile Test Engineer or related
• Six (6) years of experience with: SQL Server Integration Services (SSIS) packages; Database structures, data normalization, de-normalization, entity relationships, ODS concepts, data loading issues, and best practices; Data Warehousing concepts, dimensional modeling, and columnar databases; Programming languages including Python, Java, Scala and SQL; Cloud-based data platforms such as AWS, Azure and Google Cloud; Data modeling, database design principles, and ETL/ELT processes; and Microsoft Excel including utilizing functions such as V-Lookup, H-Lookup, Concatenating formulas and Pivot tables.
• Three (3) years of experience with: Financial Technology and Reporting products: ERP, EPM, and FP&A.

Tech Stack

• AWS
• Azure
• Cloud
• ERP
• ETL
• Java
• Python
• Scala
• SQL
• SSIS

Benefits

• Telecommuting permitted