Senior Data Engineer

Role Overview

• Design, develop and test data pipelines to extract, transform, and load data from diverse source systems into target data models and the target location.
• Work with business analysts to define data mapping and transformation rules
• Ensure data accuracy and integrity through testing, validation and quality checks.
• Produce high-level and detailed technical designs, including documentation for all data pipelines.
• Experiment and evaluate emerging solutions, such as agentic AI, to improve the efficiency, accuracy, and automation of data delivery processes.
• Design and implement Azure-based cloud-native solutions using Azure Data Factory, Databricks, Azure Container Apps, and Azure Service Bus.
• Support configuration and maintenance of development and production environments for IRIS data integration projects.
• Maintain CI/CD deployment pipelines in alignment with standards.
• Ensure scalable, secure, and event-driven data integrations aligned with banking and enterprise architecture standards, using templates and tools such as Azure Data Factory, Databricks and RIP (Right Integration Pattern).
• Monitor and maintain data pipelines to ensure alignment with evolving source systems.
• Troubleshoot and resolve issues to maintain reliable operations.
• Participate in Agile development processes including Scrum and Kanban events.
• Support project planning and manage planning dependencies.
• Apply best practices in coding, testing, and deployment including CI/CD pipelines.
• Stay updated with the latest trends in data engineering and suggest process improvements.
• Perform other relevant tasks as assigned.

Requirements

• Bachelor’s degree in computer science/information systems or information technology
• 5 years of experience as an (integration) developer and/or data engineer preferably in the banking sector or financial services sector.
• Strong expertise in the Azure Data Ecosystem, including tools such as Azure Data Factory, Azure Data Lake, Databricks, Azure Blob Storage, and Azure SQL Databases.
• Experience in at least one of five programming languages that ADB uses for data integration: Python, Quarkus (Java), C#, Node.js, Golang.
• Experience in (rest) API programming in an enterprise context.
• Experience in setting up development and production environments, including implementing CI/CD pipelines.
• Hands-on experience with Azure DevOps for version control and deployment automation.
• Ability to collaborate effectively with IT teams to design and deliver robust data integration solutions.
• Excellent communication skills, both written and verbal, in English.
• Familiarity with ITIL practices and experience working within Scrum/Agile frameworks.
• Preferred: Experience with Azure Service Bus, ADB’s Right Integration Pattern (RIP) and/or Quarkus framework for the development of microservices
• Experience with other public cloud providers, such as AWS and OCI
• Experience with the Oracle ecosystem
• Certificates on the Azure platform such as AZ-900 and/or DP-900 and up.

Tech Stack

• AWS
• Azure
• Cloud
• Java
• JavaScript
• Microservices
• Node.js
• Oracle
• Python
• SQL
• Go

Benefits

• Career Stability: Enjoy a stable career path with ample project opportunities.
• Immediate Coverage: Private HMO and insurance benefits from day one.
• Jubilee Celebration: A 5-year milestone includes a complimentary trip to any European ERNI sites.
• Comprehensive Benefits: Government-mandated benefits including 13th-month pay.
• Skill Enhancement: Access free training and certifications.
• Baby Basket: To welcome your newborn to the ERNI family.
• Fruit Basket: Boost of vitamins during hospitalization.
• Office Perks: Enjoy free snacks and coffee.