Design, develop, enhance data pipelines to support use cases such as reporting, data extraction/export etc.
Collaborates with GSS stakeholders across squads and provides accurate estimates for development effort.
Collaborate with wider GSS stakeholders (architecture, security) to ensure code adheres to the architecture designs and also security standards (i.e. vulnerabilities)
Ensure automated testing is performed before software is delivered to QA team.
Ensure code always meets the required engineering GSS standards.
Support the GSS engineering lead driving the strategic direction of the software engineering department.
Requirements
Experience designing and building high throughput, scalable, resilient, and secure data pipelines.
Experience with the following AWS technologies: Glue jobs, Athena, S3, Step functions, Lambda, EKS
Experience working on reporting tools such as Power BI, AWS Quick Sight etc.
Hands on experience working with Kafka
Hands on experience of Python programming in a Data Engineering programming paradigm
Expert knowledge of SQL
Exposure to Test Driven Development
Extensive experience working with CI/CD pipelines and relevant tool set (i.e., GitHub, Jenkins, SonarQube…)
Experience with Terraform (or infrastructure as code)
Exceptional troubleshooting and debugging skills.
Tech Stack
AWS
Jenkins
Kafka
Python
SQL
Terraform
Benefits
30 days of holiday (plus bank holidays)
Comprehensive Benefits: Including a generous pension scheme, annual discretionary bonus, private medical insurance, and life assurance.
Access to EAP, YuLife, holistic wellbeing programs, and a Virtual GP for your health and happiness.
Hybrid working environment with a ‘work abroad’ policy for up to 4 weeks a year.
Access to Udemy, a learning platform with thousands of top-rated courses to develop both tech and business skills.