Provide authoritative technical guidance on data engineering design and tools across RDG.
Lead the development, operation and continuous improvement of RDG’s data platform.
Oversee the implementation of complex data pipelines, integrations and transformations across batch and streaming workloads.
Make key decisions on data models, storage approaches, tooling and engineering techniques.
Lead, mentor and develop a team of data engineers.
Support the establishment of consistent engineering practices.
Provide guidance to engineers across other teams.
Work with Architecture, Information Security, Quality Assurance and other technical teams.
Collaborate with internal and external partners to support complex integrations, data flows and platform interactions.
Engage with business stakeholders to understand technical requirements.
Manage and prioritise the engineering workload and delivery.
Support the Head of Data, Analysis and Insights with shaping the future role of data.
Ensure appropriate controls, monitoring and operational processes are in place.
Maintain and enhance engineering standards across data quality, testing, and documentation.

Proven experience working with extremely large datasets (including tables with over 85 billion records)
Writing efficient SQL
Building both batch and streaming pipelines in Python
Hands-on AWS expertise in a data context within the last three years
Strong grasp of modern data storage and processing options (data lakes, warehouses, relational and key-value stores, and distributed frameworks like Spark)
Experience with CI/CD and DataOps
Champion best-practice data warehouse and data lake design
Drive automation and high standards in code quality

75% off rail travel for personal and family use, plus international rail discounts.
30 Days annual leave (plus buy/sell options and additional leave for key life events)
Season ticket loan for commuting costs.
Enhanced family leave – 30 weeks full pay for maternity, adoption, surrogacy, and shared parental leave.
Pension scheme – up to 11.58% employer contribution.
Private medical insurance (Vitality PPP) including mental health and specialist care.
Discounted gym membership and access to wellbeing programmes.

Data Engineering Lead

Key skills