Senior Data Engineer

TechShack is seeking experienced Senior Data Engineers for a 6-month contract opportunity supporting a major data transformation and modernisation programme. The role involves building and scaling a modern cloud data platform, developing pipelines and infrastructure, and solving complex data challenges across large and complex datasets.

Responsibilities:

• Building and scaling a modern cloud data platform, working with large and complex datasets and developing the pipelines and infrastructure that power data across the business
• Building and optimising scalable ETL/ELT pipelines

Requirements:

• Strong Python & SQL
• Hands-on experience with Databricks
• Apache Spark / PySpark
• Snowflake
• Experience across AWS, Azure or GCP
• Building and optimising scalable ETL/ELT pipelines
• Strong data modelling experience
• Large-scale data processing and distributed systems
• Strong understanding of data engineering best practices
• experience building or modernising data platforms at scale
• dbt and/or Airflow experience beneficial