Key skills
AirflowApacheAWSAzureCloudGoogle Cloud PlatformPySparkPythonSparkSQLAnalyticsSnowflakeDatabricksApache SparkdbtGCPGoogle CloudGlueGitAtlassianJiraConfluence
About this role
Role Overview
- Develop data solutions to meet company needs.
- Build robust data pipelines to get data where it needs to be.
- Take ownership for delivering engineering tasks on time and to specification.
- Build strong relationships with key stakeholders outside the team.
- Be responsible for data quality and ensuring problems are resolved swiftly.
- Contribute to robust processes and technical best practice.
- Help maintain and improve the data platform and technology.
- Foster skills, share knowledge and cross-train with peers.
Requirements
- Experience as a Data Engineer, Analytics, Software Engineer or Technical Analyst.
- Good knowledge of Python including using Pyspark/Apache Spark.
- Proven experience building and maintaining data pipelines end-to-end.
- Advanced SQL skills.
- Knowledge of one or more data warehouse or lakehouse platforms such as Snowflake, Databricks, MS Synapse.
- Experience with a cloud platform (Azure/GCP/AWS)
- Experience with Code control/Git
- Have used an orchestration tool, such as ADF, Airflow, Glue or Data Factory
Advantageous, but not required:
- Databricks
- DBT
- CI\CD
- Atlassian (Jira, Confluence)
Tech Stack
- Airflow
- Apache
- AWS
- Azure
- Cloud
- Google Cloud Platform
- PySpark
- Python
- Spark
- SQL
Benefits
- A relaxed working environment with regular socials including a summer festival
- Supportive well-being initiatives and benefits, talks & workshops, and Mental Health First aiders & Champions
- 25 days holiday plus a day for your birthday. Our offices will be closed between Christmas and New Year’s which are in addition to your annual entitlement
- Tailored training and development through both our inhouse learning platform and LinkedIn Learning
- A progressive and transparent culture focused on your development
- Flexible / hybrid working plus early finish Fridays
- Cycle to work scheme
- Enhanced Family Policies including paternity, adoption and surrogacy leave. We also provide a pregnancy loss, fertility, and carers policy
- Competitive pension plans and Life Assurance
- A newly renovated modern office with lots of collaborative spaces