Key skills
AWSCloudETLSQLTerraformData EngineeringAnalyticsSnowflakeLambdaS3GlueCI/CDCollaboration
About this role
Role Overview
- Contribute to the ongoing operation of the Snowflake and ETL environments
- Improve warehouse configuration, cost efficiency and performance
- Support the introduction of environment separation (dev/test/prod)
- Implement role-based access control and security standards
- Partner with IT on cyber-security, infrastructure and costing requirements
- Support implementation of data retention, backup and auditability standards aligned with compliance requirements
- Maintain and enhance current ingestion pipelines (currently AWS Glue-based)
- Implement improvements to ingestion architecture under architectural guidance
- Support ingestion from operational production systems, device telemetry and analysis platforms
- Improve reliability, monitoring and failure handling
- Contribute to data observability practices (pipeline health, freshness, schema evolution)
- Monitor Snowflake compute usage and identify optimisation opportunities
- Improve warehouse sizing and auto-suspend configuration
- Support storage and compute cost management initiatives
- Provide input into platform performance tuning decisions
- Implement infrastructure-as-code (e.g. Terraform) for Snowflake and AWS components
- Manage Snowflake objects (warehouses, roles, schemas) through code-based processes
- Contribute to CI/CD implementation for data infrastructure
- Improve observability and alerting across pipelines
- Collaborate closely with Graduate Data Engineers and contribute to a supportive learning environment
- Partner with Analytics/Data Engineers to ensure the platform supports modelling needs
- Participate in architecture discussions across Data, Software and Infrastructure teams
- Contribute to documentation and operational runbooks
- Collaborate with Scientists and Engineers to understand operational and scientific data context.
Requirements
- Experience contributing to a production data engineering or cloud-based data platform environment
- Experience working with Snowflake or similar modern cloud data warehouses
- Experience supporting ingestion pipelines in AWS (e.g. S3, Glue, Lambda)
- Understanding of Snowflake performance and cost fundamentals
- Familiarity with Infrastructure as Code concepts (Terraform preferred)
- Strong SQL skills
- Comfortable working under architectural guidance while taking ownership of implementation tasks
- Experience supporting environment separation (dev/test/prod) (desirable)
- Experience implementing monitoring and observability for data systems (desirable)
- Experience working with industrial, scientific or operational data (desirable)
- Familiarity with Snowpipe (desirable)
- Experience contributing to code reviews or supporting junior engineers (desirable).
Tech Stack
- AWS
- Cloud
- ETL
- SQL
- Terraform
Benefits
- Flexibility and wellbeing initiatives to help you maintain a healthy work-life balance.
- Opportunities to work with groundbreaking equipment that's transforming the mining industry and reducing its environmental impact.
- Collaboration with industry experts and the chance to grow and develop professionally.
- Exciting career prospects and room for advancement.