Senior Data Engineer – Consultant, Databricks
Australia
Full Time
6 days ago
No Sponsorship
Key skills
PythonSQLData EngineeringDatabricksIntegration TestingGitCI/CD
About this role
Role Overview
- Build, maintain, and optimise data pipelines across lakes, lakehouses, and warehouses
- Write, test, and maintain high-quality code
- Apply data modelling principles and troubleshoot issues
- Work with Databricks, Delta Live Tables, Lakeflow, Git, and CI/CD pipelines
- Implement automated testing and performance optimisation
- Lead unit and integration testing and ensure solutions meet quality standards
- Mentor junior/intermediate team members and conduct peer reviews
- Collaborate with architects on technical solutions
Requirements
- 6+ years of professional experience in data engineering or a related field
- At least 4 years of hands-on experience developing data pipelines and transformations using Databricks
- Familiarity with Microsoft Fabric concepts
- Proficiency in Python and SQL
- Understanding of data modelling
- Knowledge of Medallion architecture principles
- Experience applying DevOps practices
- Experience with testing and data quality frameworks
- Experience with visualisation and data consumption concepts
- Relevant industry certifications (Databricks Professional and Databricks Associate)
Tech Stack
- Python
- SQL
Benefits
- Collaborative, people-first culture
- Round-the-clock middleware support
- Professional development opportunities
- Customised integration training