Design, develop and maintain robust, high-performance data pipelines on Databricks;
Participate in data ingestion, transformation and loading into a Data Lake / Lakehouse architecture;
Develop data processing using Python and Spark to support analytical needs;
Contribute to implementing new data ingestion and transformation patterns;
Collaborate on defining and applying best practices for data quality;
Integrate solutions into DevOps (CI/CD) pipelines and automate deployment processes;
Ensure consistency, documentation and knowledge transfer within the team;
Actively participate in Agile (Scrum) rituals and technical coordination activities.
Requirements
Minimum 4 to 6 years of experience in data engineering;
Recent, hands-on experience with Databricks;
Development experience with SQL, Spark and Python;
Experience with version control and CI/CD tools (e.g., Azure DevOps);
Significant experience developing data solutions for analytical platforms;
Experience with cloud environments (Azure or equivalent);
Strong proficiency in SQL, Spark and Python;
Good understanding of business intelligence concepts (ETL, dimensional modeling, data marts);
Analytical mindset, autonomy and ability to manage multiple priorities in a dynamic environment;
Strong collaboration and team-working skills;
Familiarity with Microsoft BI suite tools (T-SQL, SSIS, SSAS, SSRS, Power BI);
Experience modernizing analytical platforms or migrating to the cloud;
Knowledge of testing frameworks (e.g., Xray).
Tech Stack
Azure
Cloud
ETL
Python
Spark
SQL
SSIS
Benefits
Balance that works for you: Work-life balance helps us stay at our best. With flexible work options and our Unlimited Vacation Plan, you can rest and recharge when you need it most.
Support for your well-being: Our benefits are designed with optimal health and wellness in mind. You’ll have access to 24/7 virtual healthcare, as well as an extensive wellness portal that provides tools and resources to support your physical, mental, emotional and financial well-being.
Continuous growth and learning: Through partnerships with world-renowned education leaders, we provide access to thousands of top-rated online courses and certifications. With exclusive leadership programs and a tuition reimbursement program for external training, we set you up to achieve your ambitions.
Ownership with opportunity: Through our Employee Share Purchase Plan with matched contributions, you become a shareholder, directly benefiting from our collective achievements.