Key skills
AzurePythonSQLBashPowerShellELTAnalyticsBIPower BIRESTfulAgileScrumCI/CD
About this role
Role Overview
- Design, build, optimise, and maintain scalable data pipelines
- Develop and manage ELT pipelines, orchestration, and automation using Python
- Capture and onboard metadata into enterprise data catalogues
- Perform data analysis to identify patterns, anomalies, and quality improvements
- Contribute to data product design, including data models and structures
- Implement data models for analytics and reporting
- Build and maintain CI/CD pipelines for automated deployment
- Develop automation scripts using Python, Bash, and PowerShell
- Develop and maintain RESTful APIs for integration and interoperability
- Implement data quality checks and validation frameworks
- Setup monitoring, alerting, and performance tracking
- Develop dashboards and reporting solutions using Microsoft Fabric & Power BI
Requirements
- 7–9 Years of experience as a data engineer
- Proficiency in Python and SQL
- Experience with Microsoft Azure and Microsoft Fabric
- ELT Pipeline Development
- Metadata Management & Data Catalogue onboarding
- Experience with Agile/Scrum methodologies
- Data Analysis & Data Quality Assessment
Tech Stack
- Azure
- Python
- SQL
Benefits
- Health insurance
- Flexible working hours
- Professional development opportunities