Key skills
AzureETLKafkaPySparkPythonSparkSQLTableauTerraformUnityVaultELTData LakeAnalyticsBIPower BIDatabricksAzure DevOpsGitCI/CDCommunication
About this role
Role Overview
- Design, develop and maintain scalable, resilient data architectures and pipelines
- Work on data integration across multiple sources (internal and external), ensuring consistency and traceability
- Develop and optimize ETL/ELT processes on cloud data platforms
- Ensure the quality, integrity and governance of provided data
- Support business areas and analytics teams by providing reliable data for decision-making
- Build and maintain data models and layers that support visualization and analytics solutions
- Collaborate with engineering, analytics, product and business teams
- Propose continuous improvements in performance, cost and reliability of the data ecosystem
Requirements
- Proven experience in data architecture and integration
- Strong knowledge of ETL/ELT tools and cloud data platforms
- Familiarity with visualization tools (Power BI, Tableau or similar); experience with Databricks is a plus
- Experience with data governance and data quality
- Strong experience with the Azure ecosystem (Azure Data Lake Storage, Azure Data Factory, Azure Key Vault, Synapse)
- Hands-on experience with Databricks, including Delta Lake and Medallion architecture patterns (Bronze, Silver, Gold)
- Proficiency in Python (PySpark) and SQL (Spark SQL) for distributed processing of large data volumes
- Experience in data modeling (Data Lake, Lakehouse and Data Warehouse)
- Knowledge of DataOps practices, versioning with Git and CI/CD pipelines (Azure DevOps or similar)
- Ability to identify and resolve issues related to data integrity, quality and performance
- Good communication skills and ability to interact with multidisciplinary teams (engineering, analytics, product and business)
- Intermediate English
Preferred:
- Experience in the financial sector / payments
- Experience with Unity Catalog (data governance and lineage) or equivalent tools (e.g., Purview)
- Experience with real-time processing (Structured Streaming, Event Hubs or Kafka)
- Knowledge of Infrastructure as Code (Terraform or similar)
- Databricks and/or Azure Data Engineer Associate certifications
Tech Stack
- Azure
- ETL
- Kafka
- PySpark
- Python
- Spark
- SQL
- Tableau
- Terraform
- Unity
- Vault
Benefits
- Competitive compensation based on experience;
- Opportunities for career growth and participation in strategic projects;
- Dynamic and challenging work environment;
- Opportunity to work at a rapidly growing company.