Key skills
AzureCloudPySparkPythonSQLData EngineeringDatabricks
About this role
Role Overview
- Develop, implement and maintain scalable, high-performance data pipelines;
- Work on data engineering and processing using Databricks;
- Design and evolve solutions based on Data Mesh architecture;
- Develop applications and routines using Python and PySpark;
- Create and optimize SQL queries and data models to support analyses and data products;
- Work in cloud environments, preferably Microsoft Azure;
- Ensure best practices for data quality, performance, monitoring and data reliability;
- Collaborate with cross-functional teams to build data products and define architectural standards.
Requirements
- Solid experience with Databricks for data engineering and processing;
- Knowledge and experience with Data Mesh architecture;
- Experience building and maintaining data pipelines;
- Proficiency in Python and PySpark;
- Advanced experience with SQL and data modeling;
- Experience working in cloud data environments, preferably Azure.
Tech Stack
- Azure
- Cloud
- PySpark
- Python
- SQL
Benefits
- Health and dental insurance;
- Meal and food allowance;
- Childcare assistance;
- Extended parental leave;
- Partnerships with gyms and health and wellness professionals via Wellhub (Gympass) TotalPass;
- Profit Sharing (PLR);
- Life insurance;
- Continuous learning platform (CI&T University);
- Discount club;
- Free online platform dedicated to promoting physical and mental health and well-being;
- Pregnancy and responsible parenthood course;
- Partnerships with online course platforms;
- Language learning platform;
- And many others