Key skills
AirflowApacheAWSETLPythonSparkSQLData LakeAnalyticsApache AirflowdbtLambdaS3GlueAthena
About this role
Role Overview
- Design, develop, and implement robust data pipelines, connecting data from various sources primarily using tools from the AWS ecosystem;
- Implement scalable and efficient data enrichment solutions using DBT to transform raw data into custom data models and actionable business insights;
- Manage integrations, transformation processes, and task automations using data connectors, SQL, Python, and REST APIs;
- Use SQL to query and manipulate data in relational and non-relational databases;
- Apply Spark to process large volumes of data in real time and in batch.
Requirements
- AWS (Athena, S3, Glue, Lambda)
- Proficiency in SQL, DBT, Python, and Spark
- Experience with data orchestration tools such as Apache Airflow
- Knowledge of various data architecture and modeling techniques for analytics (e.g., Data Mesh, Data Mart, Data Lake, Data Warehouse)
- Experience with data modeling (relational and/or analytical) and ETL processes
- APIs, API gateways, microservices, and containers
- Familiarity with software engineering best practices (documentation, automated testing, clean code, monitoring).
Tech Stack
- Airflow
- Apache
- AWS
- ETL
- Python
- Spark
- SQL
Benefits
- Profit sharing
- Company car
- Food allowance
- Meal voucher
- Health insurance
- Dental insurance
- Gympass
- Private pension plan
- Home office allowance
- Allya
- Unlimited access to a variety of courses at our Localiza University
- Internal training and development programs
- Discounts on vehicle purchases and rentals