Key skills
AirflowApacheAWSETLPythonSparkSQLData LakeAnalyticsApache AirflowdbtLambdaS3GlueAthena
About this role
Role Overview
- Design, develop, and implement robust pipelines that connect data from diverse sources using primarily tools from the AWS ecosystem
- Implement scalable and efficient data enrichment solutions using DBT to transform raw data into tailored data models and actionable business insights
- Manage integrations, transformation processes, and task automation using data connectors, SQL APIs, Python, and REST
- Use SQL to query and manipulate data in relational and non-relational databases
- Apply Spark for processing large volumes of data in real time and in batch
Requirements
- AWS (Athena, S3, Glue, Lambda)
- Proficiency in SQL, DBT, Python, and Spark
- Experience with data orchestration tools such as Apache Airflow
- Knowledge of different data architecture and modeling techniques for analytics purposes (e.g., Data Mesh, Data Mart, Data Lake, Data Warehouse)
- Experience with Data Modeling (relational and/or analytical) and ETL processes
- APIs, Gateways, Microservices, and Containers
- Familiarity with software engineering best practices (documentation, automated testing, clean code, monitoring)
Tech Stack
- Airflow
- Apache
- AWS
- ETL
- Python
- Spark
- SQL
Benefits
- Profit Sharing
- Company Car
- Food Allowance
- Meal Voucher
- Health Insurance
- Dental Insurance
- Gympass
- Private Pension Plan
- Home Office Allowance
- Allya
- Unlimited access to various courses from our Localiza University
- Internal training and development programs
- Discounts on vehicle purchase and rentals