Key skills
AirflowApacheAzureKafkaNoSQLPulsarPythonSparkSQLVaultRApache SparkGitVersion ControlLeadership
About this role
Role Overview
- Connect technology talent to real-world projects.
- Work in healthy environments with end-to-end professional growth opportunities.
- Collaborate with other professionals and leadership on relevant, high-impact projects.
Requirements
- Solid experience as a Data Engineer in medium
- to high-complexity environments.
- Advanced proficiency in SQL, Spark, and Python.
- Experience with distributed processing (Apache Spark, Flink, or similar).
- Experience with messaging and streaming systems (Kafka, Pulsar, or similar).
- Experience with orchestration tools (Airflow, Prefect, Dagster, or similar).
- Experience with Data Lakes (ADLS).
- Knowledge of data modeling (dimensional modeling and/or Data Vault).
- Experience with relational and NoSQL databases.
- Experience with cloud environments (Azure).
- Knowledge of optimized data formats (Parquet, ORC, Avro).
- Experience with version control (Git) and software engineering best practices.
- Ability to work strategically, autonomously, and collaboratively.
Tech Stack
- Airflow
- Apache
- Azure
- Kafka
- NoSQL
- Pulsar
- Python
- Spark
- SQL
- Vault
Benefits
- Flash Card
- R$ 936.00 per month for flexible use on food, meals, and mobility.
- SulAmérica Health Plan – no copayment or payroll deductions.
- SulAmérica Dental Plan – no copayment or payroll deductions.
- Life Insurance.
- Gympass | Wellhub
- Access to gyms and fitness activities.
- TotalPass
- Access to gyms, fitness activities, wellness, and sports.
- SESC Partnership
- Benefits for culture, leisure, sports, and wellness.
- Creditas
- Access to financial services, loans, and pension/savings options.