Key skills
AirflowApacheBigQueryCloudPythonRedisSparkSQLArtificial IntelligenceData EngineeringApache SparkPub/SubMentoring
About this role
Role Overview
- Define and structure the organization's data architecture;
- Develop and guide the construction of data pipelines (batch and streaming);
- Ensure data quality, integrity and governance;
- Support the implementation of solutions focused on artificial intelligence;
- Collaborate with both technical and business teams;
- Optimize resource usage in cloud environments.
Requirements
- Bachelor's degree in Technology or a related field;
- Knowledge of data architecture and data engineering;
- Knowledge of Lake House and Data Mesh;
- Experience with the following tools:
- BigQuery
- Apache Spark
- Airflow
- Pub/Sub
- Cloud SQL
- Data Fusion
- Redis
- Proficiency in Python and SQL (intermediate/advanced level – profile close to DBA).
Tech Stack
- Airflow
- Apache
- BigQuery
- Cloud
- Python
- Redis
- Spark
- SQL
Benefits
- Meal allowance or meal voucher;
- Discounts on courses, universities and language schools;
- Stefanini Academy — platform with online, free, up-to-date courses and certificates;
- Mentoring;
- Benefits club for medical consultations and exams;
- Medical assistance/health plan;
- Dental assistance/dental plan;
- Perks club with discounts at top establishments;
- Travel club;
- Pet care benefits.