Key skills
ApacheAWSAzureHadoopHBaseJenkinsPostgresPySparkPythonSparkData EngineeringData LakeDatabricksApache SparkLambdaS3CloudWatchPostgreSQLGitVersion ControlAgileScrumKanbanCI/CD
About this role
Role Overview
- Work with the Data Engineering team (Cards area);
- Build data pipelines for ingestion and availability in Santander Brazil's Corporate Data Lake;
- Work in an agile team on a strategic area project;
- Use Databricks and PySpark as primary tools.
Requirements
- Experience with Databricks and Apache Spark (pipeline creation and optimization);
- Programming in PySpark, Python and Kedro;
- Batch and streaming processing (messaging);
- DevOps experience with Jenkins (CI/CD and automation);
- Version control with Git;
- Experience with agile methodologies (Scrum, Kanban);
- Orchestration tools (e.g., Control-M);
- Hands-on experience with Microsoft Azure (Databricks, Data Factory, Storage Accounts);
- AWS: Aurora PostgreSQL, CloudWatch, Lambda, S3;
- On-premises environments (Cloudera, Hadoop, HBase, Hive);
- Certifications: AZ-900 (Azure Fundamentals) and DP-900 (Azure Data Fundamentals).
Tech Stack
- Apache
- AWS
- Azure
- Hadoop
- HBase
- Jenkins
- Postgres
- PySpark
- Python
- Spark
Benefits
- Bradesco Health Plan (30% co-payment);
- Bradesco Dental Plan (no employee contribution);
- Life insurance;
- Wellhub (Gympass);
- Daycare allowance;
- Allowance for children with special needs;
- Payroll loan;
- Private pension plan;
- Pet care benefits (partner discounts);
- SESC benefits;
- Conexa telemedicine;
- Expense allowance;
- Meal / food allowance;
- Multi-benefits card;
- Medical plan upgrade;
- Extended maternity and paternity leave;
- Support program for pregnant employees;
- Newborn gift basket and the book "Acontecia quando eu nascia";
- Professional development: courses available through the internal learning platform;
- 100% remote or hybrid work, depending on project requirements.