Key skills
Amazon RedshiftAWSCloudElasticSearchETLKafkaPySparkPythonSQLTerraformData LakeAnalyticsRedshiftBDDCloudFormationS3GlueKinesisElasticsearch
About this role
Role Overview
- Build and manage reliable data pipelines involving ingestion/collection, processing, integration, storage, and data availability across the organization
- Work within a distributed systems architecture for massively parallel (MPP) data processing, combining diverse heterogeneous data sources and collaborating with analytics and data science teams to build solutions and generate data-driven value
Requirements
- Practical experience with ingestion, integration, processing, and storage of large volumes of data
- Experience working on Big Data projects
- Behavior Driven Development (BDD)
- Data extraction using Python and data processing with PySpark
- Experience with ETL tools
- Knowledge of relational and dimensional data modeling (Data Warehouse)
- Experience with SQL databases
- Experience with Big Data-related AWS toolset such as EMR, Kinesis, Redshift, S3, Glue, Elasticsearch
- Knowledge of Kafka
- Knowledge of Data Lake and DataOps
- Experience with Data Science
- Preferred/Differential: AWS certifications
- Knowledge of infrastructure provisioning tools as code for cloud such as Terraform and CloudFormation
Tech Stack
- Amazon Redshift
- AWS
- Cloud
- ElasticSearch
- ETL
- Kafka
- PySpark
- Python
- SQL
- Terraform
Benefits
- Swile flexible card you can use as you wish (meal and food allowances)
- Totalpass or Gympass
- Mental health support – Psicologia Viva
- Bradesco Health Plan
- Bradesco Dental Plan
- Profit sharing
- Childcare assistance for our moms
- Incentives for certifications
- Special talks and webinars
- RAF referral bonus program
- Life insurance
- Subsidy for English or Italian
- Open English discount
- Birthday gift
- Possibility to relocate to another country
- Partnerships with universities