Key skills
Amazon RedshiftAWSElasticSearchETLKafkaKubernetesPySparkPythonSQLTerraformData LakeRedshiftBDDK8sS3GlueKinesisElasticsearchGitLabCI/CD
About this role
Role Overview
- Work as a data engineer for one of our clients in the financial sector
- Strong focus on technology
- Hybrid on-site work 2 to 3 times per week in São Paulo, SP
Requirements
- Hands-on experience with AWS
- Experience with GitLab
- Data extraction using Python and data processing with PySpark
- Knowledge of ingestion, integration, processing and storage of large volumes of data
- Knowledge of Behavior Driven Development (BDD)
- Familiarity with ETL tools
- Knowledge of relational and dimensional data modeling (Data Warehouse)
- Experience with SQL databases
- Familiarity with AWS Big Data services such as EMR, Kinesis, Redshift, S3, Glue, Elasticsearch
- Knowledge of Kafka
- Knowledge of Data Lake and DataOps
- Nice to have / differentiator: CI/CD pipeline
- Terraform
- Kubernetes (k8s)
- Soft skills: collaborative
- Proactivity and sense of urgency
- Ability to identify problems and provide solutions
Tech Stack
- Amazon Redshift
- AWS
- ElasticSearch
- ETL
- Kafka
- Kubernetes
- PySpark
- Python
- SQL
- Terraform
Benefits
- Swile flexible card to use as you prefer (meal and food vouchers)
- Totalpass
- Gympass
- Mental health support – Psicologia Viva
- Bradesco health plan
- Bradesco dental plan
- Profit-sharing
- Childcare assistance for new mothers
- Support for certifications
- Special talks and webinars
- RAF employee referral bonus program
- Life insurance
- Birthday gift
- Opportunity to relocate internationally
- Partnerships with universities