Key skills
KafkaPandasPySparkPythonSQLR
About this role
Role Overview
- Support the development and maintenance of SQL queries for data extraction, transformation, and manipulation
- Assist with data preparation, cleansing, and organization for analytical purposes
- Help build and maintain data pipelines using PySpark
- Support the organization and structuring of data in Data Warehouse environments
- Follow best practices in dimensional modeling, data partitioning, and relational data organization
- Apply basic data quality validations to ensure consistency and reliability of information
- Assist the team in analyzing and making data available for systems and analyses
- Work in partnership with the development team and the Product Owner (PO) to understand business rules
- Translate business needs into queries and data structures that support decision-making
Requirements
- Desired skills
- Python (pandas and building data pipelines)
- Data Warehouse concepts:
- Dimensional modeling
- Data partitioning
- Relational model
- Medallion Architecture
- Data quality: tools and/or validation techniques (desirable)
- HQL (desirable)
- Basic knowledge of LGPD (Brazilian General Data Protection Law)
- Data streaming concepts (e.g., Kafka)
Tech Stack
- Kafka
- Pandas
- PySpark
- Python
- SQL
Benefits
- Company-subsidized health insurance for the employee.
- Option to include dependents in the health plan with payroll deduction.
- Dental care (optional).
- Option to include dependents in the dental plan with payroll deduction.
- Meal allowance or food allowance.
- Transportation voucher (optional).
- Impact & Care
- Personal guidance program offering confidential emotional support and counseling in psychological, legal, financial, social, and pet-related areas at no cost for the employee and legal dependents.
- Gympass
- Wellhub (Access to over 700 gyms across Brazil with plans starting at R$29.90, deducted from payroll).
- Option to include dependents in Gympass
- Wellhub (up to 3 dependents
- paid via credit card).
- Access to Udemy through our intranet.
- Partnerships with major consumer brands.
- Access to SESC benefits for the employee and dependents.
- Discount agreements with educational institutions (undergraduate and postgraduate) and language schools/certification bodies.
- Group life insurance.