ApacheAzureCloudETLPySparkPythonSparkSQLRAIArtificial IntelligenceMachine LearningLarge Language ModelsELTApache SparkGitAgile
About this role
Role Overview
Develop data solutions using Python, ensuring quality, performance, and scalability;
Develop and maintain REST APIs for integration between systems and applications;
Build, optimize, and maintain ETL/ELT data pipelines;
Process and transform large volumes of data using Apache Spark and PySpark;
Develop queries and analyses using SQL to support decision-making;
Participate in the development, training, validation, and monitoring of analytical and predictive models;
Apply statistical techniques and machine learning to generate insights and intelligent solutions;
Develop and integrate solutions using Generative Artificial Intelligence and Large Language Models (LLMs);
Integrate AI solutions into products, services, and business processes;
Ensure best practices for code versioning using Git;
Document solutions, pipelines, and data processes;
Work collaboratively with multidisciplinary teams in agile environments;
Contribute to the continuous evolution of data and AI engineering architecture and practices.
Requirements
Bachelor’s degree in Computer Science, Computer Engineering, Information Systems, Software Engineering, Statistics, or related fields;
Experience developing with Python;
Experience building and consuming REST APIs;
Experience with system integration and cloud environments, preferably Microsoft Azure;
Experience with Apache Spark and PySpark;
Knowledge of building and maintaining ETL/ELT pipelines;
Strong SQL skills for querying, analysis, and data manipulation;
Knowledge of applied statistics and data analysis;
Experience with machine learning and predictive models;
Familiarity with Generative Artificial Intelligence and Large Language Models (LLMs);
Experience with code versioning using Git;
Ability to work effectively in a team, collaborating with different areas and stakeholders.
Tech Stack
Apache
Azure
Cloud
ETL
PySpark
Python
Spark
SQL
Benefits
Company-subsidized health insurance for the employee.
Option to include dependents on the health insurance with payroll deduction.
Dental assistance (optional).
Option to include dependents on the dental assistance with payroll deduction.
Meal voucher or food allowance.
Transportation voucher (optional).
Impact & Care
Personal guidance program that provides emotional support and confidential counseling in psychological, legal, financial, social, and pet-related areas at no cost for the employee and legal dependents.
Gympass
Wellhub (Access to over 700 gyms across Brazil with plans starting at R$29.90 deducted from payroll).
Option to include dependents on Gympass
Wellhub (up to 3 dependents
paid via credit card).
Access to Udemy via our intranet.
Partnerships with major consumer brands.
Agreement with SESC for employee and dependents.
Discounts with educational institutions (undergraduate and postgraduate) and language/certification schools.