Lead and develop robust data pipelines using Databricks, Azure Data Factory, Python and PySpark to support large-scale data projects.
Design and implement scalable solutions for integrating and processing data from multiple sources, including transactional and operational data, ensuring high data quality and governance.
Work with SQL and Databricks to extract, transform and prepare data, as well as create complex transformations to meet analytical and operational needs.
Collaborate with business and data teams, helping translate technical requirements into effective solutions that directly impact logistics operations.
Develop and automate data ingestion, transformation and analysis processes using tools such as Azure Data Factory, APIs, Kafka and Oracle GoldenGate.
Lead the optimization of data pipelines and promote high-performance data engineering practices, with a focus on performance, scalability and proactive monitoring.
Ensure data quality and integrity through testing, validation and governance, collaborating with BI and data science teams.
Mentor junior data analysts and data engineers, fostering team growth and the adoption of data engineering best practices.
Foster innovation in the use of emerging technologies, such as machine learning and artificial intelligence, to apply predictive models and automation.
Requirements
4+ years of experience in Data Engineering with solid knowledge of SQL, Databricks, Python and PySpark.
Experience designing and implementing scalable and efficient data pipelines using Azure Data Factory or other similar tools.
Deep understanding of large-scale data processing, working with high volumes of data and distributed architectures.
Experience with data integration and governance, ensuring data quality and reliability to support business decisions.
Strong analytical and problem-solving skills to handle complex technical challenges.
Ability to act as a technical leader within the team, guiding others in advanced technical solutions.
Good communication and interpersonal skills, with the ability to work with different teams and stakeholders.
Critical thinking and proactivity to identify and effectively resolve technical and operational issues.
Preferred:
Knowledge of MicroStrategy and Power BI to collaborate with BI and analytics teams.
Experience with real-time data ingestion systems, such as Kafka, API integrations, etc.
Experience in cloud environments, especially Azure.
Familiarity with Machine Learning and AI models as applied to Data Engineering.
LLMs, AI agents, Genies.
Tech Stack
Azure
Kafka
Oracle
PySpark
Python
SQL
Benefits
Transportation voucher and/or shuttle for positions at our distribution centers (DCs)*
Meal voucher / food allowance
Christmas gift basket voucher
Home office allowance (for hybrid or remote employment contracts)*
Multi-purpose purchase credit card
Employee discount at our stores
Health insurance
Dr. Be (telemedicine, telepsychology, nutritional coaching and sports coaching)
Wellhub (Gympass)
Programs and campaigns developed to promote the health and wellbeing of our employees and their families.
Balance methodology applied together with leadership and teams to strengthen communication and recognition, wellbeing, and work style/tools.
Dental plan
Univers
discounts at Raia and Drogasil pharmacies
Pet health plan
Running coaching
Discounts on universities, schools, language courses and professional training
Tickets to cinemas, parks and more.
People with disabilities are welcome to apply for all our opportunities.