Architecture and Ecosystem Evolution: Lead the evolution of Memed's data architecture (Data Lakehouse/Mesh), ensuring a resilient, scalable infrastructure prepared for growing data volumes.
High-Performance Engineering: Develop and optimize ingestion and transformation frameworks (ETL/ELT) using Databricks, establishing coding standards that prioritize performance and reuse.
DataOps: Implement and promote software engineering best practices in the context of data and solution productionization, including CI/CD, code versioning, automated quality tests, and infrastructure as code.
FinOps Leadership: Lead the FinOps strategy, monitoring compute and storage costs in the Cloud (AWS).
Governance and Security by Design: Develop data governance mechanisms (lineage, catalog, and metadata) and ensure compliance with the LGPD (Brazilian General Data Protection Law), applying strict access control, encryption, and anonymization policies.
Technical Interface: Act as a technical bridge between Engineering, Analytics, and stakeholders, translating business challenges into robust data solutions and mentoring the team in adopting modern architectural standards.
Requirements
Bachelor's degree in Computer Science, Engineering, Information Systems, Statistics, or related fields.
Experience with modern data architectures such as data lakes, data streaming, and cloud computing (preferably AWS).
Experience developing, maintaining, and versioning data pipelines (ETL/ELT), ensuring scalability, performance, and security.
Proficiency with Apache Spark, Databricks, Delta Lake, and orchestration tools like Apache Airflow.
Advanced SQL skills and proficiency in Python for data manipulation and automation.
Experience with Git, CI/CD pipelines, and deployment best practices in cloud environments.
Solid understanding of cloud data architecture, information security, and data governance.
Knowledge of FinOps and strategies for optimizing cloud costs.
Analytical and structured thinking with a focus on solving complex problems.
Autonomy to propose technical solutions and lead improvements in the data architecture.
Curiosity and an ongoing interest in learning and applying new technologies and best practices.
Tech Stack
Airflow
Apache
AWS
Cloud
ETL
Python
Spark
SQL
Benefits
Mental health support through ZenKlub (access to psychologists).
Health plan – Amil.
Dental plan – Amil.
Meal/food allowance on a Flash Benefits card, accepted at food establishments as credit.
Memed Cuida – BRL 110.00/month to use as you see fit.
Childcare assistance.
TotalPass available to all employees to support physical activity, mental health, and overall well-being.
WellHub.
Day off on your birthday.
Life insurance.
ÚnicoSkill: Offers a wide range of courses, undergraduate and graduate programs, postgraduate studies, language courses, and mentoring.