Data Architecture and Orchestration: Design and implement complex data architectures (Medallion Architecture, Data Mesh, or Hub-and-Spoke), ensuring versioning and the integrity of critical pipelines using LakeFlow, Delta Lake, and PySpark.
Operational Excellence and FinOps: Lead cost and performance optimization at a global scale on Azure. Analyze complex execution plans, manage cluster lifecycles, and define efficiency standards for the team.
Governance and Security as Code: Establish and maintain governance models via Unity Catalog. Implement data quality frameworks (Great Expectations, checksums) and advanced monitoring that anticipate business-impacting failures.
Technical Leadership and Mentoring: Define development standards (Clean Code, Design Patterns), conduct critical code reviews, and raise the technical bar for the team (mid-level and junior engineers).
Integration and Stakeholder Management: Collaborate with system architects and Product Owners to align data availability with product roadmaps. Connect complex sources (SAP, mainframe, third-party APIs) securely and with high performance.

Education: Bachelor's degree in Computer Science, Engineering, Data Science, or related fields;
Experience: Proven experience in data engineering with delivery of large-scale projects;
Technical Mastery: SQL expert — query tuning and data modeling;
Spark Ecosystem: Deep understanding of Spark architecture (shuffle, partitioning, broadcast) for job optimization;
Azure Cloud: Advanced experience with Data Lake Gen2, Azure Data Factory (ADF), and integration with Key Vault and VNETs;
Advanced Python: Development of internal frameworks, libraries, and automations;
Soft Skills: Ownership mindset, ability to translate technical concepts for the business, and resilience in high-criticality environments.

Data Engineer III

Key skills