Responsible for the architectural design, development, and maintenance of enterprise data platforms on AWS
Lead a high-performing team of engineers, fostering a culture of technical excellence using Scrum methodologies
Design and implementation of scalable, automated data pipelines using PySpark and AWS services
Manage, mentor, and upskill a team of data engineers
Conduct code reviews and ensure adherence to best practices in software engineering
Act as the Scrum Lead/Manager for the data team, organizing daily stand-ups, sprint planning, and backlog grooming within Jira
Translate complex technical concepts into actionable insights for non-technical stakeholders across teams

8+ years of experience in Data Engineering, Data Architecture, or related field
8+ years in a formal leadership or management role
Bachelor’s or master’s degree in computer science, Engineering, or a related quantitative field
Relevant certifications (e.g., AWS Certified Data Engineer
Associate/Professional) are highly preferred
Deep expertise in Databricks (PySpark, Delta Lake, notebooks)
Strong programming skills in Python and PySpark
Experience with GitHub, GitHub Actions, and Terraform for AWS deployments
Proficiency in Medallion Architecture and Kimball modeling
CI/CD implementation for data workflows
Hands-on experience implementing batch and streaming pipelines in Databricks using DAGs
Familiarity with data mesh principles and advanced data architecture patterns

Data Engineer – Manager

Key skills