AVP, Principal Data Engineer

Role Overview

• Design, develop and lead data engineering applications in highly agile and fast-moving teams.
• Lead a data engineering team and roll up the sleeves to individually contribute when required.
• Implement ETL/ELT on a Data warehouse applications using Ab Initio, data lake platform (Cloudera Hadoop cluster)/ Container using Ab Initio, Spark, Hive, Kafka, RDBMS (Oracle, MySQL), NoSQL databases (Cassandra) and public cloud solutions.
• Responsible for design, development, testing oversight and production implementation.
• Experience with batch and real-time data pipelines in a DevOps environment using Ab Initio and Spark.
• Work closely with Product owners, Product Managers, Program manager, scrum masters in a Scaled Agile framework.
• Partner with architects to efficiently design data applications with scalability, resiliency and speed.
• Lead data engineering team to drive program delivery.
• Drive technical development and application standards across enterprise data lake.
• Accomplish results by communicating expectations; planning, monitoring, and appraising results; coaching, counseling, and disciplining employees; developing, coordinating, and enforcing systems, policies, procedures, and productivity standards.
• Collaborate across cross-functional teams to improve and deliver on business objectives and priorities.
• Apply technical knowledge, industry experience, expertise, and insights to contribute to the development & execution of Engineering capabilities.
• Stays up-to-date on latest trends in data engineering, recommends best practices, develops innovative frameworks to avoid redundancy by promoting automation.
• Mentor and coach the team to promote Synchrony values and culture.

Requirements

• BS in computer science or engineering degree
• 6+ years experienced hands on working experience on maintaining, optimizing, resolving issues of Hadoop clusters, supporting business users, EDL batch processes, and real time services or in lieu of a degree 8+ years of relevant experience.
• Proficiency in Oracle, Ab Initio, Spark, and Cloud data engineering.
• 10+ years’ experience in Linux / Unix OS services, and system administration.
• Good knowledge in networking.
• Experience in Cloud migration and upgrading.
• Hands-on experience, POCs on upcoming new tools in Cloud space.
• Prior experience as a Data Engineering Technical Lead leading team in Scaled Agile framework.
• Experience owning multiple mission critical applications on data platform.
• Experience with batch and real-time data pipelines in a DevOps environment.
• Must be willing to work in a fast-paced environment with globally located Agile teams working in different shifts.
• Ability to develop and maintain strong collaborative relationships at all levels across IT and Business Stakeholders.
• Excellent written and oral communication skills.
• Adept and presenting complex topics, influencing, and executing with timely /actionable follow-through.
• Experience in designing ETL pipelines to enable automated data load into AWS S3 & Redshift.
• Prior work experience in a Credit Card/Banking/Fintech company.
• Experience dealing with sensitive data in a highly regulated environment.
• Demonstrated implementation of complex and innovative solutions.
• Nice to have AWS Solution Architect/Data Engineer certification.

Tech Stack

• Amazon Redshift
• AWS
• Cassandra
• Cloud
• ETL
• Hadoop
• Kafka
• Linux
• MySQL
• NoSQL
• Oracle
• RDBMS
• Spark
• Unix

Benefits

• Best-in-class employee benefits and programs that cater to work-life integration and overall well-being.
• Career advancement and upskilling opportunities for all to take up leadership roles.