Data Engineering Lead

Harnham is the named recruiting company, and the hiring client is not identified. The Data Engineering Lead will guide enterprise data platform architecture and cloud modernization, while leading the design and optimization of pipelines and frameworks and mentoring engineers.

Responsibilities:

• Lead the design, enhancement, and optimization of enterprise data pipelines and processing frameworks
• Evaluate existing architectures and recommend improvements to scalability, performance, reliability, and maintainability
• Design and build data ingestion frameworks and connectors to integrate new applications and data sources into a centralized platform
• Support the onboarding of additional business systems, products, and data domains while maintaining platform performance and stability
• Develop scalable solutions for processing growing volumes of structured and semi-structured data
• Partner with cross-functional engineering teams to establish architecture standards, best practices, and governance processes
• Provide technical leadership on platform strategy, data architecture, and cloud modernization initiatives
• Mentor engineers and serve as a technical escalation point for complex data challenges

Requirements:

• 8+ years of experience in Data Engineering, Platform Engineering, or Analytics Engineering
• Proven experience leading large-scale cloud data initiatives in AWS environments
• Python
• PySpark
• SQL
• AWS Glue
• AWS Lambda
• Amazon S3
• Amazon Redshift
• Container technologies (ECS, Fargate, Kubernetes, or similar)