Senior Data Engineer

RE Partners is looking for a skilled Senior Data Engineer to join their Data Engineering team. The role involves building and optimizing data infrastructure to support critical decisions across various domains, ensuring data quality and scalability.

Responsibilities:

• Build & Scale: Design and implement Spark ETL pipelines on AWS to process large-scale data
• Collaborate: Partner with cross-functional teams to understand needs and deliver reliable data solutions
• Optimize: Maintain and enhance data platform architecture for performance, scalability, and cost-efficiency
• Ensure Excellence: Champion data quality, governance, and reliability across all data products
• Drive Innovation: Implement best practices and contribute to continuous improvement
• Maintain Operations: Ensure platform health through monitoring, incident response, and performance tuning

Requirements:

• 5+ years in Data Warehousing, Architecture, or Engineering
• Strong expertise in Apache Spark, Hadoop, and Hive, including streaming pipelines
• High proficiency in Scala, Java, or Python
• Deep hands-on experience with AWS (EMR, S3, Lambda, Redshift)
• Strong grasp of system design, data structures, algorithms, and building large-scale data products
• Solid understanding of data quality and governance principles
• Self-driven, collaborative, and eager to learn
• Experience with DBT