Data Engineer - Cloudera & AWS Lakehouse

Gainwell Technologies is a healthcare technology company focused on using leading-edge technologies to improve health and well-being. The Data Engineer will lead technical teams and workstreams developing complex database applications and large-scale data pipelines using Cloudera, AWS, PySpark, Apache Iceberg, and Airflow, while providing technical consulting and mentoring less experienced designers.

Responsibilities:

• Head up technical teams and workstreams as you design, develop, test and install complex database applications software — with server, client and web components
• Keep the team on the same page by overseeing relationships between application architects and developers to ensure design requirements result in flexible, reusable system components
• Create more satisfied clients by writing highly complex design, coding and testing documentation that yields purpose-built technical products that meet real needs
• Shine as an SME in the areas of development, domain, application design and database methodologies and best practices
• Show your know-how as you provide clients with technical consulting on highly complex projects by refining existing apps and designing new application modules and components
• Exercise your expertise by mentoring and guiding less experienced application designers

Requirements:

• 5+ years of hands-on experience Cloudera Data Platform expertise, including data processing, data governance, and cluster management
• 5+ years of hands-on experience Advanced PySpark Development skills with experience building, optimizing, and maintaining large scale data pipelines
• 5+ years of hands-on experience AWS data engineering experience, including Spark workload management across EMR, Glue, and S3 based data lake environments
• 5+ years of hands-on experience Apache Iceberg knowledge, including Lakehouse table management, schema evolution, performance optimization, and Spark integration
• 5+ years of hands-on experience Airflow orchestration experience, including DAG development, workflow monitoring, and integration with AWS services such as S3, EMR, Lambda, and CloudWatch
• Remote in Texas (Must be located or close to Irving, Texas) 225 E John W Carpenter Fwy Ste 500, Irving, TX 75062
• Opportunities to travel through your work (0-10%)
• Willingness to work a flexible schedule to accommodate business needs and travel as required