Senior/Lead Data Engineer

Diverse Lynx is seeking a Senior/Lead Data Engineer to support healthcare reporting, analytics, and operational data solutions. The role designs and supports scalable cloud data pipelines, enterprise data warehouses, CI/CD processes, data quality controls, and production systems while providing technical leadership and mentorship.

Responsibilities:

• Design, develop, test, deploy, and support scalable batch and near-real-time data pipelines using Snowflake and IDMC
• Implement ETL/ELT solutions, dimensional models, and SCD Types 1 and 2 for enterprise DW
• Develop efficient SQL and Python components, reusable frameworks, automation, and validation utilities
• Build CI/CD pipelines for data code, IDMC assets, Snowflake objects, testing, and environment promotion
• Eligible to workimize Snowflake performance, scalability, reliability, security, and cost; support AWS and/or Databricks workloads
• Implement data quality, reconciliation, lineage, monitoring, governance, and audit controls
• Troubleshoot production issues and partner with architecture, QA, DevOps, analytics, and business teams
• Lead design and code reviews, mentor engineers, and drive engineering standards and solution ownership

Requirements:

• 8+ years in data engineering, ETL development, and enterprise data warehousing
• Strong Snowflake expertise in SQL, data loading, security, performance tuning, scalability, and cost Eligible to workimization
• Strong IDMC development experience with CDI mappings, tasks, taskflows, parameters, deployment, and monitoring
• Proficiency in Python and SQL, plus Git-based CI/CD using Jenkins, Azure DevOps, GitHub Actions, or similar tools
• Hands-on experience with AWS data services and/or Databricks/Spark, including data quality, governance, and production support
• Strong analytical, troubleshooting, communication, documentation, and stakeholder-management skills
• Bachelor's degree in a relevant field or equivalent experience
• Healthcare data experience across claims, eligibility, provider, clinical, or pharmacy domains
• Exposure to Snowpark, PySpark, AWS Glue/S3/Lambda, streaming, or automated data testing
• Snowflake, Informatica, AWS, or Databricks certification is a plus