Fractal is a strategic AI partner to Fortune 500 companies, aiming to empower human decision-making in enterprises. They are seeking a Lead Data Engineer with expertise in Azure and the healthcare domain to design and implement scalable data platforms while ensuring compliance with healthcare regulations.
Responsibilities:
- Design enterprise-scale healthcare data platforms on Microsoft Azure
- Architect scalable, secure, and high-performing cloud-native data solutions
- Define end-to-end architecture for ingestion, transformation, storage, governance, and analytics
- Lead modernization and migration of legacy healthcare data systems to Azure
- Ensure architecture aligns with healthcare compliance and governance standards
- Design and implement large-scale ETL/ELT pipelines
- Build batch and real-time data processing solutions using Azure Databricks
- Develop scalable data ingestion frameworks for structured and unstructured healthcare data
- Optimize performance and scalability of Azure data platforms
- Implement Lakehouse/Data Lake architectures using Azure services
- Define and implement enterprise Data Quality (DQ) frameworks
- Establish DQ controls for completeness, consistency, accuracy, timeliness, and reconciliation
- Build automated validation and monitoring mechanisms
- Enable data lineage, metadata management, and governance practices
- Collaborate with governance teams to improve data reliability and trust
- Work with healthcare stakeholders to understand clinical, operational, and analytical data requirements
- Support healthcare data integration initiatives involving EMR/EHR systems, claims, patient, provider, and operational data
- Ensure compliance with healthcare regulations and data privacy standards
- Support healthcare analytics, reporting, and interoperability initiatives
- Collaborate with business leaders, product owners, architects, and engineering teams
- Translate business requirements into scalable technical solutions
- Lead client discussions, architecture reviews, and technical workshops
- Provide technical leadership and mentoring to engineering teams
- Manage communication with cross-functional stakeholders and leadership
Requirements:
- Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, Healthcare Informatics, or related field
- 10+ years of IT experience with strong focus on Data Engineering and Cloud Architecture
- 5+ years of hands-on Azure Data Platform experience
- Strong experience in Healthcare domain implementations
- Experience leading enterprise-scale cloud transformation initiatives
- Strong hands-on expertise in Azure Data Factory (ADF)
- Strong hands-on expertise in Azure Databricks
- Strong hands-on expertise in Azure Synapse Analytics
- Strong hands-on expertise in Azure Data Lake Storage (ADLS)
- Strong hands-on expertise in Azure SQL Database
- Strong hands-on expertise in Azure Functions
- Strong hands-on expertise in Azure DevOps
- Strong hands-on expertise in Azure Monitor
- Strong hands-on expertise in Microsoft Purview / Azure Purview
- Strong expertise in SQL and Python/PySpark
- Experience building enterprise-grade ETL/ELT pipelines
- Strong understanding of data modeling and distributed data processing
- Experience with Delta Lake and Lakehouse architectures
- Knowledge of batch and streaming data processing
- Experience implementing enterprise Data Quality frameworks
- Strong understanding of data validation, reconciliation, profiling, and monitoring
- Experience with DQ tools/frameworks such as Great Expectations, Deequ, Informatica DQ, or custom frameworks
- Understanding of data governance and observability
- Strong experience in Healthcare domain projects
- Knowledge of healthcare data models and workflows
- Understanding of EMR/EHR, claims, patient, provider, and clinical data
- Familiarity with healthcare compliance and data privacy standards
- Experience supporting healthcare analytics and reporting platforms
- Collaborate with business leaders, product owners, architects, and engineering teams
- Translate business requirements into scalable technical solutions
- Lead client discussions, architecture reviews, and technical workshops
- Provide technical leadership and mentoring to engineering teams
- Manage communication with cross-functional stakeholders and leadership
- Microsoft Certified: Azure Solutions Architect Expert
- Microsoft Certified: Azure Data Engineer Associate
- Databricks Certified Professional
- Healthcare or Data Governance certifications preferred
- Experience working with healthcare providers, payers, or life sciences organizations
- Exposure to AI/ML healthcare data platforms
- Experience with cloud governance and security frameworks
- Familiarity with Agile/Scrum methodologies
- Client-facing consulting experience