Lead Data Engineer – AI Platforms & Healthcare Data

US Tech Solutions is seeking a highly capable Lead Data Engineer with expertise in modern cloud data engineering and AI-enabled data platforms. The role involves designing and building scalable data pipelines, leading engineering teams, and developing AI-driven data solutions, particularly in the healthcare sector.

Responsibilities:

• Design and build scalable batch + streaming data pipelines using Spark, Kafka, Airflow, Databricks, Snowflake, and cloud-native services
• Architect modern Lakehouse / warehouse platforms across AWS, Azure, or GCP
• Develop AI-enabled data solutions including LLM integrations, RAG pipelines, vector search, and intelligent analytics
• Build APIs / microservices using Python / FastAPI for data products
• Lead small to mid-size engineering teams and mentor developers
• Implement governance, monitoring, observability, lineage, and security controls
• Work with healthcare data such as claims, member, provider, patient, clinical, operational, or revenue-cycle data (preferred)
• Partner with business stakeholders and leadership to deliver roadmap priorities

Requirements:

• 7–10 years in Data Engineering / Data Platforms
• Strong Python, SQL, Spark / PySpark
• Hands-on Kafka / streaming platforms
• Databricks / Snowflake / Synapse / Redshift
• Airflow / orchestration tools
• AWS / Azure / GCP experience
• AI exposure: LLMs, RAG, Vector DB, ML pipelines
• Strong architecture + coding ability
• Team leadership experience
• Healthcare / payer / provider / hospital domain
• HIPAA / secure data environments
• Fraud, claims analytics, patient insights, care analytics
• Experience managing offshore/onshore teams