Senior Data Engineer

Mindlance is seeking a Senior Data Engineer with strong experience in Azure Databricks and AI/LLM infrastructure to support next-gen analytics in a regulated healthcare environment. The role involves building and scaling data engineering pipelines and developing AI-powered data platforms while ensuring data compliance and governance.

Responsibilities:

• Build and scale data engineering pipelines using Databricks, Spark, Python, and SQL
• Develop and support AI-powered data platforms integrating LLMs (Claude or similar)
• Work on unstructured → structured data transformation (complaints, quality, service data, etc.)
• Enable AI-driven analytics across quality, manufacturing, and business functions
• Ensure data compliance, governance, and traceability in regulated environments

Requirements:

• Strong hands-on experience with Azure Databricks
• Expertise in data engineering (ETL/ELT, pipelines, Spark, Delta Lake)
• Proficiency in Python & SQL
• Exposure to AI/ML or LLM infrastructure (Generative AI, NLP, RAG, etc.)
• Experience in pharma / medical device or other regulated domains (FDA, GxP)
• Experience with Claude (Anthropic) or similar LLMs
• Knowledge of data governance, compliance, and audit frameworks
• Integration experience with enterprise systems (SAP, Salesforce, QMS tools)
• Master's degree preferred