Mindlance is seeking a Senior Data Engineer with strong experience in Azure Databricks and AI/LLM infrastructure to support next-gen analytics in a regulated healthcare environment. The role involves building and scaling data engineering pipelines and developing AI-powered data platforms while ensuring data compliance and governance.
Responsibilities:
- Build and scale data engineering pipelines using Databricks, Spark, Python, and SQL
- Develop and support AI-powered data platforms integrating LLMs (Claude or similar)
- Work on unstructured → structured data transformation (complaints, quality, service data, etc.)
- Enable AI-driven analytics across quality, manufacturing, and business functions
- Ensure data compliance, governance, and traceability in regulated environments
Requirements:
- Strong hands-on experience with Azure Databricks
- Expertise in data engineering (ETL/ELT, pipelines, Spark, Delta Lake)
- Proficiency in Python & SQL
- Exposure to AI/ML or LLM infrastructure (Generative AI, NLP, RAG, etc.)
- Experience in pharma / medical device or other regulated domains (FDA, GxP)
- Experience with Claude (Anthropic) or similar LLMs
- Knowledge of data governance, compliance, and audit frameworks
- Integration experience with enterprise systems (SAP, Salesforce, QMS tools)
- Master's degree preferred