Databricks AI & Governance

Key Responsibilities
Design, develop, and deploy Agentic AI solutions that automate data governance, data quality, metadata management, lineage analysis, policy enforcement, and stewardship workflows
Build scalable AI agents using Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), orchestration frameworks, and enterprise governance tools
Partner with Data Governance Engineers, Data Engineers, Architects, and business stakeholders to identify governance use cases and define agent capabilities aligned with enterprise data strategy
Develop and maintain autonomous and human-in-the-loop agents supporting data cataloging, business glossary management, policy compliance validation, data ownership assignment, issue remediation, and governance workflow orchestration
Integrate AI agents with data catalogs, metadata repositories, data quality tools, MDM platforms, cloud data platforms, and governance technologies including Ataccama, Collibra, Informatica, Microsoft Purview, Databricks, Snowflake, AWS, and Azure
Create proof-of-value demonstrations and pilot implementations to validate governance automation opportunities and accelerate stakeholder adoption
Collaborate with internal delivery teams and client stakeholders to refine governance backlogs, prioritize agent development initiatives, and incrementally onboard governance controls
Implement monitoring, observability, guardrails, and governance controls for Agentic AI solutions to support security, compliance, transparency, and responsible AI practices
Support proposal development, solution architecture discussions, effort estimation, and client presentations related to Data and AI governance modernization
Contribute to reusable frameworks, accelerators, and best practices for enterprise-scale Agentic AI implementations focused on data governance and management

Required Qualifications
8+ years of experience
Bachelors Degree

Skills
Agentic AI Development
Generative AI
AI/ML Development
Python
LangChain
Semantic Kernel
AutoGen
OpenAI
Azure AI Foundry
Amazon Bedrock
Retrieval-Augmented Generation (RAG)
Azure
AWS
Google Cloud Platform
Databricks
Collibra
Ataccama
Informatica
Microsoft Purview
Snowflake
API Design
Workflow Orchestration
Event-Driven Architecture
AI Monitoring and Observability
Data Governance
Metadata Management
Master Data Management (MDM)
Data Quality Management
Enterprise Data Architecture
Regulatory Compliance Solutions
Requirements Gathering
Client Communication
Agile Delivery
Solution Architecture

Schedule
Start date: 2026-09-25