Databricks Engineer & AI Enablement Architect - Data Engineer III

Our Deloitte AI & Engineering team to transform technology platforms, drive innovation, and help make a significant impact on our clients’ success. You’ll work alongside talented professionals reimagining and reengineering operations and processes that are critical to businesses. Your contributions can help clients improve financial performance, accelerate new digital ventures, and fuel growth through innovation.

Work you'll do

As a Data Engineer III on the AI & Engineering team, you will be responsible for…

• Lead the governance, architecture, reliability, and operation of secure, scalable Databricks environments supporting the Data Aggregation Contract (CDAC)
• Establish workspace governance, Unity Catalog structures, access controls, service principals, and policies that protect protected health information (PHI) and sensitive healthcare data
• Define medallion architecture standards and build reusable ingestion and transformation frameworks for Centers for Medicare & Medicaid Services (CMS) claims, clinical, provider, quality, and oncology data
• Improve data quality and production reliability through validation, reconciliation, lineage, observability, service-level agreement monitoring, dashboards, and proactive alerts
• Establish continuous integration and continuous delivery (CI/CD) standards; review code, data models, and pipeline designs; and assess generative artificial intelligence (GenAI) and large language model (LLM) use cases for production readiness

A successful candidate would possess these skills:

• Ability to work independently and collaborate as part of a team
• Effective written and verbal communication skills
• Meticulous attention to detail and quality of work product
• Ability to build and sustain professional relationships
• Ability to lead projects or workstreams
• Ability to manage and prioritize multiple tasks in a fast-paced and dynamic environment
• Strong interpersonal skills and professional demeanor
• Ability to meet deadlines
• Ability to provide clear guidance to others

The team

Deloitte’s Government & Public Services (GPS) practice – our people, ideas, technology and outcomes – is designed for impact. Serving federal, state, & local government clients as well as public higher education institutions, our team of professionals brings fresh perspective to help clients anticipate disruption, reimagine the possible, and fulfill their mission promise.

Our AI & Data offering provides a full spectrum of solutions for designing, developing, and operating cutting-edge Data and AI platforms, products, insights, and services. Our offerings help clients innovate, enhance and operate their data, AI, and analytics capabilities, ensuring they can mature and scale effectively.

Qualifications

Required:

• Bachelor’s degree
• Ability to obtain and maintain the required clearance for this role
• 4+ years of Databricks engineering experience
• 4+ years of experience with Python, PySpark, and SQL, Delta Lake and Medallion Architecture
• 2+ years of experience in databricks architecture
• Ability to travel 10–15%, on average, based on the work you do and the clients and industries/sectors you serve
• Must be legally authorized to work in the United States without the need for employer sponsorship, now or at any time in the future

Preferred:

• Experience supporting federal healthcare clients or working with Centers for Medicare & Medicaid Services (CMS) claims, Medicaid or Medicare claims, clinical and provider data, quality measures, or longitudinal patient data
• Databricks Certified Data Engineer Professional, Data Analyst Associate, Machine Learning Professional, or Generative AI Engineer Associate certification
• Experience administering Databricks platforms, including Unity Catalog, workspace administration, cluster policies, service principals, secrets management, and role-based access controls
• Experience implementing Databricks Asset Bundles and Git-based continuous integration and continuous delivery (CI/CD) across development, test, and production environments

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Deloitte, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is $113,000 to $188,400.

You may also be eligible to participate in a discretionary annual incentive program, subject to the rules governing the program, whereby an award, if any, depends on various factors, including, without limitation, individual and organizational performance.