Databricks Platform and DevSecOps Engineer

Peregrine Advisors is an AI and data innovation hub helping government solve complex problems across strategy, governance, architecture, engineering, analytics, and artificial intelligence. The Databricks Platform and DevSecOps Engineer will build and operate Azure Databricks environments, deployment automation, infrastructure-as-code workflows, and CI/CD pipelines while supporting platform performance, migration, cutover, and production operations.

Responsibilities:

• Stand up and maintain the Azure Databricks environments, including the access, secrets, and networking they depend on
• Build the deployment automation that promotes work between environments, using Declarative Automation Bundles (formerly Databricks Asset Bundles), infrastructure as code, and continuous integration and continuous delivery (CI and CD) pipelines
• Tune Delta pipelines and platform performance
• Run platform operations, and write the runbooks that let someone else operate what you built
• Support environment parity, migration, and cutover alongside the Databricks team, under Peregrine change control, including bindings, rollback, and the evidence a release review needs
• You deliver environments that behave the same way twice and a deployment path the team can use without asking you
• You automate the promotion, checks, and evidence that would otherwise be assembled by hand before every release, and you leave the runbooks and controls that keep the platform supportable after cutover

Requirements:

• • 4+ years of platform engineering, DevSecOps, or cloud infrastructure experience
• • Hands-on Azure Databricks platform work, including Unity Catalog and Delta pipeline performance
• • Deployment automation and environment promotion, including infrastructure as code and continuous integration and continuous delivery (CI and CD) pipelines
• • Cloud networking, secrets management, and least-privilege access design in a governed environment
• • Platform operations for a production data platform
• • Migration and cutover support, including environment parity, rollback planning, and the evidence a release review asks for
• • Scripting in Python or Bash, and Git-based version control
• • Platform or DevSecOps work in at least one cloud environment other than Databricks, for example Microsoft Azure, Amazon Web Services (AWS), or Google Cloud
• • Delivery experience in a federal government environment, working to its security, access, and review processes
• • Proficiency in writing, PowerPoint, and Excel
• • Hands-on work with Azure Databricks environments, including Unity Catalog and Delta performance
• • The deployment craft around the platform, including infrastructure as code, environment promotion, and release automation
• • Working depth in a second cloud platform, so you can judge a design on its tradeoffs rather than one vendor's defaults
• • The operations discipline that migration and cutover demand, including parity, rollback, and evidence
• • Experience on a federal system accredited at Impact Level 5 (IL-5) or higher
• • Declarative Automation Bundles (formerly Databricks Asset Bundles), Terraform, or Azure DevOps pipelines
• • Databricks certification, or an Azure or Amazon Web Services cloud certification
• • Federal security experience supporting compliance frameworks, security controls, and authorization evidence
• • Familiarity with artificial intelligence (AI)-assisted developer tooling