Cloud Engineer – AWS GovCloud & Databricks Platform

Celebal Technologies is seeking a Cloud Engineer to design, implement, and operate secure cloud platforms on AWS GovCloud. The role focuses on Databricks platform engineering, infrastructure automation, and operational excellence to support enterprise-scale Data, Analytics, and AI workloads.

Responsibilities:

• Design and deploy AWS cloud infrastructure using Infrastructure as Code (Terraform)
• Build and manage Databricks environments across Development, Staging, and Production
• Implement secure networking architectures including VPCs, PrivateLink, Transit Gateway, Direct Connect, Security Groups, and NACLs
• Configure and manage IAM, AWS IAM Identity Center, SSO, SCIM, and role-based access controls
• Implement encryption and secrets management using AWS KMS and AWS Secrets Manager
• Develop and maintain CI/CD pipelines using GitHub Actions, GitLab CI/CD, or AWS CodePipeline
• Deploy and manage Databricks Asset Bundles (DAB), cluster policies, SQL Warehouses, Unity Catalog, and Delta Lake workloads
• Support data engineering, ML, and AI platform deployments in Databricks
• Implement governance, audit logging, monitoring, and compliance controls aligned with enterprise and GovCloud requirements
• Troubleshoot infrastructure, platform, networking, and deployment issues
• Collaborate with Data Engineers, Platform Engineers, Security Teams, and Architects to deliver enterprise cloud solutions

Requirements:

• Design and deploy AWS cloud infrastructure using Infrastructure as Code (Terraform)
• Build and manage Databricks environments across Development, Staging, and Production
• Implement secure networking architectures including VPCs, PrivateLink, Transit Gateway, Direct Connect, Security Groups, and NACLs
• Configure and manage IAM, AWS IAM Identity Center, SSO, SCIM, and role-based access controls
• Implement encryption and secrets management using AWS KMS and AWS Secrets Manager
• Develop and maintain CI/CD pipelines using GitHub Actions, GitLab CI/CD, or AWS CodePipeline
• Deploy and manage Databricks Asset Bundles (DAB), cluster policies, SQL Warehouses, Unity Catalog, and Delta Lake workloads
• Support data engineering, ML, and AI platform deployments in Databricks
• Implement governance, audit logging, monitoring, and compliance controls aligned with enterprise and GovCloud requirements
• Troubleshoot infrastructure, platform, networking, and deployment issues
• Collaborate with Data Engineers, Platform Engineers, Security Teams, and Architects to deliver enterprise cloud solutions
• AWS (EC2, S3, VPC, IAM, KMS, CloudWatch, Lambda, Direct Connect, Transit Gateway)
• Infrastructure as Code (Terraform)
• Databricks Administration
• Unity Catalog
• Delta Lake
• Databricks Workflows
• Cluster Policies
• SQL Warehouses
• GitHub Actions / GitLab CI/CD / CodePipeline
• Docker
• Bash / Python scripting
• IAM & RBAC
• Secrets Management
• Audit Logging
• Compliance & Security Best Practices
• Policy-as-Code (tfsec, Checkov)
• Bachelor's degree in Computer Science, Information Technology, or related field
• AWS GovCloud experience preferred
• MLflow (preferred)
• Kubernetes (EKS preferred)
• AI/ML Platform experience
• Databricks Certifications
• AWS Certifications
• Experience with Delta Sharing and Data Governance
• Experience working in regulated industries (Defense, Aerospace, Healthcare, Financial Services)
• AWS Certified Solutions Architect / SysOps / DevOps Engineer preferred
• Databricks Certified Associate or Professional certifications are a plus