Key skills
Data EngineeringDatabricksAWSTerraformCloudFormationGitOpsCI/CDLeadership
About this role
Raval West is seeking a Senior Databricks Platform Engineer who will design, build, and operate scalable and secure Databricks platforms. This role focuses on platform architecture, cloud automation, and developer enablement to ensure reliable and self-service data infrastructure.
Responsibilities:
- Design and implement scalable Databricks platform architecture (multi-tenant, secure-by-default)
- Build infrastructure-as-code (Terraform/CloudFormation) and GitOps workflows
- Develop platform APIs, templates, and automation to simplify data engineering workflows
- Implement auto-scaling, cost optimization, and lifecycle management
- Build and maintain CI/CD pipelines for data and platform deployments
- Implement observability, monitoring, and auto-healing systems
- Optimize performance, reliability, and cloud spend at scale
- Implement policy-as-code and automated controls aligned with HIPAA, NIST, and State standards
- Automate vulnerability management, patching, and audit evidence collection
- Design secure, compliant-by-default platform guardrails
- Provide hands-on leadership through code reviews and architecture guidance
- Mentor engineers on platform engineering and cloud-native best practices
- Partner with data, security, and application teams to drive platform adoption
Requirements:
- 8+ years of cloud/platform engineering experience
- Strong expertise with Databricks and AWS
- Experience with Infrastructure as Code (Terraform), CI/CD, and GitOps
- Deep understanding of distributed systems, security, and compliance automation
- Experience supporting regulated environments (healthcare/public sector preferred)