AWS & Databricks Administrator

AWS & Databricks Administrator

Location: Santa Clara, CA (Onsite)

Duration: 6-12+ months (Contract)



Overview

We are seeking a highly skilled AWS & Databricks Administrator to architect, manage, and optimize enterprise cloud and data platforms. This role will focus on supporting SAP workloads on AWS, governing Databricks architecture, and ensuring secure, scalable integrations across enterprise systems. The ideal candidate will bring deep expertise in AWS services, Databricks administration, Informatica platforms, and containerized workloads, with a strong emphasis on automation, observability, and operational resilience.

Key Responsibilities

• Architect and support AWS infrastructure for SAP workloads (S/4HANA, BW/4HANA, integrations, storage, networking, identity, backup, HA/DR).
• Design and manage AWS services: VPC, Transit Gateway, EC2, EBS, S3, IAM, KMS, Route 53, CloudWatch, CloudTrail, AWS Backup, load balancers, and security services.
• Define and govern Databricks architecture on AWS (workspace strategy, network isolation, Unity Catalog, cluster policies, orchestration, cost optimization).
• Establish scalable data-lakehouse patterns using Delta Lake, medallion architecture, Spark, Python, SQL, streaming, and batch pipelines.
• Administer Informatica platforms (PowerCenter, IDMC/IICS, Data Quality, MDM), including runtime environments, repositories, schedules, upgrades, and monitoring.
• Design secure integration patterns between SAP, Informatica, Databricks, AWS services, and downstream analytics/reporting systems.
• Build and maintain Git-based CI/CD pipelines for infrastructure, Databricks assets, Informatica deployments, APIs, and containerized workloads.
• Implement infrastructure-as-code using Terraform, CloudFormation, Pulumi, or equivalent tools.
• Architect and support Amazon EKS clusters and containerized workloads using Docker, Kubernetes, Helm, Argo CD, Flux, or GitOps tooling.
• Establish DevSecOps controls: code scanning, dependency scanning, container-image scanning, secrets management, RBAC, encryption, and audit logging.
• Implement observability with centralized logs, metrics, alerts, dashboards, and tracing (CloudWatch, Prometheus, Grafana, ELK/OpenSearch, Datadog, Splunk).
• Lead production support for high-severity incidents, conduct RCA, and improve operational runbooks.
• Define standards for availability, resilience, patching, release management, change controls, capacity planning, performance tuning, and cost optimization.
• Mentor engineering teams, conduct architecture reviews, and communicate technical decisions to leadership.