AWS Databricks Platform Administrator

job summary:

We are seeking an experienced AWS Databricks Platform Administrator with 9 years of overall IT experience including substantial handson expertise in administering securing optimizing and supporting Databricks on AWS The role will own platform reliability governance security cost management automation and operational excellence across enterprise data and analytics workloads The ideal candidate combines strong Databricks administration skills with deep knowledge of AWS services infrastructure automation cloud security and production support

location: Raritan, New Jersey

job type: Contract

salary: $65 - 75 per hour

work hours: 8am to 4pm

education: Bachelors



responsibilities:

• Administer and support Databricks accounts workspaces Unity Catalog metastores clusters SQL warehouses jobs instance pools repositories libraries secrets and access controls on AWS
• Design and maintain secure scalable and highly available Databricks platform architecture aligned with enterprise cloud standards
• Manage identity and access through IAM roles and policies service principals single signon SCIM provisioning and rolebased access control
• Implement data governance using Unity Catalog including catalogs schemas external locations storage credentials privileges lineage and auditability
• Configure and troubleshoot AWS integrations such as S3 IAM VPC PrivateLink KMS CloudWatch CloudTrail Route 53 and Secrets Manager
• Establish cluster policies approved runtime standards library controls tagging autotermination serverless usage guidelines and workload isolation
• Monitor platform health performance job reliability capacity and usage proactively identify and resolve bottlenecks and recurring issues
• Drive FinOps practices by analyzing DBU and AWS consumption enforcing tagging and budgets optimizing compute configurations and reducing idle or inefficient resources
• Automate workspace provisioning configuration policy enforcement and operational tasks using Terraform Databricks Asset Bundles Databricks CLISDK Python and CICD pipelines
• Lead incident problem change release vulnerability and servicerequest management for the platform while meeting agreed SLAs and operational KPIs
• Plan and execute runtime upgrades platform migrations disasterrecovery tests backup validation and businesscontinuity activities
• Partner with data engineering analytics security networking cloud engineering and application teams to onboard workloads and resolve complex technical issues
• Maintain architecture diagrams runbooks standard operating procedures support documentation compliance evidence and knowledge articles
• Provide technical leadership mentor administrators and engineers conduct reviews and define platform standards and product roadmaps
• Coordinate with Databricks and AWS support teams for critical incidents product defects and service improvements

qualifications:

9 years of overall experience in cloud infrastructure data platforms DevOps platform engineering or production administration

5 years of handson Databricks administration experience preferably with enterprise deployments on AWS

Strong experience with Databricks account console workspace administration Unity Catalog cluster policies SQL warehouses jobs Delta Lake system tables and audit logs

Strong knowledge of AWS networking security storage encryption monitoring and identity services particularly VPC S3 IAM KMS PrivateLink CloudWatch and CloudTrail

Handson experience with infrastructure as code and automation using Terraform Python shell scripting REST APIs Databricks CLISDK and CICD tools

Proven experience supporting businesscritical platforms in production including incident response rootcause analysis change management capacity planning and SLA governance

Working knowledge of Linux administration networking DNS firewalls certificates proxies and secure connectivity patterns

Good understanding of Spark architecture Delta Lake workload performance data lakehouse patterns and troubleshooting distributed data workloads

Experience implementing security controls leastprivilege access secrets management encryption audit logging vulnerability remediation and compliance requirements

Bachelors degree in Computer Science Information Technology Engineering or a related discipline or equivalent relevant experience

skills:

EC2,AWS S3,VPC,AWS,Spark,audit logs,audit logging,cloud infrastructure,cloud security,cloud engineering,CloudWatch,CICD pipelines,CICD,data governance,data lakehouse,Delta Lake,data platforms,Databricks Platform,Databricks,DevOps platform,disaster recovery,distributed data,DNS,IAM,data engineering,Information Technology Engineering,Computer Science,infrastructure automation,secrets management,Monitoring observability,performance tuning,Python,REST APIs,Route 53,SQL,serverless,shell scripting,single signon,vulnerability remediation,Terraform,Coordinate,troubleshoot,reliability,proactively,access controls,access control,administration,architecture,architecture diagrams,automation,Automate,budgets,capacity management,secure connectivity,cost management,FinOps,encryption,governance,incident response,cost controls,mentor,operational excellence,policy enforcement,product defects,production support,compliance requirements,security controls,standard operating procedures,warehouses,technical leadership,product roadmaps,vulnerability

Equal Opportunity Employer: Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other legally protected group status.

At Randstad Digital, we welcome people of all abilities and want to ensure that our hiring and interview process meets the needs of all applicants. If you require a reasonable accommodation to make your application or interview experience a great one, please contact

Pay offered to a successful candidate will be based on several factors including the candidate's education, work experience, work location, specific job duties, certifications, etc. In addition, Randstad Digital offers a comprehensive benefits package, including: medical, prescription, dental, vision, AD&D, and life insurance offerings, short-term disability, and a 401K plan (all benefits are based on eligibility).

This posting is open for thirty (30) days.