Key skills
AWSAzureCloudETLGoogle Cloud PlatformPySparkPythonSQLUnityAIELTData EngineeringData WarehousingData LakeAnalyticsDatabricksGCPGoogle CloudGitHub ActionsAzure DevOpsGitGitHubVersion ControlCI/CD
About this role
Role Overview
- Automate and manage Databricks workspaces, clusters, Unity Catalog, identity
- Design, implement, and maintain CI/CD pipelines using GitHub Actions and Azure DevOps
- Establish and enforce platform guardrails including cluster policies, cost controls, logging, alerting
- Ensure platform health, scalability, reliability, and cost optimization across Databricks environments
- Provide tier‑3 operational support, troubleshoot complex incidents, and drive root‑cause resolution
- Collaborate with data engineering, analytics, and AI teams to enable efficient development and deployment of data solutions
Requirements
- 5 years of experience in designing, developing, and deploying solutions on the Databricks platform
- Proficiency in Python, including PySpark, and SQL
- Strong understanding of cloud platforms such as AWS, Azure, or GCP
- Hands‑on experience with data warehousing, data lake, and Lakehouse architectures
- Proven experience building and maintaining ETL and ELT pipelines
- Experience using Git‑based version control and CI/CD practices
Tech Stack
- AWS
- Azure
- Cloud
- ETL
- Google Cloud Platform
- PySpark
- Python
- SQL
- Unity
Benefits
- Health insurance
- 401(k) matching
- Paid time off
- Professional development opportunities