Databricks Support Engineer
Detroit, Michigan, United States of America
Contract
2 weeks ago
Key skills
SQLETLData EngineeringDatabricksAirflow
About this role
Role : Databricks Support Engineer
Location: Detroit MI Dayone Onsite
Duration : Long Term
Must take calls on Saturday with engineers.
About role - We are seeking a Databricks Support Engineer with strong experience in production support and data platform operations. The ideal candidate will be responsible for monitoring, troubleshooting, and maintaining Databricks-based data pipelines and ensuring high availability of data platforms. This role requires hands-on expertise in handling P1/P2 incidents, supporting critical data workloads, and working closely with data engineering and DevOps teams in a fast-paced environment.
Key Responsibilities
- Provide production support for Databricks-based data pipelines and workflows
- Monitor jobs, clusters, and data pipelines to ensure smooth operations
- Handle P1/P2 incidents, perform troubleshooting, and ensure timely resolution
- Perform root cause analysis (RCA) and implement preventive measures
- Support batch and streaming data pipelines built using Databricks (PySpark/SQL)
- Manage and optimize Databricks clusters for performance and cost
- Work closely with Data Engineering, DevOps, and Business teams during issue resolution
- Ensure adherence to SLAs and maintain system uptime
- Maintain logs, documentation, and incident reports
- Participate in on-call rotation and weekend (Saturday) support
Required Skills
- Strong hands-on experience with Databricks
- Experience in production support / incident management (P1/P2)
- Good knowledge of PySpark and SQL
- Experience with Delta Lake, data pipelines, and ETL workflows
- Familiarity with job scheduling tools (Databricks Workflows, Airflow, Control-M, etc.)
- Strong troubleshooting and debugging skills
- Understanding of monitoring and alerting tools