Mastech Digital is seeking an Azure Data Engineer with expertise in Databricks. The role involves building scalable data pipelines, troubleshooting production workloads, and participating in design discussions within Agile teams.
Responsibilities:
- 5+ years of data engineering experience, with hands-on expertise in Azure Databricks and/or Azure Synapse
- Strong experience with Spark (PySpark/Scala) and Python for data processing
- Experience building scalable data pipelines in cloud environments (Azure preferred)
- Familiarity with data lakes, Delta Lake, and distributed processing frameworks
- Strong SQL skills and experience with relational databases
- Able to work independently with minimal guidance and deliver end-to-end solutions
- Participates in design discussions and Agile ceremonies
- Troubleshoots, optimizes, and supports production workloads
Requirements:
- 5+ years of data engineering experience, with hands-on expertise in Azure Databricks and/or Azure Synapse
- Strong experience with Spark (PySpark/Scala) and Python for data processing
- Experience building scalable data pipelines in cloud environments (Azure preferred)
- Familiarity with data lakes, Delta Lake, and distributed processing frameworks
- Strong SQL skills and experience with relational databases
- Able to work independently with minimal guidance and deliver end-to-end solutions
- Participates in design discussions and Agile ceremonies
- Troubleshoots, optimizes, and supports production workloads