Key skills
DatabricksDelta LakeUnity CatalogSparkDatabricks WorkspacesAzure cloud servicesAzure DevOpsGitHub workflowsCI/CD pipelinesAPIsDistributed application integrationsEnterprise data platformsPySparkPythonSQLSpark SQLScalaAKSKubernetesTerraformBicepInfrastructure as CodeAzure Data LakeEvent HubStreaming architecturesAzure MonitorDatadogStakeholder collaborationData EngineeringData LakeAnalyticsAzureCommunicationCollaboration
About this role
Dice is seeking an Azure Databricks Data Engineer to support enterprise Databricks environments and cloud-native platform concepts. The role involves troubleshooting, operational support, and collaboration with stakeholders to enhance data engineering capabilities.
Requirements:
- 6+ years of experience within cloud, platform engineering, data engineering, or enterprise analytics ecosystems
- 3+ years of hands-on experience supporting enterprise Databricks environments
- Strong experience with Delta Lake
- Strong experience with Unity Catalog
- Strong experience with Spark workloads
- Strong experience with cluster operations
- Strong experience with Databricks Workspaces
- Experience with Azure cloud services and cloud-native platform concepts
- Strong troubleshooting and operational support capabilities
- Strong communication and stakeholder collaboration skills
- Experience with PySpark
- Experience with Python
- Experience with SQL
- Experience with Spark SQL
- Experience with Scala
- Familiarity with AKS/Kubernetes
- Familiarity with Terraform
- Familiarity with Bicep
- Familiarity with Infrastructure as Code practices
- Experience with Azure Data Lake
- Experience with Event Hub
- Experience with streaming architectures
- Experience with enterprise analytics environments
- Familiarity with monitoring and observability platforms such as Azure Monitor
- Familiarity with monitoring and observability platforms such as Datadog
- Exposure to enterprise modernization and cloud migration initiatives