Key skills
SQLMLflowData EngineeringData WarehousingSnowflakeDatabricksSparkApache SparkKafkaApache KafkadbtAWSAzureGoogle CloudTerraformGlueGitCI/CD
About this role
Job Responsibilities and Qualifications for Databricks Architect:
- 8+ years of overall Data Engineering experience.
- 3+ years of hands-on experience with Databricks.
- Strong expertise in Apache Spark and PySpark.
- Advanced SQL programming skills.
- Experience implementing Delta Lake and Lakehouse architecture.
- Strong understanding of data warehousing concepts and dimensional modeling.
- Experience with batch and real-time data processing.
- Hands-on experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
- Experience with Git, CI/CD, and DevOps practices.
- Knowledge of data governance, data quality, and metadata management.
-
Experience with:
- Azure Data Factory or AWS Glue
- Apache Kafka
- dbt
- Snowflake
- Terraform or Infrastructure as Code
- Unity Catalog and Databricks Workflows
- MLflow