Key skills
AWSAzureETLPySparkPythonSparkSQLELTAnalyticsDatabricks
About this role
Role Overview
- Design and build scalable Databricks data pipelines
- Develop ETL/ELT pipelines using PySpark
- Implement data ingestion and transformation frameworks
- Optimize Spark workloads for performance and scalability
- Establish engineering standards and mentor engineers
- Collaborate with architecture and analytics teams to enable data products
Requirements
- Strong expertise in Python and SQL
- Deep experience with Databricks, PySpark, and Spark
- Experience building large-scale data pipelines
- Strong understanding of data transformation and distributed processing
- Ability to mentor engineers and influence engineering best practices
- Databricks certification
- AWS or Azure certification
Tech Stack
- AWS
- Azure
- ETL
- PySpark
- Python
- Spark
- SQL
Benefits
- PTO
- medical
- dental
- vision
- retirement savings
- disability insurance
- life insurance