Key skills
AWSAzureETLPySparkPythonSparkSQLAIELTAnalyticsDatabricksPerformance OptimizationCommunication
About this role
Role Overview
- Design and develop scalable data pipelines that support analytics, reporting, and AI initiatives across the enterprise data platform
- Build and maintain PySpark pipelines in Databricks
- Develop scalable data ingestion and transformation workflows
- Implement data validation and quality checks
- Optimize Spark workloads and processing performance
- Work closely with architecture and analytics teams
Requirements
- Strong expertise in Python and SQL
- Experience with PySpark, Spark, and Databricks
- Experience building ETL/ELT pipelines
- Strong understanding of data transformation and performance optimization
- Strong communication and teamwork skills
- Ability to collaborate across engineering and analytics teams
- Passion for building scalable data systems
- Bonus: Databricks certification, AWS or Azure certification
Tech Stack
- AWS
- Azure
- ETL
- PySpark
- Python
- Spark
- SQL
Benefits
- PTO
- Medical
- Dental
- Vision
- Retirement savings
- Disability insurance
- Life insurance