Key skills
PythonSparkSQLUnityData EngineeringBISnowflakeDatabricksCI/CDCollaborationRemote Work
About this role
Role Overview
- Design and implement the Unity Catalog structure
- Lead the migration of complex business logic from legacy systems
- Architect the internal transformation framework
- Serve as the resident query performance expert
- Govern the Databricks compute footprint
- Build and maintain CI/CD pipelines
- Architect the semantic layer in Omni
- Partner with cross-functional stakeholders to translate business questions
Requirements
- 8+ years in Data Engineering or Data Architecture
- Deep, hands-on experience in the Databricks ecosystem (Unity Catalog, Delta Lake, SQL Warehouses)
- Expert-level SQL and distributed computing skills
- Demonstrated experience in query optimization and data platform migration
- Proven experience building data transformation workflows using Delta Live Tables or custom Python/SQL Spark pipelines
- Strong command of dimensional modeling (Star and Snowflake schemas)
- Hands-on Unity Catalog experience
- Fluency with Delta Lake internals
- Hands-on experience with Omni or a comparable modern BI semantic layer
Tech Stack
- Python
- Spark
- SQL
- Unity
Benefits
- Fully remote work
- Professional development opportunities
- Cross-functional collaboration