Key skills
AirflowApacheETLPythonScalaSQLUnityData EngineeringData LakeAnalyticsSnowflakeDatabricksdbtAthenaDatadogCI/CDCommunicationCollaboration
About this role
Role Overview
- Designing and maintaining scalable data pipelines for ingestion, transformation, and delivery across multiple data sources
- Collaborating with Analytics Engineers and Product teams to curate datasets and establish data contracts that improve transparency and reliability
- Developing and managing modern data architectures, such as lakehouses and medallion layers, using tools like Databricks, Delta Lake, or Iceberg
- Optimizing Snowflake usage and performance, ensuring data quality and cost efficiency
- Supporting and scaling orchestration platforms (like Dagster), metadata systems (like Unity Catalog or Collibra), and monitoring tools (like Datadog)
- Collaborating with data engineering, analytics engineering, and security teams to deliver stable and efficient infrastructure for diverse workflows
- Building tools, alerting systems, and documentation that ensure reliable operation and developer self-service across our data stack
Requirements
- 8+ years of experience in data engineering or platform/infrastructure roles, with a focus on scaling tools and systems
- Expertise in Python or Scala, and strong proficiency in SQL for data modeling and optimization
- Deep experience with data warehouse technologies like Snowflake, including clustering, performance tuning, query profiling, and access management
- Experience with data lake and lakehouse architectures such as Databricks, Delta Lake, Iceberg, or Apache Hudi, and query engines like Athena or Presto
- Proven ability to design and implement scalable ETL pipelines using technologies like dbt for transformation and Databricks for large-scale processing
- Familiarity with managing infrastructure-as-code, job orchestration (Dagster, Airflow), and CI/CD workflows
- A proactive mindset and strong problem-solving skills, especially when troubleshooting complex infrastructure issues
- Excellent collaboration and communication skills to support cross-functional teams and data consumers
Tech Stack
- Airflow
- Apache
- ETL
- Python
- Scala
- SQL
- Unity
Benefits
- Flexible work environment
- Unlimited Vacation
- 100% paid employee health benefit options (including medical, dental, and vision)
- Commuter Benefits
- 401(k) with employer funded match
- Corporate wellness program with Wellhub
- Sabbatical leave (for employees with 5+ years of service)
- Competitive paid parental leave and fertility/family planning reimbursement
- Cell phone reimbursement
- Catered lunch everyday along with beverages and snacks
- Employee Resource Groups and ZocClubs to promote shared community and belonging
- Great Place to Work Certified