Key skills
AirflowApacheAWSCloudPythonSQLELTData EngineeringSnowflakeApache Airflowdbt
About this role
Role Overview
- Develop and maintain ELT pipelines using Snowflake, Python, and Apache Airflow
- Implement data ingestion and transformation logic for batch and incremental pipelines
- Convert existing SQL transformations into dbt models
- Implement dbt testing frameworks (schema, relationship, freshness tests)
- Participate in pipeline walkthroughs and knowledge transfer sessions with the existing team
- Document data pipelines and operational procedures
- Support the transition from vendor-managed pipelines to Data Meaning ownership
- Monitor production pipelines and data workflows
- Troubleshoot pipeline failures and operational issues
- Improve monitoring, alerting, and operational reliability
- Implement automated data validation and quality checks
- Support the development of a data quality framework
Requirements
- 8+ years of experience in Data Engineering
- Hands-on experience with Snowflake
- Experience working with Apache Airflow
- Strong SQL (advanced) skills
- Strong Python programming skills
- Experience building: ELT pipelines, Data warehouse transformations, Batch and incremental pipelines, Data ingestion pipelines
- Experience working in cloud environments (AWS preferred)
Tech Stack
- Airflow
- Apache
- AWS
- Cloud
- Python
- SQL
Benefits
- Flexible work arrangements
- Collaborative, inclusive, and innovation-driven work culture