Data Meaning is a front-runner in Business Intelligence and Data Analytics consulting, renowned for our high-quality consulting services throughout the US and beyond. They are proactively searching for Senior Data Engineers to support future projects and platform modernization efforts across their client portfolio.
Responsibilities:
- Develop and maintain ELT pipelines using Snowflake, Python, and Apache Airflow
- Implement data ingestion and transformation logic for batch and incremental pipelines
- Convert existing SQL transformations into dbt models
- Implement dbt testing frameworks (schema, relationship, freshness tests)
- Participate in pipeline walkthroughs and knowledge transfer sessions with the existing team
- Document data pipelines and operational procedures
- Support the transition from vendor-managed pipelines to Data Meaning ownership
- Monitor production pipelines and data workflows
- Troubleshoot pipeline failures and operational issues
- Improve monitoring, alerting, and operational reliability
- Implement automated data validation and quality checks
- Support the development of a data quality framework
Requirements:
- Advanced/fluent english
- 8+ years of experience in Data Engineering
- Hands-on experience with Snowflake
- Experience working with Apache Airflow
- Strong SQL (advanced) skills
- Strong Python programming skills
- Experience building: ELT pipelines, Data warehouse transformations, Batch and incremental, pipelines, Data ingestion pipelines
- Experience working in cloud environments (AWS preferred)
- Experience implementing dbt
- Experience with data platform migrations
- Experience with data pipeline performance optimization