Marlabs is supporting a forward-thinking public-sector organization seeking a Senior Data Engineer with strong experience in Astronomer/Astro and Python. This role will lead the implementation of Astronomer and dbt, establishing best practices for a modernized data engineering environment.
Responsibilities:
- Implement Astronomer/Astro and dbt using Cosmos for orchestration and transformation
- Design and build scalable, maintainable, and cost-effective data workflows
- Develop Python-based automation and pipelines
- Ensure data quality, reliability, and performance
- Provide knowledge transfer, mentorship, and guidance to an experienced and collaborative data team
- Work closely with the Data Architect and Data Engineers on modernization efforts
Requirements:
- 3+ years of hands-on data engineering with Astronomer/Airflow and Python
- Experience designing dynamic, production-grade Airflow DAGs (task dependencies, XCom, best practices)
- Experience implementing Astronomer or working in a mature Astro environment
- 5+ total years in IT preferred
- Familiarity with SQL Server, Oracle, Excel, and API integrations (ESRI is a bonus)
- Experience with dbt (Data Build Tool)
- Understanding of data modeling, incremental loads, and data quality practices
- Familiarity with CI/CD pipelines (Azure DevOps, Git)