TEKsystems is a leading provider of business and technology services, and they are seeking a Senior Data Engineer with expertise in Astronomer/Astro and strong Python development skills. This role will lead the implementation of Astronomer and dbt within their data environment, focusing on best practices, scalability, and cost optimization while collaborating with the data team to design and orchestrate data workflows.
Responsibilities:
- Implement Astronomer/Astro and dbt using Cosmos for data orchestration and transformation
- Design and develop reusable, maintainable data workflows
- Ensure data quality, integrity, and cost-effective solutions
- Provide training and guidance to the data team on best practices
- Collaborate closely with team members to ensure smooth integration and knowledge transfer
Requirements:
- Hands-on experience implementing Astronomer/Astro and dbt using Cosmos for data orchestration and transformation
- Strong Python programming for data workflows and automation
- Experience with data movement, transformation, and optimization
- Ability to design reusable, maintainable solutions with a cost-effective approach
- Ability to design and manage dynamic, production-grade DAGs, including task dependencies and inter-task communication (XCom)
- Minimum 3+ years in data engineering with Astronomer/Airflow and Python
- Preference for candidates who have completed at least one full Astronomer implementation or worked in a mature environment with these tools
- Total IT experience: ideally 5+ years
- Familiarity with SQL Server, Oracle, Excel, and API integrations
- Experience with dbt (Data Build Tool) for data transformation
- API integration skills for connecting diverse data sources
- Familiarity with CI/CD practices - Azure DevOps/Git