Data Engineer

Dice is the leading career destination for tech experts at every stage of their careers, and they are seeking a Data Engineer to build and scale data infrastructure. The role involves developing data pipelines, ensuring reliable data delivery, and mitigating system risks in a collaborative environment.

Responsibilities:

• You will be responsible for the end-to-end development of data pipelines, from requirement gathering to post-production support
• You will proactively identify system risks, troubleshoot defects with high urgency, and ensure the absolute reliability of our data delivery

Requirements:

• Proven experience building and maintaining data pipelines in AWS
• Expertise in developing and optimizing ETL jobs within Databricks
• Hands-on experience with Snowflake data warehousing
• Proficiency in Infrastructure as Code using Terraform
• Experience managing CI/CD pipelines via Concourse or GitHub Actions
• Strong background in technical documentation and creating architectural specifications
• Experience in risk mitigation and high-availability system design
• Background in Quality Assurance and post-delivery support for data products