Data Engineer II-AWS

VERSANT is a leading force in news, sports and entertainment, and they are seeking a Data Engineer II to work on their data systems and services. The role involves designing, building, testing, and maintaining data pipelines critical to Versant's Digital Platform Ventures business.

Responsibilities:

• Contribute to and help team in design, build, testing, scaling, and maintaining data pipelines from a variety of source systems and streams (Internal, third party, cloud based, etc.), according to business and technical requirements
• Continually work on improving the codebase and have active participation and oversight in all aspects of the team, including agile ceremonies
• Collaborate with engineers and product managers to understand data needs. Participate in Agile ceremonies (standups, retros, sprint planning, etc.)
• Troubleshoot and fix production issues as they occur

Requirements:

• Bachelor's degree in Computer Science, Computer Engineering, or related technical field, or equivalent practical experience
• 5+ years of applied experience in Data Engineering, including but not limited to: building Data Pipelines, Orchestration, Data Modeling & Data Lake
• Programming skills in one or more of the following: Python, Java, Scala, plus SQL and experience in writing reusable/efficient code to automate analysis and data processes
• Experience in Data Warehousing (Relational and dimensional data modeling)
• Strong working experience with a variety of data sources such as APIs, real-time feeds, structured and semi-structured file formats
• Experience with processing large datasets and building code using Glue, Apache Airflow / Amazon MWAA, SQL, Python, and pySpark. Experience of near Real Time & Batch Data Pipeline development
• Experience with AWS data management (S3, Redshift, DynamoDB) and related tools (Athena, EMR, Glue, Lambda)
• Experience working in an agile/scrum environment
• Familiar with software build, release, deployment and monitoring tools and practices
• Experience with Talend, Informatica, or other off-the-shelf ETL tools
• Experience working with Terraform
• Strong Test-Driven Development background, with understanding of levels of testing required to continuously deliver value to production
• Team-oriented and collaborative approach with a demonstrated aptitude, enthusiasm, and willingness to learn new methods, tools, practices, and skills
• Ability to work effectively across functions, disciplines, and levels