Data Engineer II-AWS

VERSANT is a leading force in news, sports and entertainment, home to iconic and trusted brands. As a Data Engineer II, you will work on data systems and services to deliver critical projects for Versant Digital Platform Ventures, collaborating with engineers and product managers to understand data needs and troubleshoot production issues.

Responsibilities:

• Contribute to and help team in design, build, testing, scaling, and maintaining data pipelines from a variety of source systems and streams (Internal, third party, cloud based, etc.), according to business and technical requirements
• Continually work on improving the codebase and have active participation and oversight in all aspects of the team, including agile ceremonies
• Collaborate with engineers and product managers to understand data needs. Participate in Agile ceremonies (standups, retros, sprint planning, etc.)
• Troubleshoot and fix production issues as they occur

Requirements:

• Bachelor's degree in Computer Science, Computer Engineering, or related technical field, or equivalent practical experience
• 5+ years of applied experience in Data Engineering, including but not limited to: building Data Pipelines, Orchestration, Data Modeling & Data Lake
• Programming skills in one or more of the following: Python, Java, Scala, plus SQL and experience in writing reusable/efficient code to automate analysis and data processes
• Experience in Data Warehousing (Relational and dimensional data modeling)
• Strong working experience with a variety of data sources such as APIs, real-time feeds, structured and semi-structured file formats
• Experience with processing large datasets and building code using Glue, Apache Airflow / Amazon MWAA, SQL, Python, and pySpark. Experience of near Real Time & Batch Data Pipeline development
• Experience with AWS data management (S3, Redshift, DynamoDB) and related tools (Athena, EMR, Glue, Lambda)
• Experience working in an agile/scrum environment
• Familiar with software build, release, deployment and monitoring tools and practices
• Experience with Talend, Informatica, or other off-the-shelf ETL tools
• Experience working with Terraform
• Strong Test-Driven Development background, with understanding of levels of testing required to continuously deliver value to production
• Team-oriented and collaborative approach with a demonstrated aptitude, enthusiasm, and willingness to learn new methods, tools, practices, and skills
• Ability to work effectively across functions, disciplines, and levels