Data Engineer

Cadmus is a company that provides technology-empowered advisory and implementation services. They are seeking a Data Engineer to support a major auto advertising platform by working on ETL migration from Google Cloud to AWS, ensuring business continuity, and optimizing code during the process.

Responsibilities:

• Document and highlight the business inputs
• Use the AWS data ingestion and ETL applications
• Use the AWS scheduling application
• Perform intense data testing
• Assess and verify the data after the code is migrated

Requirements:

• Needs to be able to understand the business logic behind the ETL code
• Needs to have excellent written and verbal communication skills and good public speaking and presentation skills
• Needs to have the ability to communicate with business stakeholders and refine their requests into technical specifications
• Needs to have willingness to take ownership of new projects and drive them to completion
• Needs to have passion for continuous integration, testing, and automation
• Needs to have 5+ years experience in data engineering development and/or big data management and solutions
• Needs to have 2+ years experience in the following tech stack: Apache Spark (Scala), Python, Scala, Apache Airflow, AWS, Google Cloud Platform (GCP), Apache Hive, Big Data technologies (distributed systems, large-scale data processing), Kubernetes (Pods, containerized workloads), BigQuery or similar data warehouse technologies, Familiarity with REST API consumption patterns