Mactores is an AWS modernization firm focused on delivering production systems and retiring legacy systems efficiently. They are seeking a Senior AWS Data Engineer to build and maintain data pipelines, design data models, and collaborate with teams to optimize data solutions within their Data Platform Modernization pillar.
Responsibilities:
- Build and maintain data pipelines on Amazon EMR or Amazon Glue that run in production
- Design data models and end-user querying on Amazon Redshift or Snowflake, Amazon Athena, and Presto
- Build and maintain pipeline orchestration with Airflow
- Work with customer and internal teams to understand data needs and design the solutions that meet them
- Troubleshoot and optimize pipelines and data models until they hold up under real load
- Write and maintain PySpark and SQL scripts to extract, transform, and load data
- Document and communicate technical decisions to technical and non-technical audiences — customers sign off on what we ship
- Track new AWS data technologies and judge their impact on the systems we run
Requirements:
- Bachelor's degree in Computer Science, Engineering, or a related field
- 3+ years of experience working with PySpark and SQL
- 2+ years of experience building and maintaining data pipelines using Amazon EMR or Amazon Glue
- 2+ years of experience with data modeling and end-user querying using Amazon Redshift or Snowflake, Amazon Athena, and Presto
- 1+ years of experience building and maintaining pipeline orchestration using Airflow
- Strong problem-solving and troubleshooting skills
- Excellent communication and collaboration skills
- Ability to work independently and within a team environment
- AWS Data Analytics Specialty Certification
- Experience with Agile development methodology