AWS Data Engineer

HMG AMERICA LLC is seeking a highly skilled AWS Data Engineer to design, build, and optimize scalable, cloud-native data platforms. The ideal candidate will have strong experience in big data technologies and AWS services, focusing on building robust data pipelines.

Responsibilities:

• Design, develop, and maintain scalable data pipelines and data lake solutions on AWS
• Build and optimize large-scale distributed data processing systems
• Work with structured and unstructured data across multiple platforms
• Implement best practices for data governance, security, and performance
• Collaborate with cross-functional teams to deliver data-driven solutions

Requirements:

• Strong experience with big data and distributed systems such as Apache Spark, Iceberg, Hadoop, Redshift, and Hudi
• Hands-on expertise in Python, PySpark, and Shell scripting
• Extensive experience with AWS services including: AWS Glue, Lambda, Airflow, Lake Formation, EKS, EC2, SQS, SNS
• Proven experience in building and optimizing data pipelines and data lake architectures
• Ability to work in EST time zone
• Willingness to travel occasionally based on project needs
• Experience with Google Cloud Platform (GCP) and BigQuery
• Familiarity with dbt (Data Build Tool)
• Exposure to multi-cloud environments