AWS Data Engineer

ST Global Tech LLC is seeking an AWS Data Engineer to join their team. The role involves developing and managing data pipelines, ensuring efficient data processing, and utilizing advanced Python skills for automation.

Responsibilities:

• Advanced Proficiency in Python concepts like Code Structures, Modules, Packages, Class, Sub Class, Inheritance, Multi-Threading and Functional Programming
• Experience in developing reusable Python packages for internal or public usage
• Ability to write automating ETL processes and scheduling jobs like Airflow DAG
• Ability to track job pipeline runs to reprocess error records
• Ability to orchestration different pipelines to run in sequence or parallel
• Troubleshoot data pipeline errors and fix issues
• Export or Import data to/from various formats like CSV, JSON, XML etc preferably from S3 or other cloud storage
• Experience in using AI IDE tool, AWS S3

Requirements:

• 15+ Years Experience
• Advanced Proficiency in Python concepts like Code Structures, Modules, Packages, Class, Sub Class, Inheritance, Multi-Threading and Functional Programming
• Experience in developing reusable Python packages for internal or public usage
• Ability to write automating ETL processes and scheduling jobs like Airflow DAG
• Ability to track job pipeline runs to reprocess error records
• Ability to orchestration different pipelines to run in sequence or parallel
• Troubleshoot data pipeline errors and fix issues
• Export or Import data to/from various formats like CSV, JSON, XML etc preferably from S3 or other cloud storage
• Experience in using AI IDE tool, AWS S3