Software Engineer II

Role Overview

• Design, develop, and maintain ETL workflows and data pipelines for large-scale data processing
• Write and optimize medium-complexity SQL queries on Hive, Spark, and Impala for use case-driven scenarios
• Develop and maintain scripts using HIVE, PySpark, Spark, and Scala for data transformation and processing
• Implement and troubleshoot Unix Shell scripts for automation and system tasks
• Collaborate with cross-functional teams to ensure data integrity and performance
• Work in alignment with U.S. business hours for meetings and deliverables
• Contribute to cloud-based data solutions and ensure best practices in data engineering

Requirements

• 4 years of experience in ETL and Data Warehousing
• Strong SQL skills with Hive, Spark, and Impala
• Proficiency in HIVE / PySpark / Spark / Scala scripting
• Good understanding of Unix Shell scripting
• Conceptual knowledge of cloud ecosystems (AWS preferred)
• AWS Certified applicants are highly desirable
• Strong problem-solving ability, adaptability, and communication skills

Tech Stack

• AWS
• Cloud
• ETL
• PySpark
• Scala
• Shell Scripting
• Spark
• SQL
• Unix

Benefits

• Options include a variety of health coverage options
• Wellbeing and support programs
• Retirement plans
• Vacation and sick leave
• Maternity, paternity & adoption leave
• Continuing education and training
• Several voluntary benefit options