Key skills
PythonAWS servicesCI/CD toolsETL/ELT processesSQLShell scriptingAWS Certified Data AnalyticsAWS Certified DeveloperProblem-solvingCollaborationCommunicationShellETLELTData EngineeringAnalyticsRedshiftAWSTerraformJenkinsLambdaS3CloudWatchGlueCodePipelineCI/CD
About this role
Arbor TekSystems is seeking an AWS Data Engineer to build and maintain secure, scalable, and automated data pipelines for the aviation industry. The role involves implementing CI/CD pipelines, automated testing, and monitoring solutions to support data products.
Responsibilities:
- Develop configuration-driven ingestion and transformation pipelines using AWS Glue, Lambda, and Redshift
- Implement CI/CD pipelines for automated build, test, and deployment of data products
- Establish automated test frameworks for schema validation, data quality, and performance testing
- Set up monitoring and observability dashboards for product-level metrics (CloudWatch, custom metrics)
- Work with data modelers and architects to ensure alignment with business requirements
Requirements:
- Bachelor's degree in computer science, Data Engineering, or related field
- 5+ years of experience in data engineering and pipeline development
- Proficiency in Python, SQL, and shell scripting
- Hands-on experience with AWS services (Glue, Redshift, S3, Lambda, CloudWatch)
- Experience with CI/CD tools (Terraform, Jenkins, AWS CodePipeline)
- Strong knowledge of ETL/ELT processes and frameworks
- Strong problem-solving, collaboration, and communication skills
- Aviation industry experience is preferred
- AWS Certified Data Analytics or AWS Certified Developer is a plus