Data DevOps Engineer

EPAM Systems is seeking a skilled Data DevOps Engineer to configure CI/CD for data pipeline rollouts and build robust AWS infrastructure using Terraform, ensuring reliable and scalable data operations. This role involves collaborating with architects and data engineers to gather requirements and document CI/CD processes meticulously.

Responsibilities:

• Collaborate with architects and data engineers to gather requirements and translate them into CI and infrastructure setups
• Create and manage AWS infrastructure through Terraform to support data operations
• Document CI/CD processes meticulously to ensure repeatability and maintain standards

Requirements:

• 2+ years of experience building and maintaining complex CI/CD pipelines on AWS, including automated testing, artifact management and multi-environment deployments with quality gates, security scanning and infrastructure validation
• Expertise in AWS core services including S3, VPC and EC2, with particular need for operating production-grade systems on Amazon Elastic Kubernetes Service
• Proficiency in Terraform including modular infrastructure design, reusable modules, environment isolation and integration with CI/CD pipelines for automated infrastructure provisioning and updates
• Familiarity with Redshift, Glue, Spark and Athena for data processing and analytics workloads
• Familiarity with AWS Cloud Development Kit, AWS CloudFormation and Amazon Managed Workflows for Apache Airflow
• Skills in Jira and Confluence