Cloud Data DevOps Engineer

AAA Auto Club Enterprises is the largest club within the national AAA federation, employing nearly 17,000 individuals across 24 states. They are seeking a Cloud Data DevOps Engineer who will design and maintain cloud infrastructure, optimize data pipelines, and ensure data security while collaborating with various teams to enhance data processing and automation.

Responsibilities:

• Design, deploy, and maintain scalable and reliable cloud infrastructure on AWS and GCP
• Build scalability, fault-tolerance, security, and performance into our data platforms to meet our growing data & analytics needs
• Develop cloud data ingestion and processing frameworks
• Automate routine tasks to improve efficiency and reduce manual intervention
• Implement and maintain CI/CD pipelines for data applications
• Optimize data pipelines and processes for performance and scalability
• Troubleshoot and resolve issues related to data pipelines and data processing
• Work with our data engineering teams, data science teams, and analytical business users to review and ensure best practices are followed and high-quality code gets implemented
• Partner with our Information Security, Application Security, and Cloud Infrastructure Services teams to ensure data is secure both at-rest and in-flight
• Ensure data platforms remain current to take advantage of the latest features and support
• Mentor, teach, champion, and encourage an Automation mindset amongst the IT department and other business units
• Communicate the status of assigned work to management and follow agile practices, standard procedures, and policies
• Seek guidance when direction is needed and speak up about technology risks identified

Requirements:

• Extensive hands-on expertise in Automation, troubleshooting logs, and optimizing system performance
• Deep understanding of Cloud and data security in AWS or Google Cloud
• Good experience with networking, Linux and Unix OS, and shell scripting
• Demonstrated aptitude for identifying the underlying issues in Cloud services such as Glue, Lambda, Big Query, and Cloud Functions
• Good experience with Cloud platforms AWS and/or Google Cloud in supporting Data pipelines and integrations
• Experience with Cloud Automations using CloudFormation or Terraform
• Good understanding of network infrastructures and protocols such as TCP/IP, TLS
• Familiarity with SQL and programming languages such as Python, Spark, YAML, and Bash
• Familiarity with data integration from different sources into Big Data systems is preferable
• Cloud Certification in DevOps in AWS or Google Cloud is a plus