Design, deploy, and maintain scalable and reliable cloud infrastructure on AWS and GCP.
Build scalability, fault-tolerance, security, and performance into our data platforms to meet our growing data & analytics needs.
Develop cloud data ingestion and processing frameworks.
Automate routine tasks to improve efficiency and reduce manual intervention.
Implement and maintain CI/CD pipelines for data applications.
Optimize data pipelines and processes for performance and scalability.
Troubleshoot and resolve issues related to data pipelines and data processing.
Work with our data engineering teams, data science teams, and analytical business users to review and ensure best practices are followed and high-quality code gets implemented.
Partner with our Information Security, Application Security, and Cloud Infrastructure Services teams to ensure data is secure both at-rest and in-flight.
Ensure data platforms remain current to take advantage of the latest features and support.
Mentor, teach, champion, and encourage an Automation mindset amongst the IT department and other business units.
Communicate the status of assigned work to management and follow agile practices, standard procedures, and policies.
Seek guidance when direction is needed and speak up about technology risks identified.
Requirements
Extensive hands-on expertise in Automation, troubleshooting logs, and optimizing system performance.
Deep understanding of Cloud and data security in AWS or Google Cloud.
Good experience with networking, Linux and Unix OS, and shell scripting.
Demonstrated aptitude for identifying the underlying issues in Cloud services such as Glue, Lambda, Big Query, and Cloud Functions.
Good experience with Cloud platforms AWS and/or Google Cloud in supporting Data pipelines and integrations.
Experience with Cloud Automations using CloudFormation or Terraform.
Good understanding of network infrastructures and protocols such as TCP/IP, TLS.
Familiarity with data integration from different sources into Big Data systems is preferable.
Familiarity with SQL and programming languages such as Python, Spark, YAML, and Bash.
Cloud Certification in DevOps in AWS or Google Cloud is a plus.
Tech Stack
AWS
BigQuery
Cloud
Google Cloud Platform
Linux
Python
Shell Scripting
Spark
SQL
TCP/IP
Terraform
Unix
Benefits
Health coverage for medical, dental, vision
401(K) saving plans with company match AND Pension
Tuition assistance
Floating holidays and PTO for community volunteer programs
Paid parental leave
Wellness programs
Employee discounts (membership, insurance, travel, entertainment, services and more!)