AirflowApacheAWSCloudEC2JavaKubernetesMicroservicesNode.jsPythonShell ScriptingSparkTableauTerraformShellData EngineeringLookerSnowflakeApache SparkEKSLambdaS3RDSAthenaCollaborationRemote Work
About this role
Role Overview
Lead cost optimization efforts across our AWS estate (EC2, EKS, S3, EBS, Lambda, RDS, etc.), delivering measurable savings and performance wins.
Analyze and optimize Apache Spark jobs (EMR/EKS) — improve executor tuning, autoscaling, and job scheduling for efficiency.
Partner with Data Engineering to optimize Airflow DAGs, reduce pipeline waste, and manage resource-intensive workflows.
Reduce Kubernetes costs through node pool optimization, vcluster strategy, pod rightsizing, and non-prod automation.
Implement and manage Savings Plans, Reserved Instances, and workload scheduling to maximize discount coverage.