eBay is a global ecommerce leader changing the way the world shops and sells. They are seeking a Senior Software Engineer with expertise in Apache Airflow to join their Batch Operations team, focusing on building foundational platform capabilities for workflow automation.
Responsibilities:
- Develop, deploy, and maintain Airflow-as-a-service to fulfill eBay’s batch processing demands, ensuring consistent availability and security
- Lead the deployment and management of Airflow clusters, focusing on reliability and scalability
- Design and implement observability, monitoring, and operational solutions to offer deep insights into DAG/task executions and system health
- Evaluate, spec, and implement feature gap between UC4 and Airflow
- Automate and maintain operational standards across multiple environments
- Support horizontal scaling and high availability across cloud infrastructure clusters
Requirements:
- Bachelor's degree in Computer Science or related field plus 7 or more years of experience or Master's degree in Computer Science or related field with 5 years of software engineering experience
- Demonstrated experience in providing Apache Airflow as a managed service within enterprise settings supporting extensive user groups
- Expertise in architecting, managing, and scaling Airflow deployments in Kubernetes or cloud environments, including operational challenges, synchronization of DAG or equivalent experience, and multi-region failover
- Deep familiarity with workflow automation patterns, enterprise scheduler migration, and bridging legacy-platform feature gaps
- Proven success developing observability and operational tools (metrics, monitoring, dashboards, alerting, log analysis) for workflow orchestration platforms
- Excellent technical leadership, initiative, and collaboration skills; thrive in fast paced, high-impact modernization programs
- Familiarity with Automic Enterprise Scheduler is a plus