Key skills
Data EngineeringPythonSQLApache SparkPySparkSpark SQLETL/ELT DesignData ModelingCost OptimizationPerformance OptimizationCloud EnvironmentsData Lake ArchitectureData GovernanceProduction Data OperationsETLELTData LakeAnalyticsDatabricksSparkAWSAzureGCPTerraformGitHub ActionsAzure DevOpsGitHubCI/CDCommunication
About this role
Wheels Up is a global leader in on-demand private aviation, committed to delivering a premium aviation experience. They are seeking a versatile Data Engineer to design, build, and operate scalable data pipelines that power analytics and business insights within a modern cloud data platform.
Responsibilities:
- Design, build, and maintain scalable, cloud‑native data pipelines using PySpark and Spark SQL
- Develop reliable data ingestion, transformation, and orchestration workflows to support analytics and reporting needs
- Modernize the data platform by migrating legacy SQL logic and stored procedures into distributed, Spark‑based pipelines
- Develop automation and tooling for CI/CD automation, monitoring, alerting, and data quality checks across the data platform
- Support production data operations, including troubleshooting pipeline failures, resolving bugs, and tuning performance
- Manage Databricks operational responsibilities, including workspace configuration, access controls, and permissions
- Collaborate cross-functionally, partnering with analytics, product, and engineering teams to deliver trusted, well‑governed data products
- Contribute to platform standards and best practices around reliability, observability, cost optimization, and data governance
Requirements:
- Bachelor's (with 4+ years relevant experience) OR Master's (with 2+ years relevant experience)
- 3+ years of hands‑on experience in data engineering, building and supporting production data pipelines
- Strong proficiency in Python and SQL, with experience writing performance, maintainable code
- Hands‑on experience with distributed data processing frameworks, such as Apache Spark (PySpark, Spark SQL)
- Solid understanding of ETL/ELT design patterns, data modeling, cost optimization, and performance optimization
- Experience working in cloud environments (Azure preferred; AWS or GCP acceptable)
- Familiarity with data lake or lakehouse architecture and modern analytics platforms
- Experience supporting production data systems, including troubleshooting, monitoring, and operational support
- Strong communication skills with the ability to collaborate effectively across technical and non‑technical teams
- High attention to detail, strong data intuition, and a commitment to data quality and reliability
- Comfortable working in a fast‑paced environment with evolving requirements and priorities
- Experience with Databricks and orchestration tools (Workflows, Terraform)
- DevOps familiarity (CI/CD, GitHub Actions, Azure DevOps)
- Databricks, Azure, or cloud certifications a plus
- Python, SQL, Spark
- Hands on Experience with at least (1) Cloud service, we use Azure here at Wheels Up
- Advanced level skills
- Data Engineer Falin Python
- Data Manipulation
- Computer Science or Engineering Background