Data Engineer

Wheels Up is a global leader in on-demand private aviation, committed to delivering a premium aviation experience. They are seeking a versatile Data Engineer to design, build, and operate scalable data pipelines that power analytics and business insights within a modern cloud data platform.

Responsibilities:

• Design, build, and maintain scalable, cloud‑native data pipelines using PySpark and Spark SQL
• Develop reliable data ingestion, transformation, and orchestration workflows to support analytics and reporting needs
• Modernize the data platform by migrating legacy SQL logic and stored procedures into distributed, Spark‑based pipelines
• Develop automation and tooling for CI/CD automation, monitoring, alerting, and data quality checks across the data platform
• Support production data operations, including troubleshooting pipeline failures, resolving bugs, and tuning performance
• Manage Databricks operational responsibilities, including workspace configuration, access controls, and permissions
• Collaborate cross-functionally, partnering with analytics, product, and engineering teams to deliver trusted, well‑governed data products
• Contribute to platform standards and best practices around reliability, observability, cost optimization, and data governance

Requirements:

• Bachelor's (with 4+ years relevant experience) OR Master's (with 2+ years relevant experience)
• 3+ years of hands‑on experience in data engineering, building and supporting production data pipelines
• Strong proficiency in Python and SQL, with experience writing performance, maintainable code
• Hands‑on experience with distributed data processing frameworks, such as Apache Spark (PySpark, Spark SQL)
• Solid understanding of ETL/ELT design patterns, data modeling, cost optimization, and performance optimization
• Experience working in cloud environments (Azure preferred; AWS or GCP acceptable)
• Familiarity with data lake or lakehouse architecture and modern analytics platforms
• Experience supporting production data systems, including troubleshooting, monitoring, and operational support
• Strong communication skills with the ability to collaborate effectively across technical and non‑technical teams
• High attention to detail, strong data intuition, and a commitment to data quality and reliability
• Comfortable working in a fast‑paced environment with evolving requirements and priorities
• Experience with Databricks and orchestration tools (Workflows, Terraform)
• DevOps familiarity (CI/CD, GitHub Actions, Azure DevOps)
• Databricks, Azure, or cloud certifications a plus
• Python, SQL, Spark
• Hands on Experience with at least (1) Cloud service, we use Azure here at Wheels Up
• Advanced level skills
• Data Engineer Falin Python
• Data Manipulation
• Computer Science or Engineering Background