Data Engineer

Southwest Airlines is seeking a Data Engineer to join their AIDT Delivery & Operations Team. In this role, you will design, build, and manage scalable data pipelines and analytical solutions while collaborating with various stakeholders to support their data infrastructure needs.

Responsibilities:

• Assemble large, complex sets of data that meet non-functional and functional business requirements
• Identify, design and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
• Build required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies
• Build analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition
• Work with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues
• Work with stakeholders including the Executive, Product, Data and Design teams to support their data infrastructure needs while assisting with data-related technical issues
• Generate or adapt equipment and technology to serve user needs
• May perform other job duties as directed by Employee's Leaders

Requirements:

• High School Diploma or GED
• Bachelor's degree in Computer Science, Engineering, Information systems or similar fields of study or equivalent advanced level experience
• Intermediate level experience, fully functioning broad knowledge in: Cloud infrastructure, DataLake, ETL experience ensuring source to target data integrity, Various filetypes (Delimited Text, Fixed Width, XML, JSON, Parque), ServiceBus, setting up ingress and egress within a subscription, or relevant AWS Cloud services administrative experience, Unit Testing, Code Quality tools, CI/CD Technologies, Security and Container Technologies, Agile development experience and Agile ceremonies and practices
• U.S. citizenship or current authorization to work in the U.S. required and no current or future work authorization sponsorship available
• Proficiency in Python (including PySpark) and SQL
• Experience using cloud computing tools, particularly AWS Lambda, AWS Glue, and EMR (or equivalent cloud data‑processing services)
• Experience ingesting real‑time streaming data using tools such as Confluent Kafka
• Experience orchestrating ETL workflows using AWS Step Functions or EventBridge
• Familiarity with Data Warehousing methodologies and Relational Databases
• Experience developing robust data pipelines with error handling, monitoring, and quality checks
• Strong knowledge of modern data formats such as Parquet
• Ability to perform Exploratory Data Analysis (EDA) to assess data quality, identify patterns, and generate actionable insights