Southwest Airlines is committed to providing its Employees a stable work environment with opportunities for growth. As a Data Engineer, you will design, build, and manage scalable data pipelines and deliver analysis that drives decision-making, supporting high-quality data solutions for operational outcomes.
Responsibilities:
- Assemble large, complex sets of data that meet non-functional and functional business requirements
- Identify, design and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
- Build required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies
- Build analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition
- Work with stakeholders including data, design, product and executive teams and assisting them with data-related technical issues
- Work with stakeholders including the Executive, Product, Data and Design teams to support their data infrastructure needs while assisting with data-related technical issues
- Generate or adapt equipment and technology to serve user needs
- May perform other job duties as directed by Employee's Leaders
Requirements:
- High School Diploma or GED
- Bachelor's degree in Computer Science, Engineering, Information systems or similar fields of study or equivalent advanced level experience
- Intermediate level experience, fully functioning broad knowledge in: Cloud infrastructure, DataLake
- ETL experience ensuring source to target data integrity
- Various filetypes (Delimited Text, Fixed Width, XML, JSON, Parque)
- ServiceBus, setting up ingress and egress within a subscription, or relevant AWS Cloud services administrative experience
- Unit Testing, Code Quality tools, CI/CD Technologies, Security and Container Technologies
- Agile development experience and Agile ceremonies and practices
- Ability to perform work duties from [limited space work station/desk/office area] for extended periods of time
- Ability to communicate and interact with others in the English language to meet the demands of the job
- Ability to use a computer and other office productivity tools with sufficient speed and accuracy to meet the demands of the job
- Must maintain a well-groomed appearance per Company appearance standards as described in established guidelines
- Must be a U.S. citizen or have authorization to work in the United States as defined by the Immigration Reform Act of 1986
- Must be at least 18 years of age
- Must be able to comply with Company attendance standards as described in established guidelines
- Must be able to travel and /or attend Company and non-Company facilities and remote locations such as remote-based offices as necessary
- Proficiency in Python (including PySpark) and SQL
- Experience using cloud computing tools, particularly AWS Lambda, AWS Glue, and EMR (or equivalent cloud data‑processing services)
- Experience ingesting real‑time streaming data using tools such as Confluent Kafka
- Experience orchestrating ETL workflows using AWS Step Functions or EventBridge
- Familiarity with Data Warehousing methodologies and Relational Databases
- Experience developing robust data pipelines with error handling, monitoring, and quality checks
- Strong knowledge of modern data formats such as Parquet
- Ability to perform Exploratory Data Analysis (EDA) to assess data quality, identify patterns, and generate actionable insights