Staff Software Engineer, Data Catalog

Airbnb is a mission-driven company that helps people belong anywhere through stays and experiences around the world. The Staff Software Engineer will lead the development of data catalog infrastructure, tooling, standards, and processes to make data assets discoverable, governed, and high quality across Airbnb’s data ecosystem.

Responsibilities:

• Develop and implement data catalog products to support Airbnb data users on data discovery, metadata management, data quality, data lineage
• Develop and implement metadata infrastructure to support data governance and processes, including ownership management, data classification, data privacy, access control and data retention
• Build industry leading end to end data lineage product across online, offline, machine learning, metrics, visualizations and third party datasets
• Collaborate with cross-functional teams to ensure all datasets at Airbnb are cataloged, governanced and meeting business goals and regulatory requirements. Conduct programs to define and ensure metadata quality and metadata governance requirements
• Work with various data infrastructure framework teams to identify, design and build metadata integrations to provide data catalog products for each data system
• Build infrastructure toolings and processes for scalable metadata onboarding and integrations
• Develop and implement metadata driven data policies and procedures to support data governance requirements

Requirements:

• BS/MS/PhD in Computer Science or a related field, or equivalent work experience
• 9+ years of experience in software engineering, with a focus on data infrastructure
• Experience working with data storage and distributed processing technologies, such as Hive, Spark, Trino, Flink or SQL databases
• Strong programming skills in one or more of the following languages: Java, Python, or Scala
• Experience with data catalog products – metadata infrastructure, metadata management, metadata integration framework and tooling, metadata-driven data management
• Experience with workflow orchestration solutions (e.g. Apache Airflow, Prefect, Kubeflow, etc..)
• Strong knowledge of data governance frameworks, policies, and processes, including data classification, data lineage, data quality, data privacy and retention
• Excellent communication skills and the ability to collaborate with cross-functional teams to build empathetic tools and platforms
• Ability to work in areas outside of your usual comfort zone
• Excellent analytical and problem solving skills
• This position is US - Remote Eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as agreed to with your manager
• While the position is Remote Eligible, you must live in a state where Airbnb, Inc. has a registered entity. Click here for the up-to-date list of excluded states. This list is continuously evolving, so please check back with us if the state you live in is on the exclusion list