Snowflake is at the forefront of innovation in data-driven solutions, and they are seeking a Senior Software Engineer for their Open Source Analytics team. This role involves pioneering new technical capabilities, designing features for open-source projects, and collaborating with the open-source community to enhance Snowflake's data lake architecture.
Responsibilities:
- Pioneer new and innovative technical capabilities in the Open Source Analytics community. You will define and build next-generation capabilities on top of critical lakehouse building blocks like interoperable table formats, data catalogs, file formats, and query engines
- Design and implement features and enhancements for Apache Iceberg and Apache Polaris focusing on scalability, performance and usability such as Iceberg DML/DDL transactions, schema evolution, partitioning, time travel, and more
- Collaborate with the Open source community by contributing code, participating in discussions and reviewing pull requests to ensure high quality contributions
- Architect and build systems that integrate open source technologies seamlessly with Snowflake - enabling our customers to build and deploy massive data lake architectures across platforms and across cloud providers
- Collaborate with Snowflake’s open-source team and the Apache Iceberg community to contribute new features and enhance the Iceberg table format and REST specification
- Work on core data access control and governance features for Apache Polaris
- Contribute to our managed Polaris service, Snowflake Open Catalog, enabling customers to seamlessly manage and expand their data lake through Snowflake as well as other external query engines like Spark and Trino
- Build tooling and services that automate data lake table maintenance, including compaction, clustering, and data retention for enhanced query performance and efficiency