GitHub is the world’s leading platform for agentic software development, and they are seeking a Staff Software Engineer for their Data Pipelines team. The role involves building scalable and reliable event-driven systems to support GitHub's data needs, focusing on core event logging infrastructure and collaboration with application engineers.
Responsibilities:
- Build high-volume event collection, processing and storage systems
- Work with application engineers to build product features that use GitHub's data
- Collaborate with teammates to design data pipelines and APIs, seeking and offering feedback along the way
- Develop foundational data infrastructure, enabling other teams to build data-centric features
- Work across many languages including; Go, Java, and Ruby
- Share responsibility for the availability and performance of our team's systems
Requirements:
- 9+ years' experience in software engineering, computer science, or related technical discipline with proven experience maintaining and delivering production software coding in languages including, but not limited to, Go, Ruby, Rust, Python, JavaScript, C, C++, C#, Java
- OR associate's degree in Computer Science, Electrical Engineering, Electronics Engineering, Math, Physics, Computer Engineering, Computer Science, or related field AND 8+ years' experience in software engineering, computer science, or related technical discipline with proven experience maintaining and delivering production software coding in languages including, but not limited to, Go, Ruby, Rust, Python, JavaScript, C, C++, C#, Java
- OR bachelor's degree in Computer Science or related field AND 7+ years' experience in software engineering, computer science, or related technical discipline with proven experience maintaining and delivering production software coding in languages including, but not limited to, Go, Ruby, Rust, Python, JavaScript, C, C++, C#, Java
- OR master's degree in Computer Science, Electrical Engineering, Electronics Engineering, Math, Physics, Computer Engineering, Computer Science, or related field AND 5+ years' experience in software engineering, computer science, or related technical discipline with proven experience maintaining and delivering production software coding in languages including, but not limited to, Go, Ruby, Rust, Python, JavaScript, C, C++, C#, Java
- OR doctorate in Computer Science, Electrical Engineering, Electronics Engineering, Math, Physics, Computer Engineering, Computer Science, or related field AND 3+ years' experience in software engineering, computer science, or related technical discipline with proven experience maintaining and delivering production software coding in languages including, but not limited to, Go, Ruby, Rust, Python, JavaScript, C, C++, C#, Java
- OR equivalent experience
- Demonstrated experience with large-scale system architecture and design, particularly in cloud-based environments, with a strong understanding of distributed systems and microservices
- Strong operational experience with data pipelines and distributed systems
- Experience with Microsoft Azure
- Experience with Kafka, Java and the JVM (Java Virtual Machine)
- Experience working closely with product management, design, and other engineering teams to drive cross-functional projects and deliver high-quality products