Key skills
CloudDistributed SystemsHDFSJavaKafkaKubernetesPythonRustScalaSparkYarnyarn
About this role
Role Overview
- Lead Architectural Design: Independently drive the technical design of massive-scale distributed systems using Java, Spark, Kafka, Iceberg, and more.
- Bridge the Gap: Engage with internal and external stakeholders to diagnose the root cause of friction.
- Drive Technical Excellence: Mentor the team’s Senior and Full-Stack engineers.
- Solve the "Unusually Complex": Tackle the most difficult technical challenges where standard documentation fails.
- Influence the Product Roadmap: Synthesise technical insights gained from our strategic initiatives.
Requirements
- 12+ years of software engineering experience with a focus on building distributed systems and data platforms.
- Deep, hands-on expertise with big data ecosystems (HDFS, Hive, YARN) and modern compute engines (Spark, Flink, Kafka).
- A deep understanding of technical architecture, including concurrency, multithreading, and distributed consistency challenges.
- Expert-level fluency in Java is a minimum requirement. Proficiency in Python, Scala and Rust is a plus.
- Proven ability to author complex design documents and act as the primary lead in design discussions.
- Familiarity with Kubernetes and Cloud-Native orchestration.
- The ability to learn new technologies on the fly in a continuous learning environment.
Tech Stack
- Cloud
- Distributed Systems
- HDFS
- Java
- Kafka
- Kubernetes
- Python
- Rust
- Scala
- Spark
- Yarn
Benefits
- Generous PTO Policy
- Support work life balance with Unplugged Days
- Flexible WFH Policy
- Mental & Physical Wellness programs
- Phone and Internet Reimbursement program
- Access to Continued Career Development
- Comprehensive Benefits and Competitive Packages
- Paid Volunteer Time
- Employee Resource Groups