Key skills
JavaC++Distributed systemsApache HadoopData structuresClean codingPerformance tuningOpen source contributionsCommunication skillsCSQLAIMLAnalyticsSparkHadoopCommunication
About this role
Cloudera is a leading data partner that empowers organizations to transform complex data into actionable insights. The Senior Software Engineer will be involved in designing and implementing core features for the Cloudera Data Platform, focusing on building Apache Ozone and supporting enterprise customers with large-scale data solutions.
Responsibilities:
- You will be directly involved in the design and implementation of the core feature set of Apache Ozone and Apache Ratis (open-source RAFT implementation)
- You will regularly contribute code and design docs to the Apache open-source community
- As part of storage engineering, you will support enterprise customers running 100s of petabytes-scale big data analytics and ML/AI pipelines
- You will partner with Engineering leaders, product managers, and cross-functional teams as a part of the Cloudera Data platform ecosystem in understanding requirements and turning them into a solid design and implementation, and facilitating integration and adoption
Requirements:
- BS, MS, or Ph.D. in Computer Science
- Masters +3 years or Bachelors +5 years of relevant industry experience
- Strong backend engineering skill set with expertise in Java. Alternatively strong C++ skills with intermediate Java skills
- Hands-on programmer with a good knowledge of data-structures and CS algorithms
- Experience with system software design and development with an understanding of computer architecture, storage, network, and IO subsystems
- Clean coding habits, attention to detail, and focus on quality
- Good oral and written communication
- Experience with large-scale, distributed systems design and development with an understanding of scaling, replication, consistency, and high availability
- Background in a distributed storage system including file systems, database storage internals, no-sql storage or distributed hash tables
- Background in performance tuning, identifying performance bottlenecks, and implementing performance optimizations
- Good understanding of Apache Hadoop
- Recognized contributions to open source projects
- Experience using projects in the Apache Hadoop ecosystem such as MapReduce, HBase, Hive, Spark etc. is a big plus
- Understanding of Paxos, RAFT, or equivalent distributed consensus protocols