Drive the multi-year technical roadmap and architectural vision for search services, ensuring they are secure, cost-efficient, and highly scalable for petabyte-scale enterprise workloads.
Design and oversee the implementation of large-scale OpenSearch clusters, ensuring low-latency indexing and query performance across multi-cloud environments.
Lead the deep integration of OpenSearch with core CDP components like Apache Iceberg, SDX, and Ozone to provide a unified, secure search experience.
Define and champion organization-wide best practices for security (RBAC, TLS), observability, and enterprise-grade reliability.
Design solutions for extreme scale, multi-tenancy isolation, and complex hybrid/multi-cloud deployment models.
Mentor staff and senior engineers on complex technical designs and foster a culture of continuous improvement and innovation across the entire engineering organization.
Act as a primary influencer and liaison within the upstream OpenSearch community, aligning their roadmap with Cloudera's product strategy.
Requirements
10+ years of experience (scaling from the 8+ years required for Staff level) working with OpenSearch or Elasticsearch in large-scale production environments.
Deep understanding of consensus algorithms, CAP theorem, replication, sharding, and fault-tolerant design patterns.
Mastery of Java for core development and proficiency in Go or Python for advanced automation and tooling.
Extensive experience with Kubernetes (K8s) and container orchestration, including deploying search workloads on AWS (EKS/AOSS), Azure (AKS), or Google Cloud (GKE).
Demonstrated ability to drive architectural decisions with a focus on non-functional requirements such as high availability and security.