Key skills
ApacheCloudElasticSearchHadoopJavaKubernetesPythonSparkElasticsearchCI/CDCommunication
About this role
Role Overview
- Help architect and evolve the data pipeline to support larger volumes via cloud data warehouses
- Integrate new data sources and refine the rating algorithm
- Collaborate with data science and research teams to build trust with customers in data quality and integrity
- Build actionable security insights to the customer
Requirements
- Prior experience building and operating large-scale data pipelines
- Strong proficiency in modern Java language programming
- Strong computer science fundamentals in design, data structures, and algorithms
- Experience working with a team of engineers, designers, and product owners in delivering a product to end-users
- Excellent (English) written and verbal communication skills
- Experience with Python
- Experience with Hadoop, Spark ecosystems
- Experience with Data Lakehouse tech stack, e.g. Apache Iceberg
- Experience with Elasticsearch or OpenSearch
- Experience with StarRocks or similar OLAP engines
- Experience with CI/CD and Kubernetes
- Experience working in the IT security domain
Tech Stack
- Apache
- Cloud
- ElasticSearch
- Hadoop
- Java
- Kubernetes
- Python
- Spark
Benefits
- Best in class benefits
- Outstanding career opportunities
- Professional development opportunities