Key skills
ApacheCloudElasticSearchHadoopJavaKubernetesPythonSparkElasticsearchCI/CDCommunication
About this role
Role Overview
- Help architect and evolve the pipeline to support larger volumes via cloud data warehouses
- Bring actionable security insights through integrating new data sources
- Surface new features from existing data
- Refine the rating algorithm
- Collaborate with data science and research teams
- Build trust with Bitsight customers in the quality and integrity of data
Requirements
- Prior experience building and operating large-scale data pipelines
- Strong proficiency in modern Java language programming
- Strong computer science fundamentals in design, data structures, and algorithms
- Experience working with a team of engineers, designers, and product owners in delivering a product to end-users
- Excellent (English) written and verbal communication skills
- Experience with Python
- Experience with Hadoop, Spark ecosystems
- Experience with Data Lakehouse tech stack, e.g. Apache Iceberg
- Experience with Elasticsearch or OpenSearch
- Experience with StarRocks or similar OLAP engines
- Experience with CI/CD and Kubernetes
- Experience working in the IT security domain
Tech Stack
- Apache
- Cloud
- ElasticSearch
- Hadoop
- Java
- Kubernetes
- Python
- Spark
Benefits
- Bitsight offers best in class benefits
- Inclusive culture