Bitsight is a cyber risk management leader transforming how companies manage exposure, performance, and risk for themselves and their third parties. They are looking for an experienced Big Data Engineer to join their engineering team to help architect and evolve their data pipeline, providing actionable security insights to customers.
Responsibilities:
- Help architect and evolve the pipeline to support larger volumes via cloud data warehouses
- Bring actionable security insights to the customer through integrating new data sources, surfacing new features from existing data, and refining the rating algorithm
- Collaborate with data science and research teams to build trust with Bitsight customers in the quality and integrity of our data
Requirements:
- Prior experience building and operating large-scale data pipelines
- Strong proficiency in modern Java language programming
- Strong computer science fundamentals in design, data structures, and algorithms
- Experience working with a team of engineers, designers, and product owners in delivering a product to end-users
- Excellent (English) written and verbal communication skills
- Experience with Python
- Experience with Hadoop, Spark ecosystems
- Experience with Data Lakehouse tech stack, e.g. Apache Iceberg
- Experience with Elasticsearch or OpenSearch
- Experience with StarRocks or similar OLAP engines
- Experience with CI/CD and Kubernetes
- Experience working in the IT security domain