DATAEXL INFORMATION LLC is seeking a Sr. Data Engineer to join their team. The role involves setting up streaming pipelines and integrating open-source tools while working in a public cloud environment.
Responsibilities:
- Setting up streaming pipelines, integrating/patching open-source tools (Flink, Spark, Kafka streams), and understanding their operation in public cloud (Azure, AWS)
Requirements:
- Must have: programming language in either java, GO, or scala, spark, apache flink, kafka, and AWS
- Minimum 11 years overall experience in computer science/programming
- Minimum 2-3 years experience in streaming technologies (Flink, Spark, Kafka)
- Streaming pipelines: Flink, Spark, Kafka streams
- Open-source tools
- Public Cloud: Azure, AWS
- Programming Languages (exposure to one or more): Scala, Java, Golang