Real-Time Data Engineer

Bright Vision Technologies is seeking a Real-Time Data Engineer to architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments for mission-critical event-driven workloads. The role owns the Kafka platform end-to-end and partners with application and cross-functional teams to deliver a reliable, performant streaming platform.

Responsibilities:

• We are seeking an experienced Real-time Data Engineer to architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments supporting mission-critical event-driven workloads
• In this role you will own the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, observability, and developer enablement
• The ideal candidate will combine deep Kafka internals knowledge with strong DevOps and SRE practices, and will partner with application teams to deliver a reliable, performant, and developer-friendly streaming platform
• In this role you will work closely with cross-functional partners — product, design, engineering, operations, and business stakeholders — to translate ambiguous requirements into well-engineered solutions, and will be expected to raise the bar through code review, design review, and mentorship of more junior engineers

Requirements:

• U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply
• We are unable to sponsor new H-1B visa petitions for this position
• Bachelor's degree in Computer Science, Engineering, or a related technical discipline
• Five or more years of experience operating Apache Kafka or Confluent Platform in production
• Deep, hands-on knowledge of Kafka internals (partitions, replication, ISRs, consumer groups)
• Strong experience with Kafka security (SASL, mTLS, ACLs, RBAC)
• Hands-on experience with Kafka Connect, Schema Registry, and either Kafka Streams or ksqlDB
• Experience with HA/DR strategies for Kafka
• Strong scripting skills in Python, Bash, or Go
• Hands-on experience with infrastructure-as-code (Terraform, Ansible)
• Working knowledge of observability tooling for Kafka
• Excellent troubleshooting, communication, and documentation skills
• Confluent Certified Administrator or Developer credentials
• Experience operating Kafka on Kubernetes (Strimzi, Confluent Operator)
• Exposure to managed Kafka services (AWS MSK, Azure Event Hubs Kafka API)
• Familiarity with stream processing frameworks (Flink, Spark Streaming)
• Experience with data governance and lineage for streaming data