Confluent is a company focused on transforming how data moves in real-time. They are seeking a Staff Software Engineer to develop control plane services for the Flink product, ensuring high reliability and efficiency while advancing their Data in Motion initiative.
Responsibilities:
- Developing the control plane services that orchestrate Flink job lifecycles (submission, scaling, recovery). Building Kubernetes operators and orchestrators for serverless resource management. Designing APIs for job management, multi-tenancy, and isolation
- Following a holistic development approach you will be responsible for the code quality, test coverage, documentation and maintainability of the components you and your team work on
- Designing Components: You will not only implement aspects of Flink Control Plane but also draft designs, discuss them and curate and moderate a decision with involved stakeholders
- Team: As part of the team you will help to follow and maintain processes, by being an active part of the team, leading meetings and taking initiatives where feasible and participating in on-call rotations
- Mentoring: You will mentor other engineers with less experience in Control plane architecture to get started in the community and more junior developers to get into the area of serverless Apache Flink
Requirements:
- 10+ years of relevant software development experience
- Deep knowledge of distributed systems orchestration (e.g., Kubernetes, control loops)
- Experience building high-scale control planes, API servers, or cloud-native infrastructure
- Knowledge of containerization, networking, and resource isolation
- Strong problem-solving skills, capable of translating complex requirements into effective solutions
- Excellent communication skills, both written and verbal, with the ability to collaborate across teams