Apolis is seeking a Senior Data Engineer with strong experience in PySpark, AWS Glue, Kafka, and Mongo. The role involves building and supporting scalable ETL pipelines and requires strong coding skills, problem-solving abilities, and effective communication.
Responsibilities:
- Build and support scalable batch and streaming ETL pipelines
- Write clean, maintainable, and efficient code
- Participate in code reviews and contribute to best practices for data engineering and cloud-based development
- Independently drive problem solving and participate actively in team discussions
- Clearly articulate design decisions, risks, and recommendations
Requirements:
- 6-9 years of experience as a Senior Data Engineer
- Strong experience in PySpark
- Experience with AWS Glue
- Experience with Kafka
- Experience with MongoDB
- Ability to build and support scalable batch and streaming ETL pipelines
- Hands-on coding experience
- Ability to troubleshoot and resolve production issues
- Comfortable working in a fast-paced environment
- Ability to write clean, maintainable, and efficient code
- Participation in code reviews
- Contribution to best practices for data engineering and cloud-based development
- Ability to independently drive problem solving
- Participation in team discussions
- Ability to clearly articulate design decisions, risks, and recommendations
- Strong communication skills
- Ability to collaborate effectively with team members and stakeholders