Designing, developing, and maintaining backend data pipelines and ETL solutions
Building scalable and reliable data processing using Python, SQL, and AWS
Implementing and supporting CI/CD pipelines to automate build, test, and deployment processes
Collaborating with data engineers, architects, product owners, and business partners to understand requirements
Writing clean, maintainable, and well-tested code
Troubleshooting and resolving data, performance, and reliability issues
Participating in code reviews to provide and receive feedback

Bachelor’s degree in Computer Science or related field, or equivalent practical experience
3+ years of experience in software development, with a focus on backend or data engineering
Proficiency in Python, Spark for backend development and data processing tasks
Strong SQL skills, including working with large datasets and query optimization
Hands-on experience with AWS services, ideally including EMR, Lambda, S3 and Dynamodb
Experience working with CI/CD pipelines and tools that support automated build, test, and deployment
Solid understanding of software development methodologies and best practices, including version control GitHub and Jenkins automated testing
Strong problem-solving, debugging, and troubleshooting skills

Data Engineer

Key skills