Key skills
AWSEC2MySQLPostgresPythonAnalyticsECSLambdaS3RDSSQSPostgreSQLGitVersion ControlAgile
About this role
Role Overview
- Develop and maintain efficient, scalable data ingestion pipelines.
- Integrate different data sources (APIs, relational and non-relational databases, message queues).
- Ensure the quality, security and governance of captured data.
- Collaborate with engineering, product and analytics teams to understand requirements and deliver data solutions.
- Monitor and optimize data capture processes (crawlers/scrapers).
- Document processes, workflows and technical decisions.
Requirements
- Bachelor's degree in Computer Science, Engineering, Information Systems or a related field.
- Intermediate experience with Python for developing pipelines and automations.
- Hands-on knowledge of AWS, particularly services such as SQS, Lambda, ECS, EC2, S3 and RDS.
- Experience with relational databases (e.g., PostgreSQL, MySQL).
- Experience developing REST APIs.
- Experience with version control using Git.
- Ability to work collaboratively in agile environments.
Tech Stack
- AWS
- EC2
- MySQL
- Postgres
- Python
Benefits
- Flexible working hours
- Inclusive work environment
- Opportunities for professional development