Key skills
CloudDockerETLGraphQLKubernetesLinuxPostgresPythonSQLELTPytestTDDGitHub ActionsPostgreSQLGitGitHubPerformance OptimizationCI/CDCommunication
About this role
Role Overview
- Design, develop, and maintain dagster-based data pipeline using Python.
- Design and implement efficient data models accommodating the planned product features and application requirements.
- Develop SQL queries and procedures to be used by data pipeline and API services.
- Debug, maintain and improve our existing codebase.
- Develop and execute unit tests and integration tests to ensure software reliability.
- Conduct performance profiling and stress testing to optimize system responsiveness.
- Maintain clear, structured documentation for data models and ETL/ELT pipelines and codebases.
- Collaborate closely with cross-functional teams, including client applications and cloud teams.
- Stay adaptable, learning new technologies and contributing to various technical areas as needed.
Requirements
- Bachelor’s degree in computer science or a related field or equivalent proven experience in database and data pipeline development.
- Solid experience with relational databases and SQL, preferably PostgreSQL.
- Strong Python language and OOP skills.
- Experience in data modelling for both transactional systems and analytical systems.
- Strong debugging, troubleshooting, and performance optimization skills.
- Proficiency with Git, including active participation in code reviews.
- Excellent communication and teamwork skills.
- Keen in developing in-house tech stacks as well as utilizing off-the-shelf components to build a robust solution.
- Experience with Dagster or other data orchestration technologies (preferred).
- Familiarity with CI/CD pipelines, such as GitHub Actions and Liquibase (preferred).
- Knowledge of REST/GraphQL or other API design methodologies (preferred).
- Familiarity with working in Linux based environments (preferred).
- Experience with Docker and Kubernetes for container orchestration (preferred).
- Experience in Test-Driven Development (TDD), PyTest and software design patterns (preferred).
Tech Stack
- Cloud
- Docker
- ETL
- GraphQL
- Kubernetes
- Linux
- Postgres
- Python
- SQL
Benefits
- 25 days annual leave
- Private healthcare with Vitality
- Christmas shutdown days on top of leave allowance (2-4 per year usually)
- Office located within a 5-minute walk from Angel station
- Hybrid working
- Biannual salary reviews
- Summer & Christmas staff parties
- Free lunch bought in and after-work gathering/drinks every other Thursday in the office
- Employee referral scheme
- Make a real-world impact of revolutionising the construction industry