Key skills
AirflowApacheBigQueryDockerKafkaKubernetesPythonSQLTerraformGolangData EngineeringSnowflakeApache AirflowKinesisCI/CD
About this role
Role Overview
- Work alongside a talented team of analysts, data scientists and engineers to build data products and services that meet business requirements.
- Design, develop and maintain robust, scalable and observable batch and real-time data pipelines.
- Architect, build and maintain the data infrastructure at Payrails.
- Advocate for and implement data governance and security best practices.
- Contribute to tooling that improves data quality, CI/CD workflows, and data observability.
- Collaborate with cross-functional teams to understand requirements and design optimal solutions.
Requirements
- You have extensive experience in data engineering roles building reliable, scalable and observable production-grade data pipelines and services.
- You have strong proficiency in Python. Experience with GoLang is a plus.
- You are proficient in SQL, data modelling and operating common OLTP (e.g. PostgresSQL) and OLAP databases (e.g. Snowflake, Bigquery) at scale.
- You develop and maintain data pipelines using workflow management platforms such as Apache Airflow.
- You are knowledgeable of containerization technologies such as Docker and container orchestration platforms like Kubernetes.
- You communicate effectively and are proficient in English.
- You work independently and collaboratively in a fast-paced environment.
- Experience with real-time streaming technologies (e.g. Kafka, Kinesis) and distributed stream processing technologies (e.g. Apache Flink, Apache Beam, Kafka Streams) is an advantage.
- Familiarity working with infrastructure as code (e.g. Terraform) is preferred.
- FinTech or payments domain experience is a plus.
Tech Stack
- Airflow
- Apache
- BigQuery
- Docker
- Kafka
- Kubernetes
- Python
- SQL
- Terraform
Benefits
- High impact and high velocity environment with the most talented and ambitious people you will ever work with
- A chance to shape the story of a company and a category from the ground up
- Real ownership. You’ll have the freedom and trust to build, test, and take lead
- A product used by the best brands around the world
- Hybrid working with an office in the heart of New Cairo
- Regular team events, activities and off-sites
- Competitive salary and equity package
- 27 days of annual paid vacation