Data Engineer – Programming, Data Pipelines
Bonn, North Rhine-Westphalia, Germany
Full Time
3 days ago
No Sponsorship
Key skills
AirflowETLPySparkPythonSparkSQLVaultMachine LearningELTAnalyticsSnowflakeDatabricksdbtAgileCI/CD
About this role
Role Overview
- Develop scalable ETL/ELT data pipelines for batch and streaming processing
- Work with Spark / PySpark, Python and SQL
- Implement data models based on Kimball, Data Vault or Lakehouse principles
- Transform, normalize and denormalize data from various source systems
- Orchestrate data pipelines using Airflow or comparable tools
- Work with Databricks, Snowflake or similar platforms
- Support data analytics and machine learning pipelines
- Ensure quality through testing, documentation and CI/CD
Requirements
- Several years of professional experience in the areas listed above
- Strong SQL skills
- Strong knowledge of Spark / PySpark
- Proficient in Python
- Experience with dbt and Airflow or comparable orchestration tools
- Comfortable working with Snowflake and/or Databricks
- Experienced in data modeling (dimensional modeling, Data Vault, normalization & denormalization)
Tech Stack
- Airflow
- ETL
- PySpark
- Python
- Spark
- SQL
- Vault
Benefits
- Innovative projects and a creative environment
- Agile working environment
- Flexibility
- Freedom to shape your role
- Knowledge sharing and professional growth
- Team spirit
- Attractive benefits