Key skills
AirflowApacheAWSAzureCloudGoogle Cloud PlatformNoSQLSparkMLApache SparkdbtGCPGoogle CloudCollaboration
About this role
Role Overview
- Design, develop, and maintain data pipelines (batch and streaming)
- Implement and manage cloud data architectures
- Ensure data quality and traceability
- Integrate heterogeneous data sources
- Collaborate with data scientists and ML engineers
- Document solutions and architectural decisions
Requirements
- Experience developing and maintaining data pipelines in cloud and multicloud environments
- Knowledge of tools such as Apache Spark, Airflow, dbt or equivalents
- Implementation and management of cloud data architectures (Azure, AWS, or GCP)
- Ensuring data quality and data governance
- Integration of heterogeneous data sources (APIs, relational databases, NoSQL, flat files)
- Collaboration with data scientists and ML engineers
- Deployment of DataOps practices
Tech Stack
- Airflow
- Apache
- AWS
- Azure
- Cloud
- Google Cloud Platform
- NoSQL
- Spark
Benefits
- BIZ (flexible benefit card)
- Alice Health Plan
- Amil Dental Plan (optional)
- Life Insurance
- Transportation voucher
- Wellhub (Gympass)
- Childcare assistance for parents