Identifying, creating, preparing data required for modern Data solutions and Data for AI.
Designing ETLs and ELTs for data transformations.
Designing, building and management of Datalakes architectures.
Working with Apache Hadoop projects (Spark, Hive, Pig, Oozie, Airflow, etc).
Integrating and testing Data solutions.
Creating and documenting the tests to meet requirements.
Working with Bigdata Environments.
Managing Data Cloud services, data access, security and data governance.
Analyzing and prepare data for Machine Learning workloads.
Managing monitoring and logs of applications and services.

Experience in Data Engineer/Architect role and tasks as ETL, data prepare & ingest, data streaming.
Experience working in Cloud environments (AWS, and Azure) 2 years at least.
Knowledge of Python, R or other data process tools.
Intermediate/ Upper English Level.
Experience with Apache Spark.
Experience using AWS or Microsoft Data services: S3, AWS or Microsoft Glue, Athena, Sagemaker, etc.
Experience using Devops tools (Git, pipelines).
Experience working in an Agile Scrum team.
Experience working with infrastructure as a code (Terraform, Cloudformation, etc.).

Data Engineer

Key skills