Key skills
AzureCloudETLMongoDBPostgresPythonSQLELTData EngineeringDatabricksGoogle CloudPostgreSQLSQL ServerGitVersion ControlCollaboration
About this role
Role Overview
- Support the Data Engineering team in building, maintaining, and documenting data pipelines and data solutions.
- Perform supervised tasks, assisting with data preparation, collection, transformation, and integration, ensuring good organization, standardization, and basic reliability of information.
- Contribute to simple technical analyses in collaboration with more experienced professionals, support internal and external projects related to data engineering, and perform other related duties inherent to the role.
Requirements
- Experience with ETL/ELT for data extraction, transformation, and loading.
- Experience with data architectures in cloud and on-premise environments (Azure and/or Google Cloud).
- Monitoring and optimization of data pipelines.
- Strategies for data quality, validation, and integrity.
- Implementation of Data Lakes and Data Warehouses.
- Process automation using Python and SQL.
- Knowledge of:
- Advanced Python and SQL
- Relational and non-relational databases (SQL Server, PostgreSQL, MongoDB, etc.)
- Azure Data Factory, Synapse, Databricks, Fabric, or similar platforms
- Version control with Git
- Concepts of DataOps and Data Governance
- Clear and structured technical documentation.
Tech Stack
- Azure
- Cloud
- ETL
- MongoDB
- Postgres
- Python
- SQL