GCP Data Engineer

Role Overview

• Individual contributor role in design and development of data models based on the specific requirements
• Designing, developing, and deploying ETL/ELT (Extract, Transform, Load/Extract, Load, Transform) pipelines to move data from various sources to data warehouses or data lakes
• Ensuring data pipelines are robust, scalable, and efficient
• Monitoring pipeline performance and troubleshooting issues
• Transforming raw data into usable formats for analysis
• Cleaning and validating data to ensure accuracy and consistency
• Implementing data quality checks and data governance policies

Requirements

• Must have Hands on Programming Languages: SQL, Python
• Must Have in any of the Database Management: Relational databases (e.g., PostgreSQL, MySQL), NoSQL databases (e.g., MongoDB, Cassandra)
• Preferable worked on: Big Data Technologies: Hadoop, Spark, Kafka
• Must have in any of Cloud Computing Platform : Google Cloud Platform (GCP), AWS, Azure
• Preferable to Have ETL/ELT Tools exposure: Cloud Composer DAG using Airflow, Dataproc / Dataflow
• Preferable: Data Warehousing: BigQuery
• Soft Skills: Strong analytical and problem-solving skills

Tech Stack

• Airflow
• AWS
• Azure
• BigQuery
• Cassandra
• Cloud
• ETL
• Google Cloud Platform
• Hadoop
• Kafka
• MongoDB
• MySQL
• NoSQL
• Postgres
• Python
• Spark
• SQL

Benefits

• Flexible work arrangements
• Career growth programs