Key skills
Google Cloud PlatformBigQueryCloud ComposerCloud DataflowSQLPythonData ingestion & transformationData modeling conceptsBatchstreaming processingCI/CDversion controlData securitygovernanceAgile environmentsLarge-scale data warehouseETLELTData WarehousingAirflowApache AirflowGoogle CloudcomposerGitVersion ControlAgile
About this role
Dice is the leading career destination for tech experts at every stage of their careers. Our client, Amiseq Inc., is seeking a skilled Data Engineer with strong experience in Google Cloud Platform to design, develop, and optimize scalable data pipelines.
Responsibilities:
- Design and implement scalable data ingestion and transformation pipelines
- Develop and optimize ETL/ELT workflows on Google Cloud Platform
- Build and manage data workflows using Cloud Composer (Apache Airflow)
- Develop batch and streaming pipelines using Cloud Dataflow
- Work extensively with BigQuery for data warehousing, performance tuning, and query optimization
- Integrate data from multiple sources (APIs, databases, flat files, streaming platforms)
- Ensure data quality, reliability, and governance standards
- Collaborate with Data Analysts, Architects, and Business teams for requirement gathering
- Monitor and troubleshoot production data pipelines
- Strong hands-on experience with Google Cloud Platform (Google Cloud Platform)
- Expertise in: + Data ingestion & transformation + BigQuery + Cloud Composer + Cloud Dataflow
- Strong SQL skills
- Experience with Python (preferred)
- Understanding of data modeling concepts
- Experience with batch and streaming data processing
- Knowledge of CI/CD and version control (Git)
Requirements:
- Strong experience in Google Cloud Platform (Google Cloud Platform)
- Hands-on experience in data ingestion, transformation, and processing using BigQuery, Cloud Composer, and Dataflow
- Design and implement scalable data ingestion and transformation pipelines
- Develop and optimize ETL/ELT workflows on Google Cloud Platform
- Build and manage data workflows using Cloud Composer (Apache Airflow)
- Develop batch and streaming pipelines using Cloud Dataflow
- Work extensively with BigQuery for data warehousing, performance tuning, and query optimization
- Integrate data from multiple sources (APIs, databases, flat files, streaming platforms)
- Ensure data quality, reliability, and governance standards
- Collaborate with Data Analysts, Architects, and Business teams for requirement gathering
- Monitor and troubleshoot production data pipelines
- Strong SQL skills
- Understanding of data modeling concepts
- Experience with batch and streaming data processing
- Knowledge of CI/CD and version control (Git)
- Bachelor's degree in Computer Science, Engineering, or related field (or equivalent experience)
- Google Cloud Platform Professional Data Engineer Certification
- Experience working in Agile environments
- Knowledge of data security and governance best practices
- Experience with large-scale data warehouse environments