Sr GCP Data Engineer

JOY IT Solutions is hiring a Senior Data Engineer to build and maintain scalable batch and streaming data pipelines on Google Cloud Platform. The role focuses on Java-based Dataflow development, enterprise ETL/ELT solutions, Medallion Architecture, and reliable, optimized data platforms.

Responsibilities:

• Design, develop, and maintain scalable batch and streaming data pipelines using Google Cloud Dataflow with Java (Apache Beam)
• Build reusable, high-performance data processing frameworks using Java
• Develop enterprise-grade ETL/ELT pipelines on Google Cloud Platform
• Design and implement Medallion Architecture (Bronze, Silver, Gold) for modern data lake solutions
• Develop and optimize analytical datasets using BigQuery
• Write efficient SQL queries and optimize query performance for large datasets
• Orchestrate workflows using Cloud Composer (Apache Airflow)
• Manage data storage and lifecycle using Google Cloud Storage (GCS)
• Implement CI/CD pipelines using Git and modern DevOps practices
• Apply GCP IAM best practices for security and governance
• Monitor, troubleshoot, and optimize Dataflow jobs for performance, scalability, and cost efficiency

Requirements:

• Strong hands-on experience with Java-based Google Cloud Dataflow (Apache Beam)
• Strong programming experience in Java
• Hands-on experience with Apache Beam SDK
• Extensive experience with Google Cloud Platform (GCP)
• Strong expertise in BigQuery
• Experience building enterprise ETL/ELT pipelines
• Advanced SQL skills including query optimization
• Experience implementing Medallion Architecture
• Experience with Google Cloud Storage (GCS)
• Experience with Cloud Composer (Apache Airflow)
• Knowledge of CI/CD pipelines and Git
• Strong understanding of GCP IAM and cloud security