GCP Lead Data Engineer

Ahura Workforce Solutions is seeking a Senior Data Engineer with expertise in Google Cloud Platform (GCP) to enhance their enterprise data ecosystem. The successful candidate will design and deploy advanced data architectures, ensuring the integrity and scalability of data solutions for strategic business intelligence.

Responsibilities:

• Architectural Strategy & System Design
• Enterprise Framework Design: Conceptualize and implement end-to-end data architectures utilizing GCP’s Modern Data Stack (BigQuery, Dataflow, Pub/Sub)
• Scalable Data Modeling: Lead the development of high-performance data models (Star, Snowflake, Data Vault) optimized for multi-petabyte scale and high-concurrency analytics
• Hybrid & Multi-Cloud Strategy: Provide technical leadership on data integration strategies spanning GCP, on-premise systems, and third-party SaaS environments
• Advanced Engineering & Pipeline Automation
• Distributed Processing: Engineer highly resilient, low-latency streaming and batch pipelines using Apache Beam (Dataflow) and Cloud Composer (Airflow)
• Software Engineering Excellence: Develop reusable Python libraries and frameworks to standardize data ingestion, logging, and error-handling across the engineering team
• Infrastructure as Code (IaC): Drive operational maturity by managing cloud resources exclusively through Terraform, ensuring robust versioning and environment parity
• Data Governance, Security & Performance
• System Optimization: Conduct deep-dive performance tuning of BigQuery environments, implementing partitioning, clustering, and slot management to optimize ROI
• Security & Compliance: Architect data security protocols including VPC Service Controls, IAM Least Privilege, and data masking/encryption to meet global compliance standards (GDPR, SOC 2)
• Observability: Establish comprehensive monitoring and alerting frameworks for data health, ensuring high availability and meeting stringent Service Level Objectives (SLO)
• Technical Leadership & Collaboration
• Strategic Mentorship: Serve as a mentor to mid-level and junior engineers, conducting rigorous code reviews and promoting best practices in DataOps
• Stakeholder Alignment: Act as a primary technical liaison between Data Science, Business Intelligence, and Executive leadership to translate business goals into technical roadmaps

Requirements:

• 8–10 years of professional experience in data engineering
• Mastery of Google Cloud Platform (GCP)
• Expert-level SQL optimization
• Advanced Python development
• Experience with GCP's Modern Data Stack (BigQuery, Dataflow, Pub/Sub)
• Development of high-performance data models (Star, Snowflake, Data Vault)
• Technical leadership on data integration strategies spanning GCP, on-premise systems, and third-party SaaS environments
• Engineering highly resilient, low-latency streaming and batch pipelines using Apache Beam (Dataflow) and Cloud Composer (Airflow)
• Development of reusable Python libraries and frameworks for data ingestion, logging, and error-handling
• Managing cloud resources through Terraform
• Conducting performance tuning of BigQuery environments
• Architecting data security protocols including VPC Service Controls, IAM Least Privilege, and data masking/encryption
• Establishing monitoring and alerting frameworks for data health
• Mentoring mid-level and junior engineers
• Conducting code reviews and promoting best practices in DataOps
• Acting as a primary technical liaison between Data Science, Business Intelligence, and Executive leadership
• Bachelors or Masters in Information Technology, Computer Science or relevant field