Senior GCP Data engineer
United States of America
Full Time
1 hour ago
H1B Sponsor Likely
Key skills
Google Cloud PlatformBigQuerySQLNUMERIC/BIGNUMERICPIVOT/UNPIVOTWindow FunctionsPartitioningClusteringAuthorized ViewsRow-Level SecurityColumn-Level SecurityBigQuery Write APIDataformGit version controlUnit testingCloud RunPythonDockerCloud StorageBucket designLifecycle policiesExternal tablesCloud SchedulerIAMVPC Service ControlsCMEKSecret ManagerDLPData ClassificationCI/CDCloud LoggingCloud MonitoringBigQuery performance optimizationBigQuery cost optimizationSlotsReservationsMaterialized viewsQuery optimizationAtlanMonte Carlo.sas7bdat conversionHANA replication pipelinesIdempotent retry logicDead-letter handlingData EngineeringUnit TestingGCPGoogle CloudGitVersion Control
About this role
Jade Business Services (JBS) is seeking a Senior GCP Data Engineer with strong hands-on experience in designing and building enterprise-scale data platforms on Google Cloud Platform. The role involves leveraging advanced data engineering skills to optimize and manage data workflows and ensure effective data governance.
Responsibilities:
- Designing and building enterprise-scale data platforms on Google Cloud Platform (GCP)
Requirements:
- BigQuery (Advanced SQL, NUMERIC/BIGNUMERIC, PIVOT/UNPIVOT, Window Functions, Partitioning, Clustering, Authorized Views, Row/Column-Level Security, BigQuery Write API)
- Dataform (SQL workflows, dependency management, Git version control, unit testing)
- Cloud Run, Python & Docker
- Cloud Storage (bucket design, lifecycle policies, external tables)
- Cloud Scheduler
- IAM, VPC Service Controls, CMEK, Secret Manager, DLP/Data Classification
- CI/CD for SQL and containerized applications
- Cloud Logging & Monitoring
- BigQuery performance and cost optimization (slots, reservations, materialized views, query optimization)
- Atlan (data catalog & lineage)
- Monte Carlo (data observability, freshness, volume, schema drift, anomaly detection)
- Experience with .sas7bdat conversion, HANA replication pipelines, idempotent retry logic, and dead-letter handling is highly preferred
- 12–15+ years of Data Engineering experience
- Strong expertise in GCP-based data engineering and cloud modernization
- Excellent SQL, Python, and problem-solving skills
- Experience working on enterprise-scale data migration and governance projects