Cloud Data Engineer

Apolis is seeking a highly skilled Cloud Data Engineer to support modern data platforms for analytics, reporting, and AI/ML initiatives. The role focuses on designing scalable GCP data architectures, developing batch and real-time data pipelines, implementing data governance with Dataplex, and optimizing enterprise data lakes and warehouses.

Responsibilities:

• Design and implement scalable, cloud-native data architectures on GCP
• Develop and optimize batch and real-time data pipelines using Dataproc, Spark, and Spark Streaming
• Configure and manage Dataplex for data governance, metadata management, lineage, and data quality
• Design and maintain enterprise-scale data lakes and data warehouse solutions
• Build robust data ingestion, transformation, and orchestration workflows
• Collaborate with architects, engineers, and business stakeholders to define technical requirements and solution designs
• Implement data security, governance, and compliance best practices
• Troubleshoot performance issues and optimize cloud data workloads for scalability and efficiency
• Create technical documentation, architecture diagrams, and implementation recommendations

Requirements:

• 8+ years of experience in Data Engineering and Cloud Data Platforms
• Strong hands-on experience with Google Cloud Platform (GCP)
• Expertise in GCP Dataplex
• Expertise in GCP Dataproc
• Strong experience with Apache Spark and Spark Streaming
• Proven experience designing enterprise-scale data architectures
• Strong SQL and Python programming skills
• Experience with cloud-based data lakes, data warehouses, ETL/ELT, and data pipelines
• Strong understanding of data governance, security, metadata, lineage, and data quality
• Excellent troubleshooting, analytical, and communication skills
• Experience supporting analytics, reporting, and AI/ML data platforms
• Experience with large-scale distributed data processing
• Knowledge of GCP data services and cloud-native architecture patterns
• Experience creating architecture diagrams and technical design documentation