Key skills
AirflowBigQueryCloudETLGoogle Cloud PlatformPostgresPythonSQLTableauData EngineeringData WarehousingDatabricksdbtGCPGoogle CloudGKEGCScomposerCommunication
About this role
Role Overview
- Design and Build: Develop and implement scalable, secure, and cost-effective cloud-based data solutions.
- Manage Data Pipelines: Develop and maintain data pipelines to extract, transform, and load data into data warehouses or data lakes.
- Ensure Data Quality: Implement data quality and validation processes to ensure data accuracy and integrity.
- Optimize Data Storage: Ensure efficient data storage and retrieval for optimal performance.
- Collaborate and Innovate: Work closely with data architects, data modelers, product owners, and stay updated with the latest cloud technologies and best practices.
- Team Lead: Create & lead a team of data engineers (external/internal) to ensure timely deliverables fulfilling all data engineering guidelines & standards.
Requirements
- Programming: Python
- Database: SQL, PL/SQL, Postgres SQL, Big query, Stored Procedure / Routines.
- ETL & Integration: AecorSoft / Datasphere, DBT, Databricks (Optional)
- Data Warehousing: SCD Types, Fact & Dimensions, Star Schema
- Data Modeling: Erwin (Optional)
- Medallion Architecture: Bronze, Silver, Gold, Platinum
- GCP Cloud Services: Big Query, GCS, Cloud Function/Run, GKE
- Supporting Technologies: Airflow (Composer), Automic.
- Visualization (Optional): PowerBI (Optional), Tableau (Optional)
- Soft Skills: Problem-Solving
- Communication
- Analytical Thinking
- Attention to Detail
- Adaptability
Tech Stack
- Airflow
- BigQuery
- Cloud
- ETL
- Google Cloud Platform
- Postgres
- Python
- SQL
- Tableau
Benefits
- No Relocation support available