Key skills
AirflowAWSBigQueryCloudGoogle Cloud PlatformNoSQLPostgresPythonShell ScriptingSQLTerraformGoShellAILookerGCPGoogle CloudGitHub ActionsGKECloud RunPub/SubVertex AIcomposerGitHubGitLab
About this role
Role Overview
- Lead the design and evolution of our recommendation and decision engine
- Build a "Single Customer View" platform integrating real-time data pipelines
- Utilize Infrastructure-as-Code (IaC) for scalable, cloud environments
- Partner with Data Scientists to transition experimental models into production
- Architect scalable Cloud Data Warehouses and Single Customer View logic
- Manage workflow automation using Cloud Composer and Cloud Workflows
- Apply SRE principles to ensure fault diagnosis and advanced monitoring
- Manage multi-cloud infrastructure using Terraform and GitHub Actions
Requirements
- Expert-level Python, SQL, and Shell Scripting; working knowledge of Go.
- Deep expertise in BigQuery, Vertex AI, Dataflow, Cloud Run, GKE, and Pub/Sub.
- Mastery of Terraform and GitHub Actions or Gitlab
- Hands-on experience with Postgres DB's, and NoSQL solutions.
- Expertise in Airflow (DAG development), Looker (LookML), and API management.
- Professional GCP/AWS Cloud Architect or Data Engineer certifications are highly regarded.
Tech Stack
- Airflow
- AWS
- BigQuery
- Cloud
- Google Cloud Platform
- NoSQL
- Postgres
- Python
- Shell Scripting
- SQL
- Terraform
- Go
Benefits
- Complimentary event tickets
- Birthday and volunteering leave
- Wellbeing discounts & flu vaccinations
- Paid parental leave & free employee support (EAP)
- Global rewards and recognition
- Learning, development & career pathways
- A diverse, inclusive, and passionate team