B2Spin Limited is dedicated to delivering unique Free-to-Play Social Casino and gaming experiences. They are seeking a Data Engineer to shape the data infrastructure that powers their products and decision-making, focusing on building scalable data systems to transform player data into actionable insights.
Responsibilities:
- Use Dataform to build medallion data architecture while optimizing BigQuery and ClickHouse models
- Develop batch and real-time data pipelines on our GCP platform
- Orchestrate Airflow DAG pipelines for data imports and exports, with monitoring and alerting that safeguard data integrity
- Expose data to other teams through well-designed APIs, supported by CI/CD pipelines for automated deployments
- Uphold GDPR/CCPA compliance and maintain data governance standards across platforms
Requirements:
- Strong command of SQL and Python
- Hands-on GCP experience with BigQuery, Dataform, Airflow, and Datastream
- Solid working knowledge of Docker and Kubernetes
- A proven track record in ETL, CI/CD, and API development
- The drive to own a product end to end, take initiative, and work independently without close oversight
- Bachelor's degree in Computer Science, Data Science, Information Systems, or equivalent experience
- Real-time processing experience with Kafka, PySpark, or Flink
- Familiarity with ClickHouse
- Infrastructure-as-code experience using Terraform