Senior Data Engineer

Role Overview

• You'll define the blueprints for high-scale systems where quality and latency are the primary constraints.
• You will engineer robust pipelines using a cutting-edge stack including Ray, Snowpark, and Apache Beam.
• You will design and operate sophisticated workflows and intelligent scheduling strategies leveraging Apache Airflow, Snowflake Tasks, and Google Workflows.
• You will design and build scalable backend APIs and services in Node.js and Python to deliver reliable, well-defined data to internal and external systems.
• You will design and fine-tune high-performance storage solutions across BigQuery, Snowflake, PostgreSQL, Cloud Spanner, and GCS, optimizing for cost, performance, and reliability.
• You will build CI/CD pipelines, implement observability and monitoring, and own production systems to ensure data integrity and platform health.

Requirements

• 5+ years of professional experience in Data Engineering and Backend Engineering with demonstrated ownership of production systems.
• Deep understanding of ETL/ELT patterns, data modeling, partitioning strategies, idempotent pipeline design, and cost-aware storage design and compute optimization.
• Experience designing and building RESTful APIs, handling authentication and authorization, and optimizing queries across relational and NoSQL databases.
• Proven ability to deploy and manage production workloads in the cloud (e.g., GCP) including a solid grasp of IAM, managed services, serverless, and containerized compute.
• Proven ability to lead design discussions, influence technical direction, mentor teammates, and collaborate effectively with cross-functional partners.
• Strong commitment to code and data quality, unit/integration testing, CI/CD, documentation, and owning systems from development to production support.

Tech Stack

• Airflow
• Apache
• BigQuery
• Cloud
• ETL
• Google Cloud Platform
• JavaScript
• Node.js
• NoSQL
• Postgres
• Python
• Ray

Benefits

• Flexible Work Environment 💻
• Retirement Savings Matching Plan (RRSP). Plan for your future with us! 💸
• Personal Spending Account 💰
• Up to $500 to spend on anything related to physical, mental or financial well-being (in addition to your Health Care Spending Account)
• 17 Paid Days Off (in addition to 13 Personal Days) 🌅
• This includes an extra day off during the month of your birthday 🍰
• our gift to you!
• An IDEAS (Inclusion, Diversity, Equity, Awareness, Solidarity) team ⚖️
• Weather is inclusive, we will be too. Our IDEAS team is committed to making this happen!