AirflowAWSFluxPythonSparkSQLAIDatabricksIntegration TestingPerformance OptimizationRemote Work
About this role
Role Overview
Diagnose and resolve complex data-processing issues to ensure the reliability and performance of critical data pipelines.
Collaborate with the team to support on-time software delivery by proactively managing risks and data-flow dependencies.
Prevent data errors and inconsistencies by strengthening validation, monitoring, and anomaly detection across a complex data system.
Deliver additional business value each development cycle by iteratively shipping well-defined improvements and fixes.
Integrate quickly by learning the existing development cycle, following established processes, and collaborating effectively across time zones as needed.
Requirements
Practical hands-on expertise with Spark, Airflow, AWS, and the Databricks ecosystem is required.
Strong programming and querying skills in Python and SQL; familiarity with Hive is a plus.
Strong understanding of big-data processing concepts (design trade-offs, constraints, governance, and performance optimization).
Proven ability in debugging, unit and integration testing, managing task dependencies, monitoring, and anomaly detection.
Experience with Delta processing and format, and comfortable using modern AI tools (e.g., Copilot, ChatGPT) to enhance productivity.
Knowledge of French is required for positions permanently based in Quebec so the incumbent can communicate as needed with colleagues, partners, and vendors in Quebec.
Fluency in English is required for this role to communicate with colleagues, clients, and partners who are primarily located outside Quebec.
Tech Stack
Airflow
AWS
Flux
Python
Spark
SQL
Benefits
Comprehensive health benefits, life insurance, and disability coverage.
Generous paid time off and vacation, volunteer leave, quarterly personal wellness days, and no-meeting days.
Tuition reimbursement and book reimbursement programs to support continuous learning and professional development.
Thrive Global wellness program, confidential Employee Assistance Program (EAP), and one-on-one well-being coaching.
Employee programs — including Employee Resource Groups (ERGs), the “GoTo Gets Involved” program, and our charitable donation-matching program — to expand your social network and amplify the impact of your contributions.
A Registered Retirement Savings Plan (RRSP) to help you plan for the future.
Gym fee reimbursement programs to support your physical wellness.
Access to telemedicine services for convenient healthcare.
A performance bonus program to recognize your engagement and contributions.
A monthly remote work allowance to cover home-office expenses.