Design and execute website A/B and multivariate tests across eCommerce touchpoints, delivering the full lifecycle independently from hypothesis definition to readout.
Translate ambiguous business questions into structured experimental frameworks — engage in hypothesis development, selecting metrics, sizing samples, and setting guardrails against premature decisions.
Apply causal inference and quasi-experimental methods (e.g., difference-in-differences, holdout groups) for decisions that can't be cleanly A/B tested.
Deliver concise experiment readouts that go beyond statistical significance to explain what changed, why it matters, and what to do next.
Establish success metrics and trade-off criteria upfront to align stakeholders and reduce post-hoc debate.
Identify when experimentation is the wrong tool and provide structured analytical alternatives when controlled testing isn't feasible.
Apply best practices in data structuring to ensure accuracy and consistency across systems.
Build and maintain analytical models that support key business decisions across moderately complex domains.
Work with large, sometimes messy datasets to produce analysis that is defensible, reproducible, and clearly scoped in its assumptions.
Drive the deployment of AI-powered analytics solutions — including Databricks Genie — that reduce manual analysis and surface insights faster for internal and customer-facing use cases.
Build and maintain AI agents and automated reporting pipelines, applying best practices for reliability, accuracy, and scalability.
Apply prompt engineering techniques to optimize model outputs, ensuring responses are consistent, trustworthy, and aligned with user expectations.
Support in designing guardrails and governance frameworks for AI tools, establishing clear boundaries around data access, output quality, and acceptable use.
Operationalize AI solutions on modern data platforms (Databricks, Claude, Gemini), actioning the journey from raw data to governed, consumable insight.
Document AI workflows, prompt templates, and guardrail configurations so solutions remain usable and maintainable across teams.
Monitor and adjust AI agent performance over time, flagging degradation in output quality and recommending adjustments to prompts, data inputs, or configurations.
Build strong working relationships with internal and external partners to align analysis with business goals.
Collaborate across teams to identify opportunities and deliver clear, practical recommendations.
Maintain and improve SOPs to ensure consistency, efficiency, and knowledge sharing across the team.
Document data sources, transformation logic, and analytical assumptions to ensure analyses are reproducible and auditable.
Provide guidance and feedback to less experienced analysts when needed.
Contribute to team learning by sharing insights and raising the standard of analytical practice.
Actively develop skills to take on increasingly complex and ambiguous work.
Requirements
3-5 years of professional experience as a Business Analyst with strong experience in Experimentation
Legally able to work in Canada (up to FULL TIME HOURS year-round/ no Student VISA)
Completion of a criminal background check
Tech skills:
Databricks, or similar
Basic SQL Knowledge: You can write SQL queries without using an LLM
AI literacy, you’ll be expected to go beyond prompting
Basic coding, like scripting in Python, would be nice
A/B testing experience
Tech Stack
Python
SQL
Benefits
15 days of vacation*
1 extra day off (Inclusion and Diversity Day)
6 well-being (sick) days
Hybrid work: 3 days a week in the office
Work remotely (anywhere in the world) for up to 3 weeks
Excellent extended health, dental, and vision benefits
$1000 health/lifestyle spending account* for your total physical and mental well-being
TELUS Health App
Mental Health Assistance/Counseling
Virtual medical appointments
Onsite fitness equipment with showers and towel service
Pickleball, badminton, and table tennis matches happen, from very competitive to very casual
A dog-friendly office
well-socialized pups are welcome
Free street parking (first-come, first-serve; no reserved spots for senior leaders)
Indoor secure bike storage with change rooms and showers
20-minute walk to either Main Street
Science World or VCC Clark Skytrain stations
45% discount on our entire product range (15% for friends and family)