QA Analyst – ML/AI

Role Overview

• Test ML workflows and their integrations
• Test models (functional validation, bias, drift)
• Validate MLOps pipelines: training, deployment, and monitoring
• Verify AI environment configurations (compute, security)
• Produce specialized test plans for models and LLMs.

Requirements

• Experience in quality assurance (QA) in a data science/ML context
• Strong understanding of ML models and LLMs
• Comfortable with Azure ML and AI-focused DevOps
• Able to validate ML performance, drift, and risks
• French: Advanced
• English: Intermediate
• Please note that intermediate English is required due to the nature of the tasks, including frequent communication with employees and managers outside Quebec.

Tech Stack

• Azure
• Flux

Benefits

• Work-life balance helps us stay at our best. We offer flexible work options, and with our Unlimited Vacation Plan, you can rest and recharge when you need it most.
• Your contributions matter. From day one, our total rewards package offers a comprehensive compensation plan, including short-term incentive programs.
• Our benefits are designed with optimal health and wellness in mind. You’ll have access to 24/7 virtual healthcare, as well as an extensive wellness portal that provides tools and resources to support your physical, mental, emotional, and financial well-being.
• Continuous growth and learning. When you join Alithya, you’re joining a team committed to investing in your development. Refining your expertise is essential in a rapidly evolving industry, and we support your continuous growth every step of the way. Through partnerships with world-renowned education leaders, we provide access to thousands of top-rated online courses and certifications. With exclusive leadership programs designed to empower you to lead your teams with confidence and deliver impactful outcomes, and with a tuition reimbursement program for external training, we set you up for success to thrive and achieve your ambitions.
• Our people drive our success. Through our Employee Share Purchase Plan with matched contributions, you become a stakeholder, sharing in our growth and directly benefiting from our collective achievements.
• The diversity of our backgrounds, experiences, thoughts and insights is our competitive advantage. We foster a collaborative environment rooted in our core values of respect, well-being, passion, trust, integrity, and creativity.
• Fostering an environment where you can thrive starts with ensuring an accessible recruitment process. If you require any accommodations, we welcome you to contact us.