Alivo is transforming how businesses connect with their customers using cutting-edge AI technology. They are seeking a detail-oriented Manual QA Engineer to own manual testing, validate releases, and evaluate AI conversation quality across their platform.

Responsibilities:

Own Manual Product Testing
Manually test new features, workflows, and user experiences before release
Perform exploratory testing to identify bugs, usability issues, and edge cases
Validate functionality across staging and production-like environments
Execute structured test plans and release checklists to ensure consistent quality
Verify bug fixes and regression testing across product releases
Drive Product Quality & Release Readiness
Review feature implementations and release candidates before deployment
Partner with Engineering to identify risks and improve release confidence
File clear, reproducible bug reports with detailed documentation
Help establish and improve manual testing processes as the company grows
Serve as a trusted quality gate for production releases
Own AI Conversation Quality‍
Evaluate AI-powered phone and chat conversations for quality and effectiveness
Assess whether conversations are natural, accurate, helpful, and aligned with customer goals
Review objection handling, conversational flow, and customer experience outcomes
Identify failure modes, edge cases, hallucinations, and off-script behavior
Help define quality standards and acceptance criteria for AI-powered interactions
Build AI Evaluation Processes‍
Develop and maintain conversation evaluation datasets and testing scenarios
Create scoring rubrics and quality frameworks for measuring AI performance
Track AI quality over time and identify regressions or performance changes
Provide actionable recommendations that improve prompts, workflows, and AI behavior
Collaborate Cross-Functionally
Work closely with Engineering, Product, Customer Success, and Leadership
Provide feedback that improves both product quality and customer outcomes
Help prioritize quality improvements based on customer impact and business goals
Support a culture of quality throughout the organization

Alivo

Open Positions (1)

Engineering

Manual QA Engineer