Amplifire is a leading AI Learning Platform headquartered in Boulder, CO, seeking a Senior QA Automation Engineer to redefine quality assurance through AI-driven testing and automation. The role involves designing AI-powered QA capabilities, building automated regression suites, and ensuring consistent quality across the system.
Responsibilities:
- Use LLMs and AI agents as a core part of test design, analysis, and automation workflows
- Design and build AI-driven testing systems that simulate user behavior and surface regressions
- Define evaluation approaches for AI-driven features to assess quality, reliability, and consistency
- Establish guardrails for AI usage in QA and validate outputs
- Evaluate emerging AI tools and help define how AI is applied across QA
- Build and maintain automated regression suites using Cypress or similar frameworks
- Partner with engineering and product to embed quality early
- Perform manual and exploratory testing for complex workflows
- Maintain high-quality test cases and documentation
- Track defects in Jira and contribute to quality metrics
- Conduct root cause analysis on production issues
Requirements:
- 4+ years of experience in Quality Assurance, including designing and maintaining automated test frameworks in production environments
- 3+ years of experience with Cypress or similar modern E2E testing frameworks
- Strong QA fundamentals, including test coverage strategy, risk assessment, defect writing, and regression planning / execution
- Hands-on experience applying AI/LLMs to testing workflows, such as generating test cases, analyzing results, and improving coverage with a practical understanding of limitations
- Experience testing AI/LLM-driven features, including evaluating output quality, relevance, and reliability
- Familiarity with modern AI development tools and workflows (e.g., Copilot, Claude Code, or similar), applied pragmatically
- Comfortable working across a modern web stack (e.g., React, TypeScript, Java, Python) and combining automation, manual, and exploratory testing for full system coverage
- Strong debugging and problem-solving skills, with the ability to influence technical direction without formal authority through clear thinking, execution, and collaboration