Lead the development and operationalization of evaluation and quality programs for technology solutions (including AI-enabled features) tailored for healthcare payer use cases.
Define success criteria, acceptance thresholds, and release readiness “go/no-go” gates across the delivery lifecycle.
Develop and maintain high-quality test data, scenarios, and validation suites; coordinate and/or lead user acceptance testing and structured feedback cycles.
Partner with engineering and platform teams to embed automated checks into CI/CD pipelines.
Define and track quality metrics and drive continuous improvement through root-cause analysis.

Bachelor's degree in STEM (Science, Technology, Engineering or Math) or related field or equivalent work experience required.
5+ years of relevant work experience in technology, software delivery, analytics, quality assurance, or healthcare (academic experience included), or related equivalent experience.
3+ years of experience working within the software development life cycle (SDLC).
Proven ability to design and execute evaluation approaches such as functional testing, regression testing, integration testing, and/or production validation and monitoring.
Working knowledge of privacy, security, and compliance considerations relevant to healthcare data (e.g., HIPAA) is strongly preferred.

AI Evaluation Lead

Key skills