Medeloop is a company focused on improving healthcare through innovative AI solutions. They are seeking a Senior SDET to own the quality infrastructure across their product portfolio, ensuring reliability and effectiveness in testing non-deterministic AI systems.
Responsibilities:
- Test infrastructure, test data, test processes across the entire product portfolio while working with Devops and Infrastructure engineers
- Test Framework - build and enhance automated testing frameworks and tools that facilitate automated testing across different layers of application
- The reliability bar for all Web applications, Mobile applications and AI agent outputs — from hallucination detection to latency regressions and tool-call correctness
- Test infrastructure, test data, and test processes across the entire product portfolio, alongside DevOps and Infrastructure engineers
- Automated testing frameworks that span all layers of the application — unit, integration, contract, and end-to-end
- Evaluation frameworks designed for LLM-based systems: non-deterministic output scoring, prompt regression, and adversarial test suites
- HIPAA-aware test data management — de-identification pipelines, synthetic data generation, and audit trail validation
- Integration of automated tests into CI/CD pipelines for continuous delivery confidence
- Build stability monitoring and release gate enforcement before any deployment
- Documentation of test plans, test results, and evaluation standards to support knowledge sharing
- The 'safety net' for product quality — you define what done looks like