Bioscope AI is seeking a Data Scientist to ensure the quality, reliability, and trustworthiness of their clinical AI outputs. The role involves developing evaluation frameworks, confidence scoring systems, and automated quality assurance processes that clinicians can trust.
Responsibilities:
- Design and implement automated evaluation pipelines that assess AI output quality, accuracy, and safety at scale
- Develop uncertainty quantification systems where confidence scores meaningfully correlate with accuracy
- Build comprehensive evaluation frameworks combining automated assessment with clinician-validated test cases
- Implement feedback loops that continuously improve model outputs based on validation signals
- Establish scalable quality gates that catch errors before they reach end users
- Contribute to model alignment and fine-tuning efforts