Data Scientist (AI Quality & Evaluation)

Bioscope AI is seeking a Data Scientist to ensure the quality, reliability, and trustworthiness of their clinical AI outputs. The role involves designing automated evaluation pipelines, developing frameworks for uncertainty quantification, and establishing quality gates to enhance model outputs.

Responsibilities:

• Design and implement automated evaluation pipelines that assess AI output quality, accuracy, and safety at scale
• Develop uncertainty quantification systems where confidence scores meaningfully correlate with accuracy
• Build comprehensive evaluation frameworks combining automated assessment with clinician-validated test cases
• Implement feedback loops that continuously improve model outputs based on validation signals
• Establish scalable quality gates that catch errors before they reach end users
• Contribute to model alignment and fine-tuning efforts