Home
Jobs
Saved
Resumes
Data Scientist – AI Quality, Evaluation at Bioscope AI | JobVerse
JobVerse
Home
Jobs
Recruiters
Companies
Pricing
Blog
Jobs
/
Data Scientist – AI Quality, Evaluation
Bioscope AI
Website
LinkedIn
Data Scientist – AI Quality, Evaluation
Boston, Massachusetts, United States of America
Full Time
4 hours ago
No Visa Sponsorship
Apply Now
Key skills
Python
PyTorch
AI
Machine Learning
ML
Deep Learning
LLM
About this role
Role Overview
Design and implement automated evaluation pipelines that assess AI output quality, accuracy, and safety at scale
Develop uncertainty quantification systems where confidence scores meaningfully correlate with accuracy
Build comprehensive evaluation frameworks combining automated assessment with clinician-validated test cases
Implement feedback loops that continuously improve model outputs based on validation signals
Establish scalable quality gates that catch errors before they reach end users
Contribute to model alignment and fine-tuning efforts
Requirements
Strong foundation in deep learning frameworks (PyTorch) and LLM architectures
Experience with model evaluation, benchmarking, and quality metrics
Proficiency in Python and modern ML development tools
Strong statistical foundations
Ability to read, implement, and extend research papers
Master's degree in Computer Science, Machine Learning, Statistics, or related quantitative field (PhD preferred)
Publications in top ML/AI venues (NeurIPS, ICML, ICLR, ACL)
Experience with RLHF, DPO, or preference optimization techniques
Background in healthcare AI or regulated industries
Experience building evaluation systems for production LLM applications
Tech Stack
Python
PyTorch
Benefits
Health insurance
Professional development opportunities
Apply Now
Home
Jobs
Saved
Resumes