Trata is a company that builds proprietary training environments and evaluation infrastructure used by frontier AI labs. They are seeking a Research Scientist Intern to design datasets and evaluation rubrics that influence how frontier models learn, with opportunities to co-write a significant paper and contribute to model training runs.
Responsibilities:
- Design data slices that expose meaningful model failure modes
- Build and refine evaluation rubrics and reward signals for RLHF and RLVR training pipelines
- Develop quantitative frameworks for measuring dataset quality, diversity, and downstream impact on alignment and capability
- Partner with lab research teams to translate training objectives into concrete data and evaluation specifications