Research Scientist - Frontier Data (ONSITE IN SF)

PulseRise Technologies is seeking a Research Scientist - Frontier Data for a hands-on, high-leverage research role. The successful candidate will design datasets and evaluation frameworks for frontier models, working closely with top AI labs to experiment with data collection strategies and develop metrics for model improvement.

Responsibilities:

• Design data slices and explore data shapes that expose meaningful model failure modes across domains, including finance, code, and enterprise workflows
• Build and refine evaluation rubrics and reward signals for RLHF and RLVR training pipelines
• Model annotator behavior and run experiments to improve different model capabilities
• Develop quantitative frameworks for measuring dataset quality, diversity, and downstream impact on model alignment and capability
• Partner with lab research teams to translate their training objectives into concrete data and evaluation specifications
• Move fast from hypothesis to experiment, extract actionable insights from messy results, and iterate quickly