Member of Technical Staff - Evaluations

Reflection AI is on a mission to build open superintelligence and make it accessible to all. They are seeking a Member of Technical Staff to conduct comparative analysis, develop evaluation systems, and collaborate with various teams to enhance model capabilities.

Responsibilities:

• Conduct critical comparative analysis to advance our understanding of model capabilities
• Build and refine evaluation systems and processes that create tight feedback loops between data, evals, and model behavior
• Develop generalizable evaluation frameworks that capture what matters for reasoning, alignment, and usefulness
• Collaborate closely with pre-training, post-training, and applied teams to translate insights into model improvements
• Push the boundaries of what’s measurable, from synthetic evals to human feedback and real-world interaction data