Mathematical Scientist for AI Safety Research

LawZero is a non-profit organization committed to advancing research and creating technical solutions that enable safe-by-design AI systems. They are seeking an outstanding theoretical researcher to contribute to foundational efforts in AI safety, working closely with leading experts to analyze and refine the requirements for safely building and deploying AI systems.

Responsibilities:

• Boldly go where no one has gone before in exploring new AI system architectures, theoretical frameworks, and new safety mechanisms in search of a blueprint for safe AGI and corresponding safety guarantees
• Work closely with Yoshua Bengio and other leading researchers to analyze and refine the formal requirements needed to safely build and deploy the Scientist AI, including proving probabilistic safety guarantees under finite data and compute constraints; and, as the system matures, helping our research teams with empirical validation
• Analyze, evaluate and contribute to the existing theoretical work already undertaken at LawZero by Yoshua Bengio and leading researchers, including the writing and dissemination of scientific papers
• Read vigorously to stay up-to-date with relevant AI safety and machine learning research and deeply understand the risks posed by frontier models, including misalignment, reward hacking, instrumental goals, etc
• Scrutinize and contribute to LawZero’s broader research agenda in order to guide and prioritize experiments to answer critical safety questions efficiently, in a way that does not prevent the highest level of capability
• Share your knowledge about AI Safety and help researchers and engineers at LawZero better design and implement new ML algorithms and experiments