Mathematical Scientist for AI Safety Research

LawZero is a non-profit developing Scientist AI as a safe-by-design AI system with probabilistic safety guarantees. The Mathematical Scientist will advance foundational theory, analyze safety requirements, contribute to research papers, and support empirical validation and research prioritization.

Responsibilities:

• Boldly go where no one has gone before in exploring new AI system architectures, theoretical frameworks, and new safety mechanisms in search of a  blueprint for safe AGI and corresponding safety guarantees
• Work closely with Yoshua Bengio and other leading researchers to analyze and refine the formal requirements needed to safely build and deploy the Scientist AI, including proving probabilistic safety guarantees under finite data and compute constraints; and, as the system matures, helping our research teams with empirical validation
• Analyze, evaluate and contribute to the existing theoretical work already undertaken at LawZero by Yoshua Bengio and leading researchers, including the writing and dissemination of scientific papers
• Read vigorously to stay up-to-date with relevant AI safety and machine learning research and deeply understand the risks posed by frontier models, including misalignment, reward hacking, instrumental goals, etc
• Scrutinize and contribute to LawZero’s broader research agenda in order to guide and prioritize experiments to answer critical safety questions efficiently, in a way that does not prevent the highest level of capability
• Share your knowledge about AI Safety and help researchers and engineers at LawZero better design and implement new ML algorithms and experiments