Mathematical Scientist for AI Safety Research

LawZero is a non-profit organization developing safe-by-design artificial intelligence systems through its Scientist AI approach. The Mathematical Scientist will contribute to foundational theoretical research, including developing AI architectures and safety mechanisms, proving probabilistic safety guarantees, analyzing existing research, and guiding empirical validation and experiments.

Responsibilities:

• Boldly go where no one has gone before in exploring new AI system architectures, theoretical frameworks, and new safety mechanisms in search of a blueprint for safe AGI and corresponding safety guarantees
• Work closely with Yoshua Bengio and other leading researchers to analyze and refine the formal requirements needed to safely build and deploy the Scientist AI, including proving probabilistic safety guarantees under finite data and compute constraints; and, as the system matures, helping our research teams with empirical validation
• Analyze, evaluate and contribute to the existing theoretical work already undertaken at LawZero by Yoshua Bengio and leading researchers, including the writing and dissemination of scientific papers
• Read vigorously to stay up-to-date with relevant AI safety and machine learning research and deeply understand the risks posed by frontier models, including misalignment, reward hacking, instrumental goals, etc
• Scrutinize and contribute to LawZero’s broader research agenda in order to guide and prioritize experiments to answer critical safety questions efficiently, in a way that does not prevent the highest level of capability
• Share your knowledge about AI Safety and help researchers and engineers at LawZero better design and implement new ML algorithms and experiments