Engineering Analyst, Trust and Safety, RAI Novel Testing

Google is a leading technology company specializing in innovative solutions, and they are seeking an Engineering Analyst for their Trust and Safety team. This role focuses on developing novel testing methodologies for AI products, requiring a blend of data science expertise and engineering collaboration to ensure safety and efficacy in emerging technologies.

Responsibilities:

• Drive the methodological frontier of model evaluation
• Partner with Google DeepMind to develop novel data-driven methodologies for the structured and unstructured testing of emerging AI products and model capabilities
• Move beyond standard benchmarks, designing sophisticated experimental frameworks and uncovering latent model behaviors and capabilities
• Define testing and safety standards, working with cross-functional colleagues, policy, and engineering, to ensure they are met
• Perform analyses and drive insights to develop model-level and product-level safety mitigations
• Lead and influence cross-functional teams to implement safety initiatives
• Act as an advisor to executive leadership on complex safety issues
• Represent Google's AI safety efforts in external forums and collaborations, contributing to industry-wide best practices
• Mentor analysts, fostering a culture of excellence and acting as a subject matter expert on adversarial techniques
• Work with graphic, controversial, or upsetting content