Collaborate with DDE team members, product team, and data science team to plan AI review projects, including drafting initial prompt sets and ensuring sufficient time for review phases.
Conduct detailed reviews of AI tool outputs, rate responses, and provide detailed feedback to the data science team for incremental improvements.
Supervise and review the work of junior colleagues, including DDE I experts.
Establish SME testing plans and ensure sufficient SME resources are in place.
Provide annotation, evaluation, and feedback to data scientists, data engineers, and product managers.
Execute best practices in creating and maintaining training data and relevance evaluations.
Communicate actionable feedback and provide customer-focused insights.
Requirements
Have a Law degree with experience (minimum 3 years) in an Australian legal practice role
Be competent in advanced legal research and writing
Have moderate professional experience in managing, coaching, and mentoring others
Be a natural problem solver
Have a customer-centric mindset
Be able to manage highly complex projects
Benefits
Discounted Health plan rate and Optical Assistance