Research Engineer, Domain Scaling

Anthropic is focused on creating reliable and beneficial AI systems. They are seeking a Research Engineer for their Domain Scaling team to enhance AI capabilities in sectors like finance and healthcare through applied research and data sourcing.

Responsibilities:

• Own the data strategy for knowledge work verticals end-to-end, from task sourcing through RL training
• Manage technical relationships with external data vendors, including evaluation of data quality and reward design
• Collaborate with domain experts to design data pipelines and evaluations
• Explore novel ways of creating RL envs for high value tasks
• Develop and improve QA frameworks to catch reward hacking and ensure env quality
• Run generalization experiments to measure how data strategy changes improve model capabilities
• Partner with other RL research teams and product teams to translate capability goals into training envs and evals