About this role

Ideate, develop, and compare the performance of different agent harnesses (eg memory, context compression, communication architectures for agents)
Design and implement rigorous quantitative benchmarks for large scale agentic tasks
Assist with automated evaluation of Claude models and prompts across the training and product lifecycle
Work with our product org to find solutions to our most vexing challenges applying agents to our products
Help create and optimize data mixes for model training that maximize Claude’s performance or ease of use on agentic tasks

Have experience developing complex agentic systems using LLMs
Have significant software engineering and ML experience
Have spent time prompting and/or building products with language models
Have good communication skills and an interest in working with other researchers on difficult tasks
Have a passion for making powerful technology safe and societally beneficial
Stay up-to-date and informed by taking an active interest in emerging research and industry trends.
Enjoy pair programming (we love to pair!)
Strong candidates may also have experience with large-scale RL on language models and multi-agent systems

Research Engineer, Agents

Key skills