Prompting & AI Agent Research Engineer

Hello Patient is transforming healthcare communication through advanced conversational AI. They are seeking a Prompting & AI Agent Research Engineer to design experiments, evaluate AI system behavior, and enhance their AI voice agent, Mia, to improve patient engagement.

Responsibilities:

• Design structured experiments with real controls and statistical rigor
• Build regression test coverage so we know when a global prompt change is breaking things across workflows we didn't expect
• Create a pipeline of validated, high-confidence improvements engineering can pull from instead of building on faith
• Work with the team to prioritize what actually gets shipped based on what the experiments say
• Own prompt design across Mia's agent workflows - multi-turn, voice-first, healthcare context
• Stay current on what's coming out in prompting research, and agent architecture, and bring back ideas worth testing
• Prototype new approaches locally before anything touches production
• Be the person the Product team comes to when they're stuck on a prompting problem
• Work closely with our Product and Engineering teams - understand where Mia is struggling and help decide what's worth experimenting on
• Translate experiment results into clear recommendations people can actually act on
• Build out evaluation templates and frameworks so this doesn't live only in your head