Design AI Behavior in Real Conversations: Define how agents respond across real-world scenarios (frustration, urgency, confusion, resistance)
Improve Performance & Outcomes: Analyze real interaction data to identify failure points, drop-offs, and opportunities to improve outcomes.
Own Inbound Requests & Prioritization: Own or help manage the intake and prioritization of conversational issues coming from QA and customer-facing teams.
Build & Refine Prompting Systems: Write, test, and improve structured prompts that shape agent behavior, reasoning, and tone.
Raise the Standard: Review conversational work and identify where approaches need to be strengthened.
Requirements
2+ years of experience in forward deployed engineering, implementation, solutions, technical account management, or similar high-context customer-facing technical roles
Experience designing, improving, or evaluating AI-driven conversational experiences in production
Strong prompt writing and systems-thinking skills
Exceptional critical thinking and problem-solving skills
Strong instinct for human behavior, language, and how trust is built in conversation
Ability to assess conversational quality and give clear, actionable feedback
Desire to take on greater responsibility for team coordination, prioritization, and mentorship as the function grows
Experience working on AI agents, chatbots, or LLM-based products in production (Preferred)
Experience operating across multiple customers, workflows, or deployments at once (Preferred)
Strong judgment in prioritizing production issues and balancing competing stakeholder needs (Preferred)
Experience creating frameworks, standards, or training materials for other team members (Preferred)
Comfort operating in ambiguity and moving quickly in an early-stage environment (Preferred)
Benefits
Meaningful ownership in a fast-growing healthtech startup