AI Agent Engineer

CollectWise is a fast growing and well funded Y Combinator-backed startup using generative AI to automate debt collection. They are seeking an AI Agent Engineer to build the infrastructure and prompting systems for their voice AI agents, focusing on real-time voice interactions and performance optimization.

Responsibilities:

• Build our voice AI infrastructure in LiveKit
• Design and own the architecture of our real-time voice agent systems, including orchestration, state management, latency optimization, prompting and reliability
• Own the end-to-end prompting strategy for CollectWise voice agents, including conversation flows, tone, compliance-safe phrasing, guardrails, and edge-case handling
• Build and maintain testing and evaluation frameworks for voice agent performance, including A/B testing, regression testing, conversation QA, benchmarking, and KPI reporting
• Write, expand, and improve our core AI prompting to cover more real-world scenarios
• Continuously iterate based on performance data, call outcomes, and customer feedback to improve containment, conversion, liquidation rates, and customer satisfaction
• Optimize ASR, STT, TTS, turn-taking, interruption handling, and state transitions to improve voice quality and agent performance
• Build scalable systems and tooling to support millions of voice interactions
• Migrate client implementations from legacy voice AI infrastructure to the latest systems you build, while preserving client-specific customizations and workflows
• Develop prompt and agent tooling, including versioning, rollout strategies, monitoring, safety checks, and debugging workflows
• Work closely with product, operations, and leadership to translate business goals into high-performing voice agent behavior