Zeta Global is an AI-Powered Marketing Cloud that leverages advanced artificial intelligence to enhance marketing efficiency. They are seeking a Senior Product Manager to lead LLM Operations, focusing on developing user-friendly tools for marketers and managing complex workflows involving AI capabilities.
Responsibilities:
- Agent Chaining and Orchestration: Develop and manage the process of chaining LLM agents for complex workflows, ensuring seamless orchestration and integration within our platform
- Model Workbench Development: Lead the creation of a Model Workbench designed for marketers, making it intuitive for non-technical users to leverage LLM capabilities in their workflows
- MCP Capabilities: Oversee the registration and maintenance of Model Context Protocol server, ensuring that all model capabilities are well-documented and easily accessible
- Agent Evaluation Suites: Build robust evaluation suites for testing and iterating on agent performance, ensuring continuous improvement and reliability
- Context Streaming Services: Implement and manage context streaming services that allow for real-time data flow and contextual awareness in agent interactions
- Technical Troubleshooting and Prototyping: Actively participate in troubleshooting and debugging using tools like LangSmith, and lead by example in building proof-of-concepts (POCs) to demonstrate the feasibility and potential of new ideas
- Advocacy for Quick Iteration: Promote a culture of rapid prototyping and iteration, demonstrating the value of "vibe coding" as a gateway to scalable product development
Requirements:
- Experience in Product Management: Demonstrated experience managing complex technical products, particularly those involving LLMs or AI-driven tools
- Technical Proficiency: Strong technical background with hands-on experience in tools like LangSmith, and familiarity with workflow orchestration and LLM agent chaining
- Problem-Solving Skills: Proven ability to troubleshoot, innovate, and rapidly prototype solutions to demonstrate product feasibility
- Communication and Collaboration: Excellent communication skills, with the ability to work closely with cross-functional teams and offshore developers to align on best practices and product goals
- Experience with Agentic Infrastructure: Familiarity with integrating traditional ML with generative models to enhance model explainability and user interaction
- Background in Workflow Orchestration: Experience with existing workflow orchestration tools and methodologies