Manager - AI Technical Product, Development (51407)

Citrin Cooperman offers a dynamic work environment, fostering professional growth and collaboration. We are seeking a Manager – AI Technical Product, Development, to join our Development team within the Information Technology department, responsible for pioneering our enterprise AI competency and bridging the gap between generative AI pilots and enterprise operations.

Responsibilities:

• Value Harvesting & Baseline Capture: Shadow autonomous SI teams and service-line SMEs during the pilot phase. Proactively extract and document the specific evaluation criteria, ground-truth datasets, and baseline performance metrics
• Transition Front-Running: Anticipate the operational needs of a pilot, long before it is finished. Engage InfoSec, Data Operations, and Enterprise Architecture early in the SI build process to clear roadblocks and ensure a frictionless handover to the support team
• Playbook Development: Author the definitive 'Day-Two' operational playbooks. Translate pilot value characteristics into repeatable processes for capturing, baselining, monitoring, and responding to changes in AI value measures (e.g., token drift, accuracy degradation)
• ROI & Performance Championing: Continuously monitor the agent’s performance against the originally stated SME value proposition. Ensure that the excitement of the 'demo phase' translates into quantifiable, measurable business outcomes as the solution nears production
• Cross-Service Line Standardization: Observe disparate pilot workstreams across different business units and synthesize their varied evaluation methods into a single, cohesive enterprise standard that the Data Operations team can efficiently support
• Shadowing & Support: Act as a strategic partner to the SMEs, helping them articulate their evaluation criteria, while ensuring the SI understands any operational realities, of our environment, that may put value creation at risk

Requirements:

• Have a bachelor's degree in computer science, information technology, engineering, or equivalent practical experience
• Have 5+ years of experience in Technical Product Management, IT Service Management (ITSM), or AI Strategy, with a focus on transitioning complex systems from R&D/external vendors into enterprise operations
• Possess deep familiarity with how System Integrators operate, including an understanding of the typical gaps between SI deliverables and operational readiness
• Possess strong conceptual understanding of Generative AI and agentic evaluation frameworks (e.g., LLM-as-a-judge, RAG precision/recall metrics) and the data required to establish performance baselines
• Possess exceptional technical writing and process design skills, with a proven track record of creating standardized operational playbooks for highly complex, non-deterministic systems
• Be highly autonomous and comfortable operating in a matrixed environment where you must influence and extract information from autonomous teams without having direct command-and-control authority over their daily tasks
• Be a 'Day-Two' Thinker: While everyone else is excited about the initial pilot launch, you are obsessively focused on how the system will be monitored and maintained six months later
• Be a diplomatic Extractor: Possess the emotional intelligence to embed with fast-moving SI/SME teams, supporting their autonomy while firmly extracting the rigorous documentation and datasets the enterprise requires
• Be a synthesizer: Sit in a room full of highly technical AI engineers and business-focused SMEs, translate the conversation, and distill it to address product operations