Director, Analytics & Business Intelligence, Digital Product Operations

The College Board is a mission-driven nonprofit organization dedicated to excellence in education. As the Director of Analytics & Business Intelligence, you will build the measurement infrastructure to help the Digital Product Operations team understand and improve its impact through data-driven decision-making.

Responsibilities:

• Define and build product metrics dashboards tracking roadmap maturity, Productboard field completeness, and roadmap change patterns across all 15+ Digital Product teams
• Partner with Product leaders and PM/POs to define what “healthy” looks like for each metric, establishing baselines and targets that reflect meaningful improvement, not just activity
• Design dashboards that are self-serve and easy to interpret, so product teams can understand their own health data without requiring ProdOps to translate it for them
• Prepare executive-ready dashboards with minimal oversight from the Senior Director
• Identify gaps in available data and partner with the Planning & Tooling Governance Director to ensure tooling standards support the metrics the function needs to track
• Build and maintain a measurement framework that tracks how effectively the product group is adopting ProdOps-driven ways of working, including new planning practices, tooling standards, and process changes
• Define adoption metrics for each major ProdOps initiative before it launches, establishing what “adopted” looks like and how it will be measured from day one
• Take a documented position on what the adoption data means, not just what it shows: diagnose whether gaps in adoption stem from awareness, capability, process design, or resistance, then bring a recommended course of action to the relevant stakeholders, partner with the relevant director to design the response, and own the follow-through to confirm whether the intervention worked
• Track change management signals across the product group: awareness rates, behavior change indicators, and the difference between leading and lagging adoption signals
• Own ongoing maintenance of all dashboards across product and ProdOps metrics, ensuring data is current, accurate, and trustworthy at all times
• Establish governance standards for metric definitions, ensuring consistent interpretation across teams and preventing measurement drift as the organization evolves
• Conduct regular audits of data quality; identify and address gaps, inconsistencies, or stale data before they surface in leadership reviews or team conversations
• Partner with the Planning & Tooling Governance Director to ensure metric definitions align with tooling standards and that field governance decisions support accurate measurement
• Document all metric definitions, calculation methods, and data sources in the ProdOps Info Hub so the measurement framework is transparent and maintainable
• Coach PM/POs on how to read and act on their roadmap health dashboards, translating data signals into product decisions and planning adjustments they can make independently
• Coach the ProdOps team on how to interpret function effectiveness metrics, helping the team understand what the data is telling them and where to focus improvement efforts
• Design coaching approaches that build genuine data literacy, not just tool familiarity, so teams develop the capability to operate independently rather than depending on ProdOps for interpretation
• Identify patterns in how teams are misreading or ignoring their metrics; surface these patterns to the Senior Director and the relevant director as input for targeted interventions

Requirements:

• 5+ years of experience in product analytics, business intelligence, or data analysis within a digital product or technology organization
• Experience measuring and driving organizational change: you understand the difference between awareness and behavior change, track both, and take ownership of designing and following through on the intervention when adoption stalls
• Comfort operating with ambiguity, defining what to measure and how for a function still establishing its own ways of working
• Demonstrated experience building dashboards and metrics frameworks that teams actually use, not just technically sound, but genuinely adopted and acted on
• Strong understanding of product management practices: you know what roadmap maturity, backlog health, and planning consistency look like in practice, and can design metrics that reflect them accurately
• Strong data governance instincts: you define metrics precisely, document them clearly, and prevent measurement drift over time
• Familiarity with Productboard, Jira, and Confluence as data sources: you know how to extract meaningful signals from product management tooling
• Comfort with SQL and APIs to extract and validate your own data, even if you're not a technical builder yourself
• Strong coaching and communication skills: you can translate data into clear, actionable guidance for non-technical audiences without losing accuracy
• The ability to travel 5-7 times a year to College Board offices or on behalf of College Board business
• A passion for expanding educational and career opportunities and mission-driven work
• Authorization to work in the United States for any employer
• Curiosity and enthusiasm for emerging technologies, with a willingness to experiment with and adopt new AI-driven solutions and comfort learning and applying new digital tools independently and proactively
• Clear and concise communication skills, written and verbal
• A learner's mindset and a commitment to growth: welcoming diverse perspectives, giving and receiving timely, respectful feedback, and continuously improving through iterative learning and user input
• A drive for impact and excellence: solving complex problems, making data-informed decisions, prioritizing what matters most, and continuously improving through learning, user input, and external benchmarking
• A collaborative and empathetic approach: working across differences, fostering trust, and contributing to a culture of shared success