Search Relevance Product Manager – eCommerce

Role Overview

• Own search relevance strategy, including ranking signals and query understanding
• Define and evolve ranking policies (availability, price, popularity, fitment, recency)
• Lead improvements in query handling (synonyms, typo correction, rewriting)
• Run a zero-results reduction program with effective fallbacks
• Establish quality gates (offline evaluation + A/B testing) for all releases
• Design and evaluate experiments to drive measurable improvements
• Build and maintain a gold standard evaluation dataset (“truth set”)
• Prioritize and deliver a relevance roadmap across key query types
• Work closely with Engineering and Data Science to define features, signals, and evaluation criteria

Requirements

• Business Analysis: Knowledge of business analysis and the set of tasks, techniques and tools required to identify business needs; ability to recommend solutions that deliver value to stakeholders.
• Decision Making and Critical Thinking: Knowledge of the decision-making process and associated tools and techniques; ability to accurately analyze situations and reach productive decisions based on informed judgment.
• Software Change Request Management: Knowledge of software change request management; ability to manage software product change requests from customers, prospective customers, vendors, and internal staff.
• Software Engineering: Knowledge of software engineering; ability to deliver new or enhanced fee-based software products.
• Software Product Business Knowledge: Knowledge of and experience with the business aspects and operation of a software product; ability to manage install base, current uses, future plans, and product vision.
• User Acceptance Testing (UAT): Knowledge of UAT activities, tasks, tools and techniques; ability to design, implement and evaluate acceptance tests for end-users.
• Consideration for top candidates: Experience with search platforms (e.g., Elasticsearch, Solr, vector or hybrid search)
• Experience with LLM-powered search or query understanding, including semantic search, embeddings, or retrieval augmented generation
• Experience with eCommerce search behavior (e.g., part number, fitment, attribute-driven queries)
• Digital product management, user experience, user research, digital strategy, or related function
• Experience managing projects using Product Management and/or Agile software tools such as Aha, Product Board, Azure DevOps
• Human-centered design, lean innovation, or design thinking methodologies
• Product Owner certification (Certified Scrum Product Owner from Scrum Alliance)
• Knowledge of Software Development Lifecycle (SDLC) and demonstrated experience employing SDLC in aspects of the project management process
• Improved NDCG@10 and MRR (ranking quality)
• Reduced zero-results rate
• Fewer manual fixes (boosts, one-off rules) over time
• 5–7 years of product management experience in search, recommendations, or data-driven products
• Hands-on experience designing and interpreting A/B tests and experiments
• Strong understanding of ranking, relevance, or information retrieval concepts
• Ability to define and use metrics and evaluation frameworks (e.g., NDCG, MRR, CTR)
• Experience working closely with Data Science or ML teams
• Proven ability to lead complex, cross-functional initiatives
• Strong analytical thinking and communication skills

Tech Stack

• Azure
• ElasticSearch
• SDLC

Benefits

• Medical, dental, and vision benefits*
• Paid time off plan (Vacation, Holidays, Volunteer, etc.)*
• 401(k) savings plans*
• Health Savings Account (HSA)*
• Flexible Spending Accounts (FSAs)*
• Health Lifestyle Programs*
• Employee Assistance Program*
• Voluntary Benefits and Employee Discounts*
• Career Development*
• Incentive bonus*
• Disability benefits
• Life Insurance
• Parental leave
• Adoption benefits
• Tuition Reimbursement