Sr. Software Engineer II - AI

iHerb is on a mission to make health and wellness accessible to all. They are seeking a Sr. Software Engineer II - AI to lead the development of GenAI-powered product experiences and AI platform infrastructure, focusing on building AI features, shared AI platforms, and coordinating with teams for alignment on product features.

Responsibilities:

• Design, build, and operate production AI features: RAG pipelines, LLM-driven recommendations, conversational agents, or agentic workflow automation
• Build the shared AI platform layer: retrieval infrastructure, eval frameworks, model monitoring, guardrails, and observability
• Write LLM applications and integrations with marketing platforms, BI tools, or customer-facing product surfaces
• Evaluate model and feature quality using structured eval frameworks; iterate on prompts, retrieval strategies, and model selection using data
• Use AI-driven SDLC tooling such as Claude Code as a daily practice for both AI and non-AI code
• Coordinate with the Personalization team to align GenAI product features with existing ML personalization signals
• Document AI system design decisions, evaluation results, and operational lessons in the shared knowledge base
• Own the observability of AI systems you build: latency, cost, quality drift, and error rates; participate in on-call rotation and respond to production incidents