Senior AI Engineer

Hermetic builds Mia, an AI assistant that responds to inquiries for restaurants and event venues. The Senior AI Engineer will own Mia’s conversational agent, autonomy and evaluation systems, voice rollout, and production reliability, while helping set engineering standards and mentor teammates.

Responsibilities:

• The conversation agent: Mia’s replies, routing, tool calls for availability and pricing, handoff detection, and guardrails that keep things accurate and on-brand
• Autonomy: Improve the models and per-location thresholds that predict which replies need an edit, so more can go out safely on their own
• Evaluation that drives decisions: Build offline eval sets from real conversations, regression tests for prompts and graph changes, and online metrics tied to what customers care about: edit rate, handoff rate, response time, and bookings
• Voice: Help take Voice Mia from early adopters to every customer, with per-customer rollout flags, safe call transfer, and instant rollback when something sounds off
• Running it for real: Tracing and cost tracking on every LLM call, prompt versioning, latency budgets, and being the calm person in the room when a model provider has a bad day
• Raising the bar: Write the design docs others build from, review code thoughtfully, and help engineers new to LLM systems get good at them fast