Founding Senior Applied AI Engineer

Goaly AI is building an agent harness that connects frontier models with users. The Founding Senior Applied AI Engineer will build and operate agent systems, sandboxed execution environments, context and evaluation infrastructure, and ship production workflows with customers while converting production learnings into improvements to models and environments.

Responsibilities:

• Own the harness: the agent loop, tool interface, system prompts, permissions, stop conditions, retries, budget caps, and output checks that turn a model into a dependable agent
• Build sandboxed execution environments (containers / microVMs) that are isolated, reproducible, and fast enough to run thousands of rollouts in parallel, used both for serving and for RL and evals
• Design context engineering: what goes into the window, when to compact, file-backed memory and state, retrieval, and hand-offs between sub-agents on long-running tasks
• Make every agent run observable and replayable: trace every model call, tool call, and state change, so a failure at 3am can be reproduced at 9am
• Build the eval stack: offline suites, tests on production traces, LLM-as-judge, and checks that catch reward hacking and silent failures before they poison training data
• Ship with customers: embed with real users, take a workflow from prototype to stable production, and turn repeated patterns into reusable building blocks (tools, MCP servers, agent skills, playbooks)
• Close the loop with research: convert production traces and failures into tasks, environments, and reward signals for post-training
• Make the model calls: pick which model runs where, and own the cost, latency, and quality trade-offs