Software Engineer, Agents (Internal Audit)

Fieldguide builds software that automates and streamlines assurance and audit work in cybersecurity, privacy, and financial audits. The Software Engineer, Agents will own agent quality, build LLM-powered agents that perform real internal audit work, analyze errors, develop structured-output pipelines, and collaborate closely with practitioners, design partners, and cross-functional teams.

Responsibilities:

• Make agent judgment repeatable: run error analysis on real testing data and turn findings into concrete fixes
• Tradeoffs such as quality/latency/cost across a long multi-phase run
• Build structured-output pipelines that turn model output into real audit artifacts
• Take ambiguous problem statements and turn them into a plan, a shipped feature, and a clear read on what was cut and why
• Work directly with an embedded subject matter expert and with design-partner firms, turning their feedback into agent changes within days
• Expand agent coverage into new controls and new areas of internal audit
• Own a major agent area end-to-end, from how the agent reasons about a class of controls through to the artifact a reviewer signs
• Set the evals and error-analysis practice for the team's agent work, and decide what evidence justifies shipping a change or rolling it back
• Collaborate with PMs and designers to shape roadmaps and define architectural tradeoffs, including where the agent acts and where the auditor decides
• Own the harder model and orchestration judgment calls across a long multi-phase run
• Mentor other engineers and raise the bar on 0→1 execution and applied eval rigor
• Drive agent initiatives that reach beyond Internal Audit and influence how agents are built across Fieldguide
• Set and champion engineering standards for agent reliability, reproducibility, and defensibility
• Partner with engineering and product leadership to define long-term technical strategy for agentic audit work
• Serve as a trusted advisor to leaders across Engineering, Product, and Design
• Represent Fieldguide externally through writing, speaking, and open-source contributions