Key skills
CloudCyber SecurityAILLMAgenticPerformance Optimization
About this role
Role Overview
- Design and implement production agent architectures: state management, error handling, retry logic, graceful degradation, human-in-the-loop escalation
- Build evaluation and testing frameworks for non-deterministic agent workflows: offline tests, synthetic data generation, regression checks, and post-deploy monitoring
- Implement orchestration patterns: multi-agent coordination, tool-calling chains, memory management, context window optimization
- Define deployment and governance practices: agent versioning, rollback, behavioral telemetry, anomaly detection
- Instrument agents with tracing, logging, and observability that make production behavior debuggable
- Establish architectural standards and best practices for agentic development through design reviews, pairing, and mentorship
Requirements
- 7+ years of software engineering experience building production systems, with hands-on experience designing and deploying LLM-based agents
- Deep knowledge of agent reliability patterns: state management, error boundaries, escalation logic, context management, tool-calling failure modes
- Experience with agent orchestration frameworks and understanding of tradeoffs between existing frameworks and building custom
- Strong backend engineering fundamentals: testing, monitoring, deployment, debugging, performance optimization
- Hands-on experience with retrieval-augmented systems and understanding of how retrieval quality affects agent behavior
- Experience building systems that handle adversarial or noisy input (cybersecurity, fraud detection, content moderation, or similar domains)
- Familiarity with cloud-based AI deployment, including observability, reliability, and cost considerations
Tech Stack
- Cloud
- Cyber Security
Benefits
- Competitive compensation
- Community-driven culture with employee events
- Regular catered lunches for in-office work; snacks, drinks available daily
- Generous time off
- Comprehensive health benefits & 401(k) plan
- Fun, modern workspace
- Respectful and nourishing work environment, where every opinion is heard and everyone is encouraged to be an active part of the organizational culture