Colossus Technologies Group is seeking a Staff AI Agent Engineer for a senior, hands-on engineering role focused on complex deployments. The engineer will lead AI agent deployments, improve agent behavior, and collaborate with product teams to ensure high quality and operational readiness.
Responsibilities:
- Lead technically complex AI agent deployments from initial design through production
- Build and iterate on agent workflows, prompts, evaluations, and system integrations
- Identify failure modes and improve agent behavior through structured analysis and testing
- Convert one-off customer solutions into reusable frameworks and internal standards
- Collaborate with product and platform teams to influence system direction based on field learnings
- Define and uphold quality bars for launches, reliability, and operational readiness
- Mentor other engineers through code reviews, design feedback, and hands-on support
Requirements:
- 6+ years of professional software engineering experience
- Strong experience building and operating production backend systems
- Proficiency in Python and modern service-oriented architectures
- Experience working with LLM-based systems, including prompts, tools, or agent-style workflows
- Ability to reason about system correctness, edge cases, and operational risk
- Comfortable working directly with customers on technically demanding problems
- High ownership and sound judgment in fast-moving environments
- Experience with agent evaluation frameworks, monitoring, or observability
- Background in B2B SaaS or enterprise software
- Experience operating in regulated or operationally sensitive environments
- Demonstrated ability to turn bespoke implementations into scalable systems