Staff AI Agent Engineer

Colossus Technologies Group is seeking a Staff AI Agent Engineer for a senior, hands-on engineering role focused on complex deployments. The engineer will lead AI agent deployments, improve agent behavior, and collaborate with product teams to ensure high quality and operational readiness.

Responsibilities:

• Lead technically complex AI agent deployments from initial design through production
• Build and iterate on agent workflows, prompts, evaluations, and system integrations
• Identify failure modes and improve agent behavior through structured analysis and testing
• Convert one-off customer solutions into reusable frameworks and internal standards
• Collaborate with product and platform teams to influence system direction based on field learnings
• Define and uphold quality bars for launches, reliability, and operational readiness
• Mentor other engineers through code reviews, design feedback, and hands-on support

Requirements:

• 6+ years of professional software engineering experience
• Strong experience building and operating production backend systems
• Proficiency in Python and modern service-oriented architectures
• Experience working with LLM-based systems, including prompts, tools, or agent-style workflows
• Ability to reason about system correctness, edge cases, and operational risk
• Comfortable working directly with customers on technically demanding problems
• High ownership and sound judgment in fast-moving environments
• Experience with agent evaluation frameworks, monitoring, or observability
• Background in B2B SaaS or enterprise software
• Experience operating in regulated or operationally sensitive environments
• Demonstrated ability to turn bespoke implementations into scalable systems