Principal Software Engineer- GenAI - Remote

Duck Creek Technologies is the intelligent solutions provider defining the future of the property and casualty and general insurance industry. As a Principal Software Engineer on the GenAI team, you will drive the technical vision and execution of advanced AI-powered solutions, designing and implementing scalable systems that leverage large language models and AI-driven services.

Responsibilities:

• Drive the technical vision and execution of advanced AI-powered solutions across multiple initiatives
• Design and implement scalable, secure, and high-performing systems that leverage large language models (LLMs), retrieval-augmented generation (RAG), and AI-driven services
• Lead technical strategy for GenAI-based products and platforms, ensuring alignment with enterprise architecture and business goals
• Own the design and implementation of the AI orchestration runtime, including agent workflows, context assembly, tool invocation, policy enforcement, and execution control
• Build platform-level capabilities for observability, evaluation, auditability, and cost management across AI workloads
• Design and implement core AI services, including model orchestration, inference pipelines, and standardized prompt and configuration patterns
• Collaborate with data scientists and ML engineers to integrate LLMs and fine-tuned models into production systems
• Enable product teams to deliver AI capabilities without reinventing orchestration, governance, or runtime infrastructure
• Architect and deliver solutions for high-complexity Agile stories across multiple domains, ensuring scalability and resilience
• Mentor and guide engineers on modern AI development practices, including distributed systems, model deployment, and performance optimization
• Ensure compliance and security in AI solutions, including data privacy, responsible AI principles, and model governance
• Debug and resolve complex issues in distributed AI systems, ensuring minimal downtime and high availability
• Champion CI/CD and MLOps practices for continuous delivery of AI features and models
• Participate in hiring and talent development for the GenAI team

Requirements:

• Bachelor's degree, or higher education level, or its foreign equivalent, in Computer Science, Computer Information Sciences, and/or related field
• Total Work Experience: 7+ years (software development)
• 5+ years of strategic leadership experience
• Expertise in AI/ML systems: LLM integration, RAG pipelines, vector databases, and prompting strategies
• Experience with LLM evaluation frameworks (e.g., RAGAS, LangSmith evaluations, custom benchmarks)
• Hands-on experience with agent frameworks, workflow orchestration, and LLM runtime systems (e.g., LangGraph, Agent Development Kit, Agent Framework, or similar), including tool use, memory, evaluation, and governance
• Expert of scalable, resilient, modern, cloud-native microservice development with Java, .NET, Python, or Typescript
• Excels in the ability to lead, teach, and guide modern software-development practices across Product Development, operating independently with guidance
• Experience building monitoring, alerting, and observability for maintaining high customer SLAs for SaaS delivered products
• Experience with CQRS, event-driven architecture, and Kafka
• Experience with Terraform/Ansible or other IaC platforms
• Experience with cost controls and usage attribution of model execution
• Knowledge of data security, compliance, and responsible AI principles
• Experience in Cloud platforms and cloud-native architectures, including Serverless
• Proven experience building multi-agent systems with planning, tool calling, and state management
• Expert with CI/CD to deliver software enhancements to customers with full automation
• Expert in distributed software patterns, such as DDD, microservices, serverless, and event-driven architecture
• Experience in regulated industries (financial services, insurance, healthcare)