Software Engineer III (AI/ML)

Guidewire Software is a global leader in cloud-based platforms for property and casualty insurers, dedicated to transforming the insurance industry through innovative AI solutions. The Software Engineer III (AI/ML) role involves designing and building scalable microservices and APIs for AI capabilities, collaborating with cross-functional teams to integrate machine learning models, and ensuring the performance and security of AI workloads in cloud environments.

Responsibilities:

• Design, build, and maintain scalable microservices and APIs that power AI capabilities across core solutions and offerings
• Develop Generative AI pipelines using frameworks such as LangChain, LlamaIndex, and MCP-based integrations to enable context-aware reasoning and action orchestration
• Collaborate with ML engineers and data scientists to integrate and operationalize models from providers like OpenAI and Anthropic
• Design and deploy ML models that drive predictive insights, anomaly detection, and automated decision-making
• Design and extend MCP servers to define, expose, and manage tools accessible to LLMs
• Implement continuous evaluation and retraining workflows to ensure models remain accurate and relevant as business data evolves
• Work closely with platform teams to align ML and GenAI components with enterprise standards for security, reliability, and performance
• Ensure scalability, performance, and security of AI workloads in multi-tenant cloud environments (AWS, Kubernetes)
• Participate in architecture reviews and define MCP-compliant interfaces for consistent, safe model–tool interactions

Requirements:

• 5+ years of software engineering experience, with exposure to AI/ML and backend platform development
• Proficiency in Python, TypeScript, or JavaScript, with strong coding and debugging skills
• Hands-on experience with cloud and container technologies such as AWS, Docker, and Kubernetes
• Familiarity with AI orchestration frameworks (LangChain, LangGraph, CrewAI) and GenAI design patterns such as RAG, ReAct, and agent-based reasoning
• Experience building or integrating MCP servers to manage tools, context, and state across LLMs and external systems
• Expertise with LLM APIs (OpenAI, Claude, Gemini, etc.) and multi-model orchestration
• Strong foundation in API design, microservice architecture, and event-driven systems
• Knowledge of authentication and security standards, including OAuth2, JWT, and secure coding practices
• Experience with databases such as PostgreSQL or DynamoDB
• Passion for building intelligent platforms that leverage AI to improve efficiency, reliability, and automation
• BS/MS in Computer Science or a related field, or equivalent professional experience
• Demonstrated ability to embrace AI and apply it to your current role as well as data-driven insights to drive innovation, productivity, and continuous improvement
• Experience with additional AI/ML frameworks or cloud platforms
• Exposure to insurance technology or enterprise SaaS environments
• Contributions to open-source AI/ML projects
• Experience with ethical AI and governance best practices