QA Automation Engineer

Milliman is a global leader in delivering market-leading services and solutions, and they are seeking a QA Automation Engineer to develop and maintain Java-based test automation frameworks for M365 and cloud solutions. The role involves ensuring high-quality software delivery through automation and testing best practices, as well as collaborating within an Agile framework.

Responsibilities:

• Develop and maintain reusable test automation frameworks for web, API, and cloud-native solutions by using Java, Selenium, and TestNG
• Develop and automate test cases for Microsoft 365, SharePoint Online, Power Platform, and Azure-based applications, covering both frontend components (such as React, SPFx) and backend components (such as APIs, Azure Functions, Runbooks)
• Implement and execute automated regression, smoke, integration, and performance tests to ensure high-quality releases
• Perform black box and other relevant testing methods to cover both positive and negative flows when automation is insufficient or infeasible
• Actively participate in design discussions and requirements review to provide input from a testing perspective
• Perform root cause analysis on defects, work closely with developers and support teams to prepare RCA reports in a timely manner
• Leverage AI-based tools, technologies and frameworks throughout the automation test cases development and finding defects in advance
• Collaborate closely with team members within an Agile framework, actively participating in sprint planning, assist in defining acceptance criteria, identifying any testing dependencies, and effectively sizing user stories to ensure clear requirements, and alignment with sprint goals
• Utilize Azure DevOps and GitHub to plan, track, and document work, ensuring transparency and effective project coordination
• Integrate automated testing with GitHub Actions to support both continuous and scheduled test cases execution

Requirements:

• Bachelor's or master's degree in computer science, Information Technology or related field
• Minimum 5 years of hands-on experience in QA and test automation for cloud-based applications, or equivalent industry experience as a Software Engineer working with cloud technologies
• Hands-on experience with automation testing tools, frameworks, IDEs and libraries such as Selenium, TestNG, WebDriver Manager, Apache POI, Extent Reports, Lombok, Rest Assured, Jackson Annotations, Feign Client, Microsoft Graph, Azure Identity, IntelliJ, and Jsoup
• Previous experience developing, maintaining, and executing automated tests for SharePoint, React applications and Azure cloud solutions
• Exposure to performance testing tools and security testing practices
• Scripting/coding skills, with a strong knowledge of API's validation
• Experience with GitHub and Azure DevOps tools for version control and CI/CD pipelines
• Excellent problem-solving and analytical skills, with meticulous attention to detail
• Strong communication and interpersonal skills
• Ability to work collaboratively in a fast-paced environment
• Familiarity with AI-driven testing tools, Azure AI services, or test data generation utilities
• Microsoft certifications related to QA/Test Automation
• Experience in testing AI powered applications
• Experience with Agile/Scrum methodologies
• Proven track record of implementing continuous testing and quality improvements for SharePoint online and the M365 product suite. Familiarity with monitoring and logging tools