Software Automation Engineer

McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. The Software Automation Engineer (P3) is a senior individual contributor responsible for designing, developing, and maintaining automated test solutions across Ontada’s product ecosystem, with a strong focus on AI-enabled and GenAI-powered systems.

Responsibilities:

• Own and execute test strategy, planning, and execution for assigned features, services, or product areas under the guidance of the QA Lead
• Identify functional, integration, and non-functional quality risks early; communicate risks, impacts, and recommendations clearly
• Coordinate end-to-end validation across multiple environments to ensure release readiness
• Design, develop, and maintain automated test suites across UI, API, service, and data layers
• Contribute to the enhancement and maintainability of automation frameworks using tools such as Selenium, Playwright, Cypress, TOSCA, or similar
• Develop robust API automation using RestAssured, Postman, or equivalent frameworks
• Integrate automated tests into CI/CD pipelines to support fast and reliable feedback cycles
• Leverage AI-assisted development tools (e.g., GitHub Copilot, Claude Code, or similar) to accelerate test automation development, refactoring, and debugging while maintaining code quality and security standards
• Design and execute test strategies for AI/ML and GenAI-powered features, including LLM-based workflows
• Validate prompt behavior, prompt templates, and prompt chaining across different scenarios and data contexts
• Validate AI outputs for accuracy, consistency, explainability, and compliance in regulated environments
• Critically evaluate AI-generated suggestions and outputs to ensure accuracy, safety, reproducibility, and regulatory compliance
• Work closely with Product Owners and Business Analysts to refine user stories, define acceptance criteria, and ensure testability
• Participate actively in sprint planning, grooming, retrospectives, and release readiness reviews
• Collaborate with onshore and offshore QA team members to ensure consistent execution and quality standards
• Ensure testing activities align with HIPAA and other regulatory, security, and data-privacy requirements
• Contribute audit-ready documentation, including test plans, execution evidence, and reports
• Participate in root-cause analysis for quality or performance issues and support corrective actions
• Identify opportunities for improving QA processes, tools, and documentation; contribute suggestions through established continuous improvement channels
• Research and evaluate new QA, automation, or performance testing, AI assisted tools and techniques as appropriate

Requirements:

• 5+ years of progressive Software Quality Assurance experience, preferably in healthcare or regulated industries
• 3+ years of hands-on test automation development experience
• 2+ years of API testing and automation experience
• 3+ years of software performance testing experience
• 1+ years of experience testing AI/ML or GenAI systems, or demonstrated delivery of AI-adjacent quality frameworks (e.g., prompt testing, RAG evaluation, guardrails)
• Experience mentoring or supporting junior QA engineers
• Bachelor's degree in computer science, Engineering, Mathematics, or equivalent practical experience
• Strong experience working in Agile SDLC environments with CI/CD pipelines
• Proficiency in Java, JavaScript, or Python for test automation and scripting
• Experience with CI/CD tools such as Jenkins, GitHub Actions, GitLab CI and build tools like Maven or Gradle
• Solid understanding of QA methodologies, test design techniques, and quality metrics
• Hands-on experience with performance testing tools (JMeter, NeoLoad, or similar)
• Experience using profiling and monitoring tools (Dynatrace, New Relic, AppDynamics, Splunk, JProfiler)
• Ability to analyze performance issues related to CPU, memory/heap, garbage collection, threads, databases, messaging systems, and network latency
• Experience creating reusable, maintainable, and portable automation and performance test scripts
• RAG testing experience, including embedding quality, retrieval evaluation, and chunk strategy validation
• Familiarity with vector databases and semantic search concepts
• Hands-on experience using AI-assisted coding and analysis tools such as GitHub Copilot, Claude Code, or similar
• Ensure testing activities align with HIPAA and other regulatory, security, and data-privacy requirements
• Contribute audit-ready documentation, including test plans, execution evidence, and reports
• Participate in root-cause analysis for quality or performance issues and support corrective actions
• Identify opportunities for improving QA processes, tools, and documentation; contribute suggestions through established continuous improvement channels
• Research and evaluate new QA, automation, or performance testing, AI assisted tools and techniques as appropriate
• Experience with source control tools such as GitHub, Bitbucket, Git Bash
• Experience with test management tools (qTest, TestRail, ALM, TestLink, or similar)
• Familiarity with microservices and distributed system architectures
• Experience benchmarking, capacity planning, and release readiness reporting
• Knowledge of healthcare software, data privacy, and regulatory compliance is a plus
• Ability to manage multiple priorities and work independently in a fast-paced environment