Senior DevOps Engineer, IPP Sanity Engineering

NVIDIA is a leader in AI and computing technology, seeking a Senior DevOps Engineer for their IPP Sanity Engineering team. The role involves leading infrastructure projects, automating workflows, and optimizing GPU resource utilization to support the development of cloud services for NVIDIA's products.

Responsibilities:

• Lead end to end SW infrastructure bringup execution of new Nvidia GPU product
• Develop framework and scripts to automate workflows and deployments in the private cloud environment
• Have a thorough understanding of Nvidia GPU hardware and driver stack, SBIOS, VBIOS and should be able to enhance automation for farm wide updates of firmware
• Optimize farm utilization of GPU resources by identifying right set of regression test coverage
• Champion config automation using world-class configuration management & infrastructure automation (IaC) tools like Chef, Puppet, Ansible, Terraform etc
• Execute on bringup of specialized products used for accelerated computing and secure AI (Nvidia Confidential Computing), in fast-paced and critically important environments
• Develop extensive monitoring dashboards systems to have fast, reliable and real-time pulse of the various infrastructure subsystems using state of the art telemetry
• Will be leading a service charter completely, and will be essentially a responsible pilot in charge for the development, monitoring and automation of that infrastructure
• Automation and performance tuning of regression test frameworks, creation of self healing/automated recovery solutions for multi-geo regression farms
• Coherent engagement with collaborators and partner teams across organizations to deliver onboarding of new products in CI/CD
• Implement seamlessly on multiple parallel bringups scoped out in Nvidia Product Bringup landscape

Requirements:

• Bachelor's or Master's Degree in Computer Science or Software Engineering, or equivalent experience
• 8+ years of relevant experience
• Hands-on coding and debug experience (with any including but not limited to Python, JAVA etc.), cross compiling source code on various platforms, triage, root cause and resolve issues in the bringup infrastructure
• Familiar with maintenance and setup of Linux, Windows (x64 and arm) hosts, VM and container based environments
• Unix & TCL shell proficiency is expected
• Experience in MySQL/No-SQL(plus), should be able to write complex queries
• Experience with version control systems like Perforce, GIT
• Demonstrable experience working in large scale enterprise production systems. 8+ years of development and operations experience required
• Expertise in creating agentic AI to orchestrate GPU fleet management is a plus
• Strong background with automating bare metal and VM provisioning at large scale
• Prior knowledge of VM isolation for GPUs, Nvidia Confidential Computing etc is a major plus
• Experience with public cloud platforms (AWS, GCP, Azure) and virtualization technologies such as VMware, KVM, Docker, and Kubernetes clusters is desirable
• Experience with debugging GPU performance issues, embedded device software development and automation, software driver development and CUDA/TensorRT applications