Senior Software Engineer, CUTLASS Performance

NVIDIA is a leader in high-performance computing platforms powering the AI revolution across many applications. They are seeking a Senior Software Engineer to join the CUTLASS team, focusing on performance benchmarking and optimization of deep learning models on NVIDIA GPUs.

Responsibilities:

• Benchmark the performance of state-of-the-art deep learning models’ inference and training passes to identify key GPU kernel and fusion opportunities
• Identify gaps between theoretical and realized performance, and suggest software improvements or model adjustments to resolve them
• Develop tooling to automate the benchmarking, analysis, and performance optimization loop to push the limit of CUTLASS kernel performance within DL networks
• Be the authoritative resource on kernel performance in the team and engage with teams across NVIDIA including GPU architecture, DL frameworks, and QA as the performance representative for the CUTLASS team