Senior Software Engineer - GPU Local AI Platforms

NVIDIA is a leader in computer graphics and AI technology, and they are seeking a Senior Software Engineer for their Local AI team. The role involves building software for large language models and generative AI applications, ensuring optimal performance on NVIDIA hardware, and engaging with the community and partners on technical matters.

Responsibilities:

• Track and evaluate innovations in leading open-source LLM inference frameworks — identify performance-critical features and algorithmic improvements relevant to NVIDIA edge AI hardware
• Analyze how new model architectures and inference algorithms (attention variants, MoE routing, speculative decoding, multi-token prediction, quantized inference) map onto NVIDIA GPU architecture — identify mismatch, fallback paths, and optimization opportunities
• Characterize multi-node inference behavior: collective communication primitives (NCCL/RCCL), topology-aware all-reduce strategies, and parallelism efficiency on edge cluster configurations
• Produce performance analysis reports mapping theoretical hardware limits (memory bandwidth, FLOP/s, interconnect throughput) to observed inference throughput, latency, and utilization
• Own the model validation workflow for new model releases: architecture compatibility assessment, inference recipe development, performance characterization, and publication to developer recipe sites
• Develop and maintain developer-facing inference recipes: keep them accurate as frameworks evolve, automate staleness detection, and build feedback loops from CI results to recipe updates
• Engage with community and partners on model bring-up questions; serve as the technical point of contact for hardware-specific inference issues related to partner concerns