Senior Deep Learning Compiler Engineer - XLA

NVIDIA is an AI computing company developing GPU-accelerated technologies for computing, graphics, and artificial intelligence. The Senior Deep Learning Compiler Engineer will develop compiler optimization algorithms for deep learning workloads, optimize JAX and OpenXLA performance on NVIDIA GPUs, and create code-generation and graph-partitioning solutions. The role also involves collaborating with deep learning framework and GPU hardware teams to advance compiler software for next-generation AI systems.

Responsibilities:

• Crafting and implementing compiler optimization techniques for deep learning network graphs
• Designing novel graph partitioning and tensor sharding techniques for distributed training and inference
• Performance tuning and analysis
• Code-generation for NVIDIA GPU backends using open-source compilers such as MLIR, LLVM and OpenAI Triton
• Designing user facing features in JAX and related libraries and other general software engineering work
• Working closely with GPU hardware engineering teams to design AI compiler software features for next-generation GPUs