Senior Math Libraries Engineer - LLM Integration and Developer Experience

NVIDIA is a technology company developing GPU-accelerated libraries and SDKs for AI, data analytics, and scientific simulations. The Senior Math Libraries Engineer will integrate CUDA-X math library APIs into modern LLM and agentic AI workflows, while developing LLM-first API documentation, impact metrics, and tooling for AI-friendly code generation.

Responsibilities:

• Drive the architecture and implementation of math libraries APIs and documentation structures designed to be LLM-first: introspectable, explainable, and easily synthesized by AI agents
• Work with internal and external stakeholders to deliver timely LLM-enhanced library releases
• Build metrics, tools and processes to measure impact and quality of LLM/agentic code generation
• Prototype tooling and solutions to help transform math libraries’ APIs into LLM-friendly representations across popular codegen tools

Requirements:

• • 3+ years of experience
• • Robust knowledge of LLMs, finetuning, RL, building RAGs, MCP, and building agenting tooling
• • Proven experience designing clear, composable APIs and writing high-quality, well-documented code for complex technical domains
• • Ability to prioritize multiple projects and work independently with minimal direction
• • Excellent collaboration, communication, and documentation habits
• • PhD or MSc's degree in Computational Science, Computer Science, Applied Math, or related science or engineering field of study is preferred (or equivalent experience)
• • Prior work in AI-assisted software engineering, code generation, or programming language design
• • Familiarity with CUDA-X math library APIs: cuBLAS, cuFFT, cuSOLVER, cuSPARSE, etc