Senior Software Engineer - Performance Tooling

Microsoft is a leading technology company that develops AI software enabling the operation of AI models across various platforms. The Senior Software Engineer - Performance Tooling will work on the AI software stack, benchmark performance, optimize workloads, and collaborate with teams to enhance AI performance.

Responsibilities:

• Work across multiple layers of the AI software stack (abstractions, programming models, compilers, runtimes, libraries, and APIs) to enable large-scale model training and inference
• Benchmark OpenAI and other LLMs for performance on GPUs and Microsoft hardware
• Debug, profile, and optimize performance for training/inference workloads on Central Processing Units (CPUs)/Graphics Processing Units (GPUs)
• Monitor performance regressions and drive continuous improvements to reduce time-to-deploy and hardware footprint
• Collaborate across teams of researchers and engineers to deliver scalable, production-ready AI performance improvements