Principal Software Engineer

Microsoft is a leading technology company, and they are seeking a Principal Software Engineer to join their Azure High Performance Computing & AI Engineering team. The role involves designing and developing high volume low latency telemetry pipelines to enhance job reliability and performance for AI supercomputers, while collaborating with strategic customers to drive engineering improvements.

Responsibilities:

• Architect, design and develop high volume low latency end to end event pipelines that can provide first-to-know-insights on events causing job interrupts and job reliability
• Conduct analysis of existing event pipelines to evaluate fidelity, granularity and latency of critical events
• Contribute to improving key metrics such as Job Mean Time to Interrupt, Nodes in Service, Mean Time to Resolve on flagship supercomputers by enabling data scientists and domain experts to use the telemetry to identify events & issues at the intersection of datacenter and hardware, develop hypothesis, conduct A/B tests and synthesize results
• Partner with cross organizational teams to evaluate available telemetry and latency drive architecture, design, development and deployment of end-to-end solutions to manage core infrastructure including current & next generation datacenter, IT hardware, power & cooling technologies
• Drive engineering and operational excellence based on issues and learnings from strategic customers on their usage scenarios to improve product features and capabilities
• Partner with teams on continuous learning and continuous improvement programs by leading the resolution of complex incidents, driving root cause analyses and championing initiatives to minimize future customer impact