SDE II, ML Infra Services, Annapurna Labs

Amazon is hiring a Software Development Engineer II for its AWS Neuron ML infrastructure services. The role leads development of machine learning infrastructure and tools, including capacity management, workload scheduling, fleet orchestration, and optimization for ML accelerators.

Responsibilities:

• This engineer will lead the design and implementation of ML infrastructure platform, building systems for capacity management, workload scheduling, and fleet orchestration across ML accelerators. They will work with ML scientists, training infrastructure engineers, hardware teams, and internal customers to ensure the ML Infra service delivers seamless ML Accelerator access with low wait times, high utilization, and zero-config deployment from various environments
• As you design and code solutions to help our team drive efficiencies in software architecture, you’ll create metrics, implement automation and other improvements, and resolve the root cause of software defects
• Build high-impact solutions to deliver to our large customer base
• Participate in design discussions, code review, and communicate with internal and external stakeholders
• Work cross-functionally to help drive business decisions with your technical input
• Work in a startup-like development environment, where you’re always working on the most important stuff