Software Engineer- AI/ML, Amazon Neuron Training

Amazon's Annapurna Labs team builds AWS Neuron, a software development kit that accelerates deep learning and generative AI workloads on Trainium machine learning accelerators. The Software Engineer will implement and optimize distributed training components for large-scale training, post-training, and reinforcement learning workloads, while profiling performance and collaborating across the Neuron software stack.

Responsibilities:

• You’ll implement and tune components of our distributed training stack for large-scale training, post-training, and reinforcement learning workloads on the latest Trainium instances, working across PyTorch and the Neuron software stack
• You'll contribute to parallelism strategies such as data, tensor, and pipeline parallelism and apply reduced-precision formats under the guidance of senior team members
• You'll profile workloads to help determine whether a bottleneck sits in compute, memory, collectives, or host overhead, and work with compiler, runtime, and collectives engineers to help land the fix
• You'll build and maintain internal tooling, benchmarks, and tests that keep the team's performance work reproducible, and take on increasing ownership as you grow in the role