Motional is a driverless technology company making autonomous vehicles a safe, reliable, and accessible reality. They are seeking a Machine Learning Systems Engineer to join their ML Acceleration team, focusing on optimizing core systems for large-scale model training and enhancing performance across distributed training pipelines.
Responsibilities:
- Utilize profiling tools (e.g., Nsight, PyTorch Profiler) to identify bottlenecks in data loading, gradient computation, and communication. Implement optimizations like kernel fusion, sharding, and tiling to improve step time
- Optimize distributed training pipelines using frameworks such as PyTorch Distributed
- Design and maintain high-performance GPU kernels in Triton or CUDA for state-of-the-art ML workloads
- Optimize robust data loading pipelines that maximize training throughput