Research Engineer - [Seed Model - Infra - Training Performance & ML Compilation (Torch Compile)]

ByteDance is a technology company whose Seed Infrastructures team develops systems for AI foundation models. The Research Engineer will optimize large-scale model training through ML compiler techniques, GPU kernel development, PyTorch compilation, and performance profiling across heterogeneous hardware.

Responsibilities:

• Optimize training performance for large-scale foundation models through compiler-level techniques, including graph optimization, operator fusion, and kernel generation
• Develop and extend ML compilation capabilities based on the PyTorch compilation stack (e.g. FX, Dynamo, Inductor) to improve training efficiency across heterogeneous GPU platforms
• Design and optimize high-performance GPU kernels for training workloads
• Conduct performance profiling and analysis of large-scale training jobs; identify and resolve bottlenecks in collaboration with research and infrastructure teams