Yotta Labs is building the next generation multi-silicon AI cloud and runtime platform to power the world’s most demanding AI workloads. They are seeking a highly motivated Research Engineer Intern to work on Trainium, GPU kernels, and LLM systems optimization, owning a well-scoped project that impacts AI applications deployed on their platform.

Responsibilities:

• Implement and optimize compute kernels for Attention, GEMM, MoE, and quantization on NVIDIA, AMD, or AWS Trainium
• Build custom operators using CUDA, Triton, ROCm/HIP, or the Neuron SDK with PyTorch/XLA
• Profile and improve inference performance in vLLM, SGLang, and our custom runtimes — kernel fusion, scheduling, KV-cache and memory optimizations
• Build benchmarks, chase down performance regressions, and turn profiler traces into concrete speedups
• Ship code upstream to open-source AI infrastructure projects, with tests and documentation