AI Kernel Engineer

Majestic Labs is building custom AI servers for large-scale inference and training. The AI Kernel Engineer designs and optimizes high-performance compute kernels, integrates them into AI software pipelines, and collaborates with compiler, runtime, and hardware teams.

Responsibilities:

• Design and implement high-performance compute kernels for AI primitives such as GEMM, attention, normalization, and convolution
• Optimize for throughput, latency, and memory hierarchy across heterogeneous compute units (SIMD, matrix engines, DMA)
• Collaborate with compiler and runtime teams to integrate kernels into Triton and PyTorch pipelines
• Profile and tune kernels using tools like Perfetto, VTune, Tracy, Nsight, or custom simulators
• Prototype and evaluate precision formats (FP16/BF16/FP8/e5m2, MXFP/FP4, etc.)
• Contribute to micro-architecture feedback loops, helping co-design ISA and memory features with the hardware team