AI Kernel Engineer

Majestic Labs is a deep-tech AI infrastructure company re-architecting AI systems for data centers and developing high-performance server solutions for large-scale inference and training. The AI Kernel Engineer will design, implement, profile, and optimize compute kernels for AI workloads, collaborate with compiler, runtime, and hardware teams, and contribute to precision-format evaluation and architecture co-design.

Responsibilities:

• Design and implement high-performance compute kernels for AI primitives such as GEMM, attention, normalization, and convolution
• Optimize for throughput, latency, and memory hierarchy across heterogeneous compute units (SIMD, matrix engines, DMA)
• Collaborate with compiler and runtime teams to integrate kernels into Triton and PyTorch pipelines
• Profile and tune kernels using tools like Perfetto, VTune, Tracy, Nsight, or custom simulators
• Prototype and evaluate precision formats (FP16/BF16/FP8/e5m2, MXFP/FP4, etc.)
• Contribute to micro-architecture feedback loops, helping co-design ISA and memory features with the hardware team