Inference Stack Engineer

Role Overview

• Design and build components of an AI inference stack , from high-level model representation to low-level execution
• Develop and extend a Python-based DSL for expressing AI workloads and kernels
• Work on compiler infrastructure including:
• IR design and transformation pipelines
• graph lowering and optimization passes
• backend code generation for target execution environments
• Optimize model execution for:
• latency
• throughput
• memory efficiency
• numerical stability
• Contribute to runtime systems responsible for model execution and scheduling
• Profile and analyze inference workloads to identify system bottlenecks
• Collaborate closely with hardware and systems engineers on execution efficiency
• Influence architecture decisions for next-generation AI execution platforms

Requirements

• Strong software engineering background (C++ and Python)
• Experience with performance-critical systems or compiler-related work
• Understanding of AI model execution (especially transformers / LLMs)
• Familiarity with compute graphs, tensor operations, or execution frameworks
• Ability to analyze complex systems end-to-end (model → runtime → hardware)
• Experience working with large codebases and system-level debugging
• Strong communication skills and ability to work in cross-functional teams

Tech Stack

• Python

Benefits

• Competitive compensation
• Flexible working model