PythonPyTorchC++CAIMLGenerative AILarge Language ModelsCollaboration
About this role
Role Overview
Analysis of new models from generative AI field and understanding of impacts on compilation stack
Develop and maintain model definition framework that consists of model building blocks to represent large language models based on PyTorch and Cerebras dialects ready to be deployed on Cerebras hardware.
Develop and maintain the frontend compiler infrastructure that ingests PyTorch models and produces an intermediate representation (IR).
Extend and optimize PyTorch FX / TorchScript / TorchDynamo-based tooling for graph capture, transformation, and analysis.
Collaboration with other teams throughout feature implementation
Research on new methods for model optimization to improve Cerebras inference
Requirements
Degree in Engineering, Computer Science, or equivalent in experience and evidence of exceptional ability
Strong Python programming skills and in-depth experience with PyTorch internals (e.g., TorchScript, FX, or Dynamo).
Solid understanding of computational graphs, tensor operations, and model tracing.
Experience building or extending compilers, interpreters, or ML graph optimization frameworks.
Experience working with PyTorch and HuggingFace Transformers library
Knowledge and experience working with Large Language Models (understanding Transformer architecture variations, generation cycle, etc.)
Strong C++ programming skills.
Knowledge of MLIR based compilation stack
Tech Stack
Python
PyTorch
Benefits
Build a breakthrough AI platform beyond the constraints of the GPU.
Publish and open source their cutting-edge AI research.
Work on one of the fastest AI supercomputers in the world.
Enjoy job stability with startup vitality.
Our simple, non-corporate work culture that respects individual beliefs.