Engineering Manager, Modeling

Modular is on a mission to revolutionize AI infrastructure by rebuilding the AI software stack. The Engineering Manager for the GenAI Modeling team will be responsible for scaling the engineering organization, developing and maintaining Modular's models library, and collaborating with various teams to drive efficient model development.

Responsibilities:

• Lead the scoping and development of new GenAI architectures for integration into the MAX stack, ensuring top accuracy from initial research to deployment
• Lead the team maintaining the MAX library of state-of-the-art models
• Work with the Modular product team to select and prioritize new architectures
• Lead and grow the modeling team to the scale demanded by current market needs
• Drive process and technological advancements to enhance model development efficiency, and establish metrics to continuously measure and track improvements
• Drive the optimal model development experience by collaborating with stakeholders to influence the development of necessary libraries and tooling
• Collaborate with the Modular community to facilitate contributions to the models library
• Influence the Modular practices for collaboration and cross-stack development

Requirements:

• 3+ years of management experience with a proven track record of building high-performing collaborative teams of 5+ engineers
• 4+ years of technical experience as a technical lead / contributor in the field of AI and software engineering
• In-depth understanding of deep learning, especially LLMs
• Adept at navigating ambiguity and ability to exercise sound judgment to identify appropriate solutions and tools, while avoiding unnecessary complexity
• Proficiency in Python programming languages, plus familiarity with frameworks such as MAX, Pytorch, or vLLM