Research Engineer, Infrastructure, Training Systems

Thinking Machines Lab is dedicated to advancing collaborative general intelligence and is looking for an infrastructure research engineer. The role involves designing and building core systems for scalable training of large models, ensuring efficiency and reliability for research teams.

Responsibilities:

• Design, implement, and optimize distributed training systems that scale across thousands of GPUs and nodes for large-scale training workloads
• Develop high-performance optimizations to maximize throughput and efficiency
• Develop reusable frameworks and libraries to improve training reproducibility, reliability, and scalability for new model architectures
• Establish standards for reliability, maintainability, and security, ensuring systems are robust under rapid iteration
• Collaborate with researchers and engineers to build scalable infrastructure
• Publish and share learnings through internal documentation, open-source libraries, or technical reports that advance the field of scalable AI infrastructure