Member of Technical Staff, AI Training Infrastructure

Fireworks AI is building the future of generative AI infrastructure, delivering high-quality models and scalable inference. The Training Infrastructure Engineer will design and optimize the infrastructure for large-scale model training, collaborating with AI researchers to enhance training methodologies.

Responsibilities:

• Design and implement scalable infrastructure for large-scale model training workloads
• Develop and maintain distributed training pipelines for LLMs and multimodal models
• Optimize training performance across multiple GPUs, nodes, and data centers
• Implement monitoring, logging, and debugging tools for training operations
• Architect and maintain data storage solutions for large-scale training datasets
• Automate infrastructure provisioning, scaling, and orchestration for model training
• Collaborate with researchers to implement and optimize training methodologies
• Analyze and improve efficiency, scalability, and cost-effectiveness of training systems
• Troubleshoot complex performance issues in distributed training environments