Picture for Wenxiang Lin

Wenxiang Lin

FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models

Add code
Jan 18, 2025
Figure 1 for FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models
Figure 2 for FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models
Figure 3 for FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models
Figure 4 for FSMoE: A Flexible and Scalable Training System for Sparse Mixture-of-Experts Models
Viaarxiv icon