Bai, Hongxiao
- MoE Parallel Folding: Heterogeneous Parallelism Mappings for Efficient Large-Scale MoE Model Training with Megatron Core
2025/04/21 by Liu, Dennis, Yan, Zijie, Yao, Xin +15 · 5 citations
#Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)