vix.ing · top · new · best · stats · spec

Bai, Hongxiao

  1. MoE Parallel Folding: Heterogeneous Parallelism Mappings for Efficient Large-Scale MoE Model Training with Megatron Core
    2025/04/21 by Liu, Dennis, Yan, Zijie, Yao, Xin +15 · 5 citations
    #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)