Liu, Dennis

1. MoE Parallel Folding: Heterogeneous Parallelism Mappings for Efficient Large-Scale MoE Model Training with Megatron Core
   2025/04/21 by Liu, Dennis, Yan, Zijie, Yao, Xin +15 · 5 citations
   #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)
2. Llama 3 Meets MoE: Efficient Upcycling
   2024/12/13 by Aditya Vavre, Ethan He, Vavre, Aditya +11 · 2 citations
   Computer Science · Medicine · #Topic Modeling #Multimodal Machine Learning Applications #Artificial Intelligence in Healthcare and Education