Ding Zhou

1. MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs
   2024/02/23 by Ziheng Jiang, Haibin Lin, Jiang, Ziheng +61 · 61 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques
2. MoE-Pruner: Pruning Mixture-of-Experts Large Language Model using the Hints from Its Router
   2024/10/15 by Yanyue Xie, Zhi Zhang, Xie, Yanyue +14 · 20 citations
   Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #Expert finding and Q&A systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Topic Modeling
3. Revisiting Multimodal Representation in Contrastive Learning: From Patch and Token Embeddings to Finite Discrete Tokens
   2023/03/27 by Yuxiao Chen, Jianbo Yuan, Chen, Yuxiao +13 · 9 citations
   Computer Science · #Advanced Image and Video Retrieval Techniques #Computer Vision and Pattern Recognition (cs.CV) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Multimodal Machine Learning Applications