Li, Shuaipeng
- Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by Tencent
2024/11/04 by Xingwu Sun, Sun, Xingwu, Yanfeng Chen +228 · 3 voices · 36 citations
Computer Science · #Age of Information Optimization #cs.AI #cs.CL
- Surge Phenomenon in Optimal Learning Rate and Batch Size Scaling
2024/05/23 by Shuaipeng Li, Li, Shuaipeng, Penghao Zhao +23 · 9 citations
Computer Science · Engineering · #Educational Technology and Assessment #FOS: Computer and information sciences #Image Processing Techniques and Applications #Machine Learning (cs.LG) #Metaheuristic Optimization Algorithms Research
- TransMamba: A Sequence-Level Hybrid Transformer-Mamba Language Model
2025/03/31 by Yixing Li, Ruobing Xie, Li, Yixing +19 · 3 voices · 8 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Hunyuan-TurboS: Advancing Large Language Models through Mamba-Transformer Synergy and Adaptive Chain-of-Thought
2025/05/21 by Ao Liu, Tencent Hunyuan Team, Liu, Ao +509 · 1 voice · 13 citations
Computer Science · Medicine · #Artificial Intelligence in Healthcare and Education #Big Data and Digital Economy #Topic Modeling #cs.CL
- HMoE: Heterogeneous Mixture of Experts for Language Modeling
2024/08/20 by An Wang, Wang, An, Xingwu Sun +21 · 6 citations
Computer Science · #Computation and Language (cs.CL) #Expert finding and Q&A systems #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- Scaling Laws for Floating Point Quantization Training
2025/01/05 by Sun, Xingwu, Li, Shuaipeng, Xie, Ruobing +13 · 5 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Hardware Architecture (cs.AR) #Machine Learning (cs.LG)
- More Expressive Attention with Negative Weights
2024/11/11 by Ang Lv, Lv, Ang, Ruobing Xie +10 · 2 citations
Computer Science · Neuroscience · Psychology · #Artificial Intelligence (cs.AI) #Cognitive Science and Education Research #Computability, Logic, AI Algorithms #Computation and Language (cs.CL) #Creativity in Education and Neuroscience #FOS: Computer and information sciences #Machine Learning (cs.LG)
- BeamVQ: Beam Search with Vector Quantization to Mitigate Data Scarcity in Physical Spatiotemporal Forecasting
2025/02/26 by Weiyan Wang, Wang, Weiyan, Xingjian Shi +22 · 3 citations
Decision Sciences · Engineering · Earth and Planetary Sciences · #Forecasting Techniques and Applications #Traffic Prediction and Management Techniques #Meteorological Phenomena and Simulations
- Advanced Long-term Earth System Forecasting
2025/05/26 by Hao Wu, Wu, Hao, Yuan Gao +49 · 10 citations
Computer Science · #Computational Physics and Python Applications #FOS: Computer and information sciences #I.2.10 #I.4.9 #Machine Learning (cs.LG)