Qi Hou
- MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs
2024/02/23 by Ziheng Jiang, Jiang, Ziheng, Haibin Lin +61 · 66 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques
- FLUX: Fast Software-based Communication Overlap On GPUs Through Kernel Fusion
2024/06/11 by Li‐Wen Chang, Wenlei Bao, Chang, Li-Wen +22 · 26 citations
Computer Science · Neuroscience · #Parallel Computing and Optimization Techniques #Embedded Systems Design Techniques #Brain Tumor Detection and Classification
- Comet: Fine-grained Computation-communication Overlapping for Mixture-of-Experts
2025/02/27 by S. J. Zhang, Zhang, Shulai, Ningxin Zheng +20 · 21 citations
Computer Science · #Advanced Neural Network Applications #Mobile Crowdsensing and Crowdsourcing #Big Data and Digital Economy
- Triton-distributed: Programming Overlapping Kernels on Distributed AI Systems with the Triton Compiler
2025/04/28 by Size Zheng, Wenlei Bao, Zheng, Size +40 · 11 citations
Computer Science · #Parallel Computing and Optimization Techniques #Advanced Neural Network Applications #Distributed and Parallel Computing Systems
- Two-level Transmission Scheme for Cache-enabled Fog Radio Access Networks
2018/09/03 by Shiwen He, Chenhao Qi, He, Shiwen +7 · 1 citation
Computer Science · Engineering · Mathematics · #Advanced Wireless Network Optimization #Caching and Content Delivery #Cooperative Communication and Network Coding #FOS: Computer and information sciences #Information Theory (cs.IT) #cs.IT #math.IT