Bao, Wenlei

1. ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
   2024/10/28 by Sun, Hanshi, Li‐Wen Chang, Wenlei Bao +14 · 39 citations
   Computer Science · #Anomaly Detection Techniques and Applications #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Network Packet Processing and Optimization #Time Series Analysis and Forecasting
2. FLUX: Fast Software-based Communication Overlap On GPUs Through Kernel Fusion
   2024/06/11 by Li‐Wen Chang, Chang, Li-Wen, Wenlei Bao +22 · 25 citations
   Computer Science · Neuroscience · #Parallel Computing and Optimization Techniques #Embedded Systems Design Techniques #Brain Tumor Detection and Classification
3. Comet: Fine-grained Computation-communication Overlapping for Mixture-of-Experts
   2025/02/27 by S. J. Zhang, Zhang, Shulai, Ningxin Zheng +20 · 19 citations
   Computer Science · #Advanced Neural Network Applications #Mobile Crowdsensing and Crowdsourcing #Big Data and Digital Economy
4. TileLink: Generating Efficient Compute-Communication Overlapping Kernels using Tile-Centric Primitives
   2025/03/26 by Zheng, Size, Fang, Jin, Zheng, Xuegui +9 · 14 citations
   #Distributed #FOS: Computer and information sciences #Parallel #and Cluster Computing (cs.DC)
5. Triton-distributed: Programming Overlapping Kernels on Distributed AI Systems with the Triton Compiler
   2025/04/28 by Size Zheng, Wenlei Bao, Zheng, Size +40 · 11 citations
   Computer Science · #Parallel Computing and Optimization Techniques #Advanced Neural Network Applications #Distributed and Parallel Computing Systems
6. MegaScale-MoE: Large-Scale Communication-Efficient Training of Mixture-of-Experts Models in Production
   2025/05/16 by Jin, Chao, Jiang, Ziheng, Bai, Zhihao +16 · 9 citations
   #Distributed #FOS: Computer and information sciences #Machine Learning (cs.LG) #Parallel #and Cluster Computing (cs.DC)