Xiuhong Li
- A Survey on Efficient Inference for Large Language Models
2024/04/22 by Zixuan Zhou, Zhou, Zixuan, Xuefei Ning +27 · 36 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- FlashDecoding++: Faster Large Language Model Inference on GPUs
2023/11/02 by Ke Hong, Guohao Dai, Hong, Ke +15 · 9 citations
Computer Science · Engineering · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Natural Language Processing Techniques #Topic Modeling
- MuxServe: Flexible Spatial-Temporal Multiplexing for Multiple LLM Serving
2024/04/02 by Jiangfei Duan, Duan, Jiangfei, Runyu Lu +13 · 10 citations
Engineering · #Power Line Communications and Noise
- MBQ: Modality-Balanced Quantization for Large Vision-Language Models
2024/12/27 by Shiyao Li, Li, Shiyao, Yingchun Hu +22 · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- MxMoE: Mixed-precision Quantization for MoE with Accuracy and Performance Co-Design
2025/05/09 by Haojie Duanmu, Xiuhong Li, Duanmu, Haojie +11 · 9 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Mobile Crowdsensing and Crowdsourcing #Stochastic Gradient Optimization Techniques
- Proteus: Simulating the Performance of Distributed DNN Training
2023/06/04 by Jiangfei Duan, Duan, Jiangfei, Xiuhong Li +11 · 2 citations
Computer Science · Engineering · #Advanced Memory and Neural Computing #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Parallel #Parallel Computing and Optimization Techniques #and Cluster Computing (cs.DC)
- semi-PD: Towards Efficient LLM Serving via Phase-Wise Disaggregated Computation and Unified Storage
2025/04/28 by Ke Hong, Lufang Chen, Hong, Ke +21 · 4 citations
Computer Science · #Parallel Computing and Optimization Techniques #Big Data and Digital Economy #Cloud Computing and Resource Management