Shiyao Li

1. A Survey on Efficient Inference for Large Language Models
   2024/04/22 by Zixuan Zhou, Zhou, Zixuan, Xuefei Ning +27 · 36 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
2. FlightLLM: Efficient Large Language Model Inference with a Complete Mapping Flow on FPGAs
   2024/01/08 by Shulin Zeng, Zeng, Shulin, Jun Liu +31 · 12 citations
   Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
3. Mixture of Attention Spans: Optimizing LLM Inference Efficiency with Heterogeneous Sliding-Window Lengths
   2024/06/21 by Tianyu Fu, Haofeng Huang, Fu, Tianyu +23 · 14 citations
   Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7 #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
4. Evaluating Quantized Large Language Models
   2024/02/28 by Shiyao Li, Xuefei Ning, Li, Shiyao +14 · 8 citations
   Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling
5. MBQ: Modality-Balanced Quantization for Large Vision-Language Models
   2024/12/27 by Shiyao Li, Yingchun Hu, Li, Shiyao +22 · 7 citations
   Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
6. Fast and Efficient 2-bit LLM Inference on GPU: 2/4/16-bit in a Weight Matrix with Asynchronous Dequantization
   2023/11/28 by Jinhao Li, Li, Jinhao, Jiaming Xu +11 · 3 citations
   Computer Science · Engineering · #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
7. PM-KVQ: Progressive Mixed-precision KV Cache Quantization for Long-CoT LLMs
   2025/05/24 by Tengxuan Liu, Liu, Tengxuan, Shiyao Li +15 · 3 citations
   Computer Science · Engineering · #Advanced Data Storage Technologies #Advancements in Photolithography Techniques #Algorithms and Data Compression