Li, Shiyao
- A Survey on Efficient Inference for Large Language Models
2024/04/22 by Zixuan Zhou, Xuefei Ning, Zhou, Zixuan +27 · 40 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- Evaluating Quantized Large Language Models
2024/02/28 by Shiyao Li, Xuefei Ning, Li, Shiyao +15 · 1 voice · 11 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Natural Language Processing Techniques #Topic Modeling #cs.AI #cs.CL
- ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generation
2024/06/04 by Tianchen Zhao, Zhao, Tianchen, Tongcheng Fang +21 · 18 citations
Computer Science · Engineering · #Advanced Memory and Neural Computing #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Neural Networks and Reservoir Computing
- FlightLLM: Efficient Large Language Model Inference with a Complete Mapping Flow on FPGAs
2024/01/08 by Shulin Zeng, Jun Liu, Zeng, Shulin +31 · 13 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Speech Recognition and Synthesis
- Mixture of Attention Spans: Optimizing LLM Inference Efficiency with Heterogeneous Sliding-Window Lengths
2024/06/21 by Tianyu Fu, Fu, Tianyu, Haofeng Huang +23 · 14 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #I.2.7 #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Topic Modeling
- LV-Eval: A Balanced Long-Context Benchmark with 5 Length Levels Up to 256K
2024/02/06 by Yuan, Tao, Ning, Xuefei, Zhou, Dong +10 · 11 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- MBQ: Modality-Balanced Quantization for Large Vision-Language Models
2024/12/27 by Shiyao Li, Yingchun Hu, Li, Shiyao +22 · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimodal Machine Learning Applications
- Fast and Efficient 2-bit LLM Inference on GPU: 2/4/16-bit in a Weight Matrix with Asynchronous Dequantization
2023/11/28 by Jinhao Li, Li, Jinhao, Jiaming Xu +11 · 3 citations
Computer Science · Engineering · #Distributed #FOS: Computer and information sciences #Ferroelectric and Negative Capacitance Devices #Machine Learning (cs.LG) #Natural Language Processing Techniques #Parallel #Topic Modeling #and Cluster Computing (cs.DC)
- Can LLMs Learn by Teaching for Better Reasoning? A Preliminary Study
2024/06/20 by Ning, Xuefei, Wang, Zifu, Li, Shiyao +7 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- PM-KVQ: Progressive Mixed-precision KV Cache Quantization for Long-CoT LLMs
2025/05/24 by Tengxuan Liu, Liu, Tengxuan, Shiyao Li +15 · 3 citations
Computer Science · Engineering · #Advanced Data Storage Technologies #Advancements in Photolithography Techniques #Algorithms and Data Compression