Du, Cunxiao
- When Attention Sink Emerges in Language Models: An Empirical View
2024/10/14 by Gu, Xiangming, Pang, Tianyu, Du, Chao +5 · 30 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- GliDe with a CaPE: A Low-Hassle Method to Accelerate Speculative Decoding
2024/02/03 by Cunxiao Du, Jing Jiang, Du, Cunxiao +19 · 13 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · #Algorithms and Data Compression #Cellular Automata and Applications #Computation and Language (cs.CL) #DNA and Biological Computing #FOS: Computer and information sciences
- SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration
2024/10/09 by Heming Xia, Yongqi Li, Xia, Heming +7 · 17 citations
Computer Science · Physics and Astronomy · #Advanced Data Storage Technologies #Computation and Language (cs.CL) #FOS: Computer and information sciences #Magnetic confinement fusion research #Network Packet Processing and Optimization
- LightTransfer: Your Long-Context LLM is Secretly a Hybrid Model with Effortless Adaptation
2024/10/17 by Xuan Zhang, Zhang, Xuan, Cunxiao Du +10 · 4 citations
Computer Science · #Advanced Data Storage Technologies #Artificial Intelligence (cs.AI) #Caching and Content Delivery #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Software-Defined Networks and 5G
- Muon Outperforms Adam in Tail-End Associative Memory Learning
2025/09/30 by Shuche Wang, Wang, Shuche, Fengzhuo Zhang +17 · 1 voice · 7 citations
Engineering · Physics and Astronomy · #Muon and positron interactions and applications #Particle Detector Development and Performance #Particle physics theoretical and experimental studies #cs.AI #cs.LG #math.OC
- Efficient Inference for Large Language Model-based Generative Recommendation
2024/10/07 by Lin, Xinyu, Yang, Chaoqun, Wang, Wenjie +5 · 4 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Information Retrieval (cs.IR)
- Reverse Modeling in Large Language Models
2024/10/13 by Yu, Sicheng, Xu, Yuanchen, Du, Cunxiao +5 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- BanditSpec: Adaptive Speculative Decoding via Bandit Algorithms
2025/05/21 by Y. R. Hou, Hou, Yunlong, Fengzhuo Zhang +14 · 3 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Artificial Intelligence (cs.AI) #Data Stream Mining Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs
2025/02/18 by Longxu Dou, Dou, Longxu, Qian Liu +73 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques
- LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification
2025/02/24 by Yang, Penghui, Du, Cunxiao, Zhang, Fengzhuo +4 · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)