Zhang, Fengzhuo
- When Attention Sink Emerges in Language Models: An Empirical View
2024/10/14 by Gu, Xiangming, Pang, Tianyu, Du, Chao +5 · 30 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- What and How does In-Context Learning Learn? Bayesian Model Averaging, Parameterization, and Generalization
2023/05/30 by Zhang, Yufeng, Zhang, Fengzhuo, Yang, Zhuoran +1 · 6 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Unveiling the Statistical Foundations of Chain-of-Thought Prompting Methods
2024/08/25 by Hu, Xinyang, Zhang, Fengzhuo, Chen, Siyu +1 · 5 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Statistics Theory (math.ST)
- Error Analyses of Auto-Regressive Video Diffusion Models: A Unified Framework
2025/03/12 by Jing Wang, Wang, Jing, Fengzhuo Zhang +13 · 6 citations
Computer Science · #Image and Video Quality Assessment #Video Coding and Compression Technologies #Visual Attention and Saliency Detection
- LightTransfer: Your Long-Context LLM is Secretly a Hybrid Model with Effortless Adaptation
2024/10/17 by Xuan Zhang, Zhang, Xuan, Zhang, Fengzhuo +10 · 4 citations
Computer Science · #Advanced Data Storage Technologies #Artificial Intelligence (cs.AI) #Caching and Content Delivery #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Software-Defined Networks and 5G
- Muon Outperforms Adam in Tail-End Associative Memory Learning
2025/09/30 by Shuche Wang, Fengzhuo Zhang, Wang, Shuche +17 · 1 voice · 7 citations
Engineering · Physics and Astronomy · #Muon and positron interactions and applications #Particle Detector Development and Performance #Particle physics theoretical and experimental studies #cs.AI #cs.LG #math.OC
- Learning Regularized Monotone Graphon Mean-Field Games
2023/10/12 by Zhang, Fengzhuo, Tan, Vincent Y. F., Wang, Zhaoran +1 · 2 citations
#Computer Science and Game Theory (cs.GT) #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (stat.ML) #Systems and Control (eess.SY) #electronic engineering #information engineering
- From Words to Actions: Unveiling the Theoretical Underpinnings of LLM-Driven Autonomous Systems
2024/05/30 by Jianliang He, He, Jianliang, Siyu Chen +5 · 2 citations
Computer Science · Business, Management and Accounting · #Semantic Web and Ontologies #Business Process Modeling and Analysis #Multi-Agent Systems and Negotiation
- Relational Reasoning via Set Transformers: Provable Efficiency and Applications to MARL
2022/09/20 by Zhang, Fengzhuo, Liu, Boyi, Wang, Kaixin +3 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Multiagent Systems (cs.MA)
- BanditSpec: Adaptive Speculative Decoding via Bandit Algorithms
2025/05/21 by Y. R. Hou, Fengzhuo Zhang, Hou, Yunlong +14 · 3 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #Artificial Intelligence (cs.AI) #Data Stream Mining Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification
2025/02/24 by Yang, Penghui, Du, Cunxiao, Zhang, Fengzhuo +4 · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)