Sun, Yutao
- Retentive Network: A Successor to Transformer for Large Language Models
2023/07/17 by Yutao Sun, Li Dong, Sun, Yutao +13 · 8 voices · 102 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Multimodal Machine Learning Applications
- Why Can GPT Learn In-Context? Language Models Implicitly Perform Gradient Descent as Meta-Optimizers
2022/12/20 by Damai Dai, Yutao Sun, Dai, Damai +12 · 4 voices · 49 citations
Computer Science · #Topic Modeling #Machine Learning and Data Classification #Advanced Neural Network Applications
- Reinforcement Pre-Training
2025/06/09 by Qingxiu Dong, Quennie Dong, Li Dong +13 · 5 voices · 12 citations
Computer Science · #Topic Modeling #Natural Language Processing Techniques #Text Readability and Simplification
- You Only Cache Once: Decoder-Decoder Architectures for Language Models
2024/05/08 by Yutao Sun, Li Dong, Sun, Yutao +15 · 2 voices · 20 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #cs.CL
- Differential Transformer
2024/10/07 by Tianzhu Ye, Li Dong, Ye, Tianzhu +11 · 7 voices
#cs.CL #cs.LG
- A Length-Extrapolatable Transformer
2022/12/20 by Yutao Sun, Dong Li, Sun, Yutao +14 · 12 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech Recognition and Synthesis
- Structured Prompting: Scaling In-Context Learning to 1,000 Examples
2022/12/13 by Yaru Hao, Hao, Yaru, Yutao Sun +9 · 6 citations
Computer Science · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Multimodal Machine Learning Applications #Natural Language Processing Techniques #Topic Modeling
- Multimodal Latent Language Modeling with Next-Token Diffusion
2024/12/11 by Yutao Sun, Hangbo Bao, Sun, Yutao +13 · 9 citations
Computer Science · #Natural Language Processing Techniques #Topic Modeling #Speech and dialogue systems
- SeerAttention-R: Sparse Attention Adaptation for Long Reasoning
2025/06/10 by Gao, Yizhao, Shuming Guo, Guo, Shuming +24 · 10 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Multimodal Machine Learning Applications
- Prototypical Calibration for Few-shot Learning of Language Models
2022/05/20 by Han, Zhixiong, Hao, Yaru, Dong, Li +2 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences
- The Self-Improvement Paradox: Can Language Models Bootstrap Reasoning Capabilities without External Scaffolding?
2025/02/19 by Sun, Yutao, Chen, Mingshuai, Zhao, Tiancheng +3 · 4 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- VibeVoice Technical Report
2025/08/26 by Peng, Zhiliang, Yu, Jianwei, Wang, Wenhui +10 · 12 citations
#Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering
- Efficient Attention Mechanisms for Large Language Models: A Survey
2025/07/25 by Sun, Yutao, Li, Zhenyu, Zhang, Yike +4 · 7 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Rectified Sparse Attention
2025/06/04 by Sun, Yutao, Ye, Tianzhu, Dong, Li +6 · 2 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences