Li, Yingcong
- Transformers as Support Vector Machines
2023/08/31 by Davoud Ataee Tarzanagh, Yingcong Li, Tarzanagh, Davoud Ataee +5 · 5 voices · 5 citations
Computer Science · #Topic Modeling #Domain Adaptation and Few-Shot Learning #Machine Learning and Data Classification
- Mechanics of Next Token Prediction with Self-Attention
2024/03/12 by Yingcong Li, Li, Yingcong, Yixiao Huang +7 · 2 voices · 5 citations
Engineering · #Metallurgy and Material Forming #Robotic Mechanisms and Dynamics
- Transformers as Algorithms: Generalization and Stability in In-context Learning
2023/01/17 by Yingcong Li, M. Emrullah Ildiz, Li, Yingcong +5 · 25 citations
Computer Science · #Machine Learning and Algorithms #Gaussian Processes and Bayesian Inference #Machine Learning and Data Classification
- Provable Benefits of Overparameterization in Model Compression: From Double Descent to Pruning Neural Networks
2020/12/16 by Chang, Xiangyu, Li, Yingcong, Oymak, Samet +1 · 4 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- From Self-Attention to Markov Models: Unveiling the Dynamics of Generative Transformers
2024/02/21 by M. Emrullah Ildiz, Ildiz, M. Emrullah, Yixiao Huang +7 · 7 citations
Computer Science · #Reinforcement Learning in Robotics
- Fine-grained Analysis of In-context Linear Estimation: Data, Architecture, and Beyond
2024/07/13 by Yingcong Li, Li, Yingcong, Ankit Singh Rawat +3 · 7 citations
Computer Science · #Anomaly Detection Techniques and Applications #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- Provable and Efficient Continual Representation Learning
2022/03/03 by Li, Yingcong, Li, Mingchen, Asif, M. Salman +1 · 3 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- BREAD: Branched Rollouts from Expert Anchors Bridge SFT & RL for Reasoning
2025/06/20 by Zhang, Xuechen, Huang, Zijian, Li, Yingcong +3 · 11 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Max-Margin Token Selection in Attention Mechanism
2023/06/23 by Davoud Ataee Tarzanagh, Yingcong Li, Tarzanagh, Davoud Ataee +5 · 3 citations
Computer Science · #Topic Modeling #Domain Adaptation and Few-Shot Learning #Advanced Neural Network Applications
- Dissecting Chain-of-Thought: Compositionality through In-Context Filtering and Learning
2023/05/30 by Li, Yingcong, Sreenivasan, Kartik, Giannou, Angeliki +2 · 1 citation
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Provable Benefits of Task-Specific Prompts for In-context Learning
2025/03/03 by Chang, Xiangyu, Li, Yingcong, Kara, Muti +2 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences
- Gating is Weighting: Understanding Gated Linear Attention through In-context Learning
2025/04/06 by Li, Yingcong, Tarzanagh, Davoud Ataee, Rawat, Ankit Singh +2 · 2 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- When and How Unlabeled Data Provably Improve In-Context Learning
2025/06/18 by Yingcong Li, Xiangyu Chang, Li, Yingcong +8 · 2 citations
Computer Science · #Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning and Algorithms #Machine Learning and Data Classification #Optimization and Control (math.OC)