Liang, Yingbin
- Bilevel Optimization: Convergence Analysis and Enhanced Design
2020/10/15 by Ji, Kaiyi, Yang, Junjie, Liang, Yingbin · 23 citations
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- Finite-Sample Analysis for SARSA with Linear Function Approximation
2019/02/06 by Shaofeng Zou, Zou, Shaofeng, Tengyu Xu +3 · 11 citations
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Search Problems #Reinforcement Learning in Robotics
- CRPO: A New Approach for Safe Reinforcement Learning with Convergence Guarantee
2020/11/11 by Xu, Tengyu, Liang, Yingbin, Lan, Guanghui · 10 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Provably Faster Algorithms for Bilevel Optimization
2021/06/08 by Yang, Junjie, Ji, Kaiyi, Liang, Yingbin · 10 citations
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- In-Context Convergence of Transformers
2023/10/08 by Huang, Yu, Yuan Cheng, Yingbin Liang +2 · 15 citations
Computer Science · #Advanced Neural Network Applications #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
- Generalized-Smooth Nonconvex Optimization is As Efficient As Smooth Nonconvex Optimization
2023/03/06 by Ziyi Chen, Chen, Ziyi, Yi Zhou +5 · 11 citations
Computer Science · Engineering · #FOS: Mathematics #Machine Learning and ELM #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- Improved Zeroth-Order Variance Reduced Algorithms and Analysis for Nonconvex Optimization
2019/10/26 by Kaiyi Ji, Ji, Kaiyi, Zhe Wang +5 · 5 citations
Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Sparse and Compressive Sensing Techniques #Machine Learning and ELM
- On the Convergence Theory for Hessian-Free Bilevel Algorithms
2021/10/13 by Sow, Daouda, Ji, Kaiyi, Liang, Yingbin · 6 citations
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- Convergence of Meta-Learning with Task-Specific Adaptation over Partial Parameters
2020/06/16 by Kaiyi Ji, Ji, Kaiyi, Jason D. Lee +5 · 6 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Machine Learning and ELM #Optimization and Control (math.OC)
- Non-asymptotic Convergence Analysis of Two Time-scale (Natural) Actor-Critic Algorithms
2020/05/07 by Tengyu Xu, Xu, Tengyu, Zhe Wang +3 · 7 citations
Computer Science · Decision Sciences · #Adaptive Dynamic Programming Control #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics
- Convergence Analysis of Proximal Gradient with Momentum for Nonconvex Optimization
2017/05/14 by Li, Qunwei, Zhou, Yi, Liang, Yingbin +1 · 4 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Theory on Mixture-of-Experts in Continual Learning
2024/06/24 by Li, Hongbo, Lin, Sen, Duan, Lingjie +2 · 11 citations
#Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- In-Context Learning with Representations: Contextual Generalization of Trained Transformers
2024/08/19 by Tong Yang, Yang, Tong, Huang, Yu +4 · 11 citations
Computer Science · #Computation and Language (cs.CL) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Mathematics #Human Pose and Action Recognition #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Optimization and Control (math.OC)
- Theory on Forgetting and Generalization of Continual Learning
2023/02/12 by Sen Lin, Lin, Sen, Peizhong Ju +5 · 5 citations
Computer Science · #Domain Adaptation and Few-Shot Learning #Multimodal Machine Learning Applications
- Secure Communication over Fading Channels
2007/01/04 by Yingbin Liang, H. Vincent Poor, Liang, Yingbin +2 · 2 citations
Engineering · Computer Science · #Wireless Communication Security Techniques #Chaos-based Image/Signal Encryption #Advanced Authentication Protocols Security
- Distributed Proximal Gradient Algorithm for Partially Asynchronous\n Computer Clusters
2017/04/11 by Yi Zhou, Zhou, Yi, Yaoliang Yu +7 · 2 citations
Computer Science · Engineering · #Complexity and Algorithms in Graphs #FOS: Mathematics #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- Stochastic Variance-Reduced Cubic Regularization for Nonconvex Optimization
2018/02/20 by Zhe Wang, Yi Zhou, Wang, Zhe +5 · 2 citations
Computer Science · Engineering · Mathematics · #Advanced Optimization Algorithms Research #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- SGD Converges to Global Minimum in Deep Learning via Star-convex Path
2019/01/02 by Zhou, Yi, Yang, Junjie, Zhang, Huishuai +2 · 2 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Two Time-scale Off-Policy TD Learning: Non-asymptotic Analysis over Markovian Samples
2019/09/26 by Xu, Tengyu, Zou, Shaofeng, Liang, Yingbin · 2 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Reanalysis of Variance Reduced Temporal Difference Learning
2020/01/07 by Xu, Tengyu, Wang, Zhe, Zhou, Yi +1 · 2 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Non-asymptotic Convergence of Adam-type Reinforcement Learning Algorithms under Markovian Sampling
2020/02/15 by Xiong, Huaqing, Xu, Tengyu, Liang, Yingbin +1 · 2 citations
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- Lower Bounds and Accelerated Algorithms for Bilevel Optimization
2021/02/07 by Kaiyi Ji, Ji, Kaiyi, Yingbin Liang +1 · 4 citations
Computer Science · Engineering · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- Rate Regions for Relay Broadcast Channels
2006/06/15 by Yingbin Liang, Liang, Yingbin, Gerhard Kramer +1 · 1 citation
Computer Science · Engineering · #Cooperative Communication and Network Coding #Advanced MIMO Systems Optimization #Advanced Wireless Communication Technologies
- Dynamic Loss-Based Sample Reweighting for Improved Large Language Model Pretraining
2025/02/10 by Daouda Sow, Sow, Daouda, Herbert Woisetschläger +9 · 6 citations
Computer Science · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Natural Language Processing Techniques #Speech Recognition and Synthesis #Text and Document Classification Technologies
- Training Dynamics of Transformers to Recognize Word Co-occurrence via Gradient Flow Analysis
2024/10/12 by Hongru Yang, Yang, Hongru, Bhavya Kailkhura +5 · 4 citations
Computer Science · #Image Processing and 3D Reconstruction #Natural Language Processing Techniques #Speech Recognition and Synthesis
- An Information Theoretic Approach to Secret Sharing
2014/04/25 by Zou, Shaofeng, Liang, Yingbin, Lai, Lifeng +1 · 1 citation
#FOS: Computer and information sciences #Information Theory (cs.IT)
- Proximal Gradient Descent-Ascent: Variable Convergence under KŁ Geometry
2021/02/09 by Ziyi Chen, Yi Zhou, Chen, Ziyi +5 · 2 citations
Engineering · Computer Science · #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #Optimization and Variational Analysis
- Reshaped Wirtinger Flow and Incremental Algorithm for Solving Quadratic System of Equations
2016/05/25 by Zhang, Huishuai, Zhou, Yi, Liang, Yingbin +1 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Estimation of KL Divergence: Optimal Minimax Rate
2016/07/09 by Bu, Yuheng, Zou, Shaofeng, Liang, Yingbin +1 · 1 citation
#FOS: Computer and information sciences #Information Theory (cs.IT)
- A Theoretical Analysis of Self-Supervised Learning for Vision Transformers
2024/03/04 by Huang, Yu, Wen, Zixin, Chi, Yuejie +1 · 3 citations
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- Characterization of Gradient Dominance and Regularity Conditions for Neural Networks
2017/10/18 by Zhou, Yi, Liang, Yingbin · 1 citation
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- Guaranteed Recovery of One-Hidden-Layer Neural Networks via Cross Entropy
2018/02/18 by Haoyu Fu, Yuejie Chi, Fu, Haoyu +3 · 1 citation
Computer Science · #Advanced Neural Network Applications #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Stochastic Gradient Optimization Techniques
- A Note on Inexact Condition for Cubic Regularized Newton's Method
2018/08/22 by Wang, Zhe, Zhou, Yi, Liang, Yingbin +1 · 1 citation
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- Take the Bull by the Horns: Hard Sample-Reweighted Continual Training Improves LLM Generalization
2024/02/22 by Xuxi Chen, Chen, Xuxi, Zhendong Wang +13 · 2 citations
Computer Science · Medicine · #Artificial Intelligence in Healthcare and Education #COVID-19 diagnosis using AI #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification
- Gradient Free Minimax Optimization: Variance Reduction and Faster Convergence
2020/06/16 by Xu, Tengyu, Wang, Zhe, Liang, Yingbin +1 · 1 citation
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- Sample Complexity Bounds for Two Timescale Value-based Reinforcement Learning Algorithms
2020/11/10 by Tengyu Xu, Yingbin Liang, Xu, Tengyu +1 · 1 citation
Computer Science · Decision Sciences · Engineering · #Adaptive Dynamic Programming Control #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics #Traffic control and management
- Doubly Robust Off-Policy Actor-Critic: Convergence and Optimality
2021/02/23 by Tengyu Xu, Zhuoran Yang, Xu, Tengyu +5 · 1 citation
Computer Science · #Adaptive Dynamic Programming Control #Adversarial Robustness in Machine Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics
- Absorb and Converge: Provable Convergence Guarantee for Absorbing Discrete Diffusion Models
2025/06/02 by Yuchen Liang, Liang, Yuchen, Lifeng Lai +6 · 6 citations
Computer Science · Engineering · #Advanced Mathematical Modeling in Engineering #Advanced Numerical Methods in Computational Mathematics #FOS: Computer and information sciences #FOS: Electrical engineering #FOS: Mathematics #Machine Learning (cs.LG) #Signal Processing (eess.SP) #Statistics Theory (math.ST) #electronic engineering #information engineering
- Faster Algorithm and Sharper Analysis for Constrained Markov Decision Process
2021/10/20 by Li, Tianjiao, Guan, Ziwei, Zou, Shaofeng +3 · 1 citation
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC)
- Model-Based Offline Meta-Reinforcement Learning with Regularization
2022/02/07 by Lin, Sen, Wan, Jialin, Xu, Tengyu +2 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- A Primal-Dual Approach to Bilevel Optimization with Multiple Inner Minima
2022/03/01 by Daouda Sow, Sow, Daouda, Kaiyi Ji +5 · 2 citations
Computer Science · Engineering · #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Optimization and Control (math.OC) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
- Provable Benefit of Multitask Representation Learning in Reinforcement Learning
2022/06/13 by Cheng, Yuan, Feng, Songtao, Yang, Jing +2 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Will Bilevel Optimizers Benefit from Loops
2022/05/27 by Ji, Kaiyi, Liu, Mingrui, Liang, Yingbin +1 · 1 citation
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- M-L2O: Towards Generalizable Learning-to-Optimize by Test-Time Fast Self-Adaptation
2023/02/28 by Junjie Yang, Yang, Junjie, Xuxi Chen +7 · 1 citation
Computer Science · Decision Sciences · #Advanced Bandit Algorithms Research #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Data Classification #Metaheuristic Optimization Algorithms Research
- Provably Efficient Offline Reinforcement Learning with Trajectory-Wise Reward
2022/06/13 by Tengyu Xu, Yue Wang, Xu, Tengyu +5 · 1 citation
Computer Science · Engineering · #Adversarial Robustness in Machine Learning #Autonomous Vehicle Technology and Safety #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics
- Provable Generalization of Overparameterized Meta-learning Trained with SGD
2022/06/18 by Huang, Yu, Liang, Yingbin, Huang, Longbo · 1 citation
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Statistics Theory (math.ST)
- Sparse Mixture-of-Experts for Compositional Generalization: Empirical Evidence and Theoretical Foundations of Optimal Sparsity
2024/10/17 by Jinze Zhao, Zhao, Jinze, Wang, Peihao +7 · 2 citations
Computer Science · #Expert finding and Q&A systems
- Learning to Generalize Provably in Learning to Optimize
2023/02/22 by Yang, Junjie, Chen, Tianlong, Zhu, Mingkang +4 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Theoretical Characterization of the Generalization Performance of Overfitted Meta-Learning
2023/04/09 by Ju, Peizhong, Liang, Yingbin, Shroff, Ness B. · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG)
- Near-Optimal Partially Observable Reinforcement Learning with Partial Online State Information
2023/06/14 by Ming Shi, Yingbin Liang, Shi, Ming +3 · 1 citation
Computer Science · Engineering · Materials Science · #Advancements in Photolithography Techniques #Artificial Intelligence (cs.AI) #Copper Interconnects and Reliability #FOS: Computer and information sciences #Machine Learning (cs.LG) #VLSI and Analog Circuit Testing
- Generalization Performance of Transfer Learning: Overparameterized and Underparameterized Regimes
2023/06/08 by Peizhong Ju, Ju, Peizhong, Sen Lin +7 · 1 citation
Computer Science · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning and Data Classification #Machine Learning and ELM
- Object Detection for Medical Image Analysis: Insights from the RT-DETR Model
2025/01/27 by Weijie He, Yuwei Zhang, He, Weijie +9 · 2 citations
Neuroscience · #Brain Tumor Detection and Classification
- Improving Sample Efficiency of Model-Free Algorithms for Zero-Sum Markov Games
2023/08/17 by Songtao Feng, Ming Yin, Feng, Songtao +7 · 1 citation
Computer Science · Decision Sciences · #Artificial Intelligence (cs.AI) #Computer Science and Game Theory (cs.GT) #FOS: Computer and information sciences #Game Theory and Applications #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reinforcement Learning in Robotics
- How Transformers Learn Regular Language Recognition: A Theoretical Study on Training Dynamics and Implicit Bias
2025/05/02 by Huang, Ruiquan, Liang, Yingbin, Yang, Jing · 3 citations
#Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Rethinking PGD Attack: Is Sign Function Necessary?
2023/12/03 by Junjie Yang, Tianlong Chen, Yang, Junjie +7 · 1 citation
Computer Science · #Adversarial Robustness in Machine Learning #Advanced Neural Network Applications #Domain Adaptation and Few-Shot Learning
- Sample Complexity Characterization for Linear Contextual MDPs
2024/02/05 by Deng, Junze, Cheng, Yuan, Zou, Shaofeng +1 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Broadening Target Distributions for Accelerated Diffusion Models via a Novel Analysis Approach
2024/02/21 by Liang, Yuchen, Ju, Peizhong, Liang, Yingbin +1 · 1 citation
#FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Signal Processing (eess.SP) #electronic engineering #information engineering
- A comparative study of generative adversarial networks for image recognition algorithms based on deep learning and traditional methods
2024/08/07 by Yihao Zhong, Zhong, Yihao, Yijing Wei +9 · 1 citation
Computer Science · Neuroscience · #Anomaly Detection Techniques and Applications #Image and Signal Denoising Methods #Brain Tumor Detection and Classification
- Dynamic Fraud Detection: Integrating Reinforcement Learning into Graph Neural Networks
2024/09/15 by Yuxin Dong, Jianhua Yao, Dong, Yuxin +9 · 1 citation
Computer Science · #FOS: Computer and information sciences #Imbalanced Data Classification Techniques #Machine Learning (cs.LG) #Social and Information Networks (cs.SI)
- Multi-head Transformers Provably Learn Symbolic Multi-step Reasoning via Gradient Descent
2025/08/11 by Tong Yang, Yang, Tong, Huang, Yu +4 · 4 citations
Computer Science · Psychology · #Artificial Intelligence (cs.AI) #Child and Animal Learning Development #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Mathematics #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC) #Reinforcement Learning in Robotics
- Theory on Score-Mismatched Diffusion Models and Zero-Shot Conditional Samplers
2024/10/17 by Yuchen Liang, Peizhong Ju, Liang, Yuchen +5 · 2 citations
Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Statistical Methods and Inference
- Data Sampling Affects the Complexity of Online SGD over Dependent Data
2022/03/31 by Shaocong Ma, Ziyi Chen, Ma, Shaocong +7 · 1 citation
Computer Science · Mathematics · #Stochastic Gradient Optimization Techniques #Privacy-Preserving Technologies in Data #Markov Chains and Monte Carlo Methods
- Non-asymptotic Convergence of Training Transformers for Next-token Prediction
2024/09/25 by Ruiquan Huang, Huang, Ruiquan, Yingbin Liang +3 · 1 citation
Computer Science · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Speech Recognition and Synthesis #Topic Modeling
- Optimizing YOLOv5s Object Detection through Knowledge Distillation algorithm
2024/10/16 by Guanming Huang, Huang, Guanming, Aoran Shen +9 · 1 citation
Engineering · #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Industrial Vision Systems and Defect Detection #Machine Learning (cs.LG)