Chen, Lizhang
- Cautious Optimizers: Improving Training with One Line of Code
2024/11/25 by Kaizhao Liang, Liang, Kaizhao, Lizhang Chen +5 · 12 voices · 11 citations
#cs.LG #cs.AI #cs.CL #cs.CV #cs.DM
- DeMo: Decoupled Momentum Optimization
2024/11/29 by Bowen Peng, Peng, Bowen, Lizhang Chen +9 · 6 voices · 2 citations
Computer Science · #Robotic Path Planning Algorithms
- Muon Optimizes Under Spectral Norm Constraints
2025/06/18 by Chen, Lizhang, Li, Jonathan, Liu, Qiang · 14 citations
#FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- Lion Secretly Solves Constrained Optimization: As Lyapunov Predicts
2023/10/09 by Chen, Lizhang, Liu, Bo, Liang, Kaizhao +1 · 4 citations
#Applications (stat.AP) #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- Memory-Efficient LLM Training with Online Subspace Descent
2024/08/23 by Liang, Kaizhao, Liu, Bo, Chen, Lizhang +1 · 5 citations
#Artificial Intelligence (cs.AI) #Computation and Language (cs.CL) #FOS: Computer and information sciences #Machine Learning (cs.LG)
- Communication Efficient Distributed Training with Distributed Lion
2024/03/30 by Bo Liu, Lemeng Wu, Liu, Bo +13 · 2 citations
Engineering · #Robotics and Automated Systems
- WoW: Towards a World omniscient World model Through Embodied Interaction
2025/09/26 by Chi, Xiaowei, Jia, Peidong, Fan, Chun-Kai +33 · 9 citations
#Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Multimedia (cs.MM) #Robotics (cs.RO)
- Cautious Weight Decay
2025/10/14 by Lizhang Chen, Chen, Lizhang, Jonathan Li +15 · 1 voice · 1 citation
#cs.LG #math.OC #stat.ML
- Improving Adaptive Moment Optimization via Preconditioner Diagonalization
2025/02/11 by Nguyen, Son, Liu, Bo, Chen, Lizhang +1 · 1 citation
#FOS: Computer and information sciences #Machine Learning (cs.LG)