Congliang Chen

1. Adam-mini: Use Fewer Learning Rates To Gain More
   2024/06/24 by Yushun Zhang, Zhang, Yushun, Congliang Chen +14 · 22 citations
   Computer Science · Engineering · #Advanced Adaptive Filtering Techniques #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Music and Audio Processing
2. Why Transformers Need Adam: A Hessian Perspective
   2024/02/26 by Yushun Zhang, Zhang, Yushun, Congliang Chen +9 · 16 citations
   Physics and Astronomy · #Space Science and Extraterrestrial Life
3. Preserving Diversity in Supervised Fine-Tuning of Large Language Models
   2024/08/29 by Ziniu Li, Congliang Chen, Li, Ziniu +11 · 15 citations
   Physics and Astronomy · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Magnetic confinement fusion research
4. Arbitrary Style Transfer with Deep Feature Reshuffle
   2018/05/10 by Shuyang Gu, Gu, Shuyang, Congliang Chen +5 · 5 citations
   Computer Science · #Advanced Image Processing Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Image Enhancement Techniques
5. Adam Can Converge Without Any Modification On Update Rules
   2022/08/20 by Yushun Zhang, Congliang Chen, Zhang, Yushun +7 · 6 citations
   Computer Science · Mathematics · Physics and Astronomy · #Stochastic Gradient Optimization Techniques #Markov Chains and Monte Carlo Methods #Statistical Mechanics and Entropy
6. Quantized Adam with Error Feedback
   2020/04/29 by Congliang Chen, Li Shen, Chen, Congliang +5 · 2 citations
   Computer Science · Engineering · #Advanced Memory and Neural Computing #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Optimization and Control (math.OC) #Parallel #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)