Chen, Congliang
- Adam-mini: Use Fewer Learning Rates To Gain More
2024/06/24 by Yushun Zhang, Congliang Chen, Zhang, Yushun +14 · 22 citations
Computer Science · Engineering · #Advanced Adaptive Filtering Techniques #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Music and Audio Processing
- Why Transformers Need Adam: A Hessian Perspective
2024/02/26 by Yushun Zhang, Congliang Chen, Zhang, Yushun +9 · 17 citations
Physics and Astronomy · #Space Science and Extraterrestrial Life
- Preserving Diversity in Supervised Fine-Tuning of Large Language Models
2024/08/29 by Ziniu Li, Congliang Chen, Li, Ziniu +11 · 15 citations
Physics and Astronomy · #Artificial Intelligence (cs.AI) #FOS: Computer and information sciences #Machine Learning (cs.LG) #Magnetic confinement fusion research
- Arbitrary Style Transfer with Deep Feature Reshuffle
2018/05/10 by Shuyang Gu, Gu, Shuyang, Congliang Chen +5 · 5 citations
Computer Science · #Advanced Image Processing Techniques #Computer Vision and Pattern Recognition (cs.CV) #FOS: Computer and information sciences #Generative Adversarial Networks and Image Synthesis #Image Enhancement Techniques
- Adam Can Converge Without Any Modification On Update Rules
2022/08/20 by Yushun Zhang, Congliang Chen, Zhang, Yushun +7 · 6 citations
Computer Science · Mathematics · Physics and Astronomy · #Stochastic Gradient Optimization Techniques #Markov Chains and Monte Carlo Methods #Statistical Mechanics and Entropy
- Towards Practical Adam: Non-Convexity, Convergence Theory, and Mini-Batch Acceleration
2021/01/14 by Chen, Congliang, Shen, Li, Zou, Fangyu +1 · 3 citations
#Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Parallel #and Cluster Computing (cs.DC)
- Quantized Adam with Error Feedback
2020/04/29 by Congliang Chen, Chen, Congliang, Li Shen +5 · 2 citations
Computer Science · Engineering · #Advanced Memory and Neural Computing #Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Optimization and Control (math.OC) #Parallel #Stochastic Gradient Optimization Techniques #and Cluster Computing (cs.DC)
- Efficient-Adam: Communication-Efficient Distributed Adam
2022/05/28 by Chen, Congliang, Shen, Li, Liu, Wei +1 · 1 citation
#Distributed #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Optimization and Control (math.OC) #Parallel #and Cluster Computing (cs.DC)
- Rethinking Data Mixture for Large Language Models: A Comprehensive Survey and New Perspectives
2025/05/27 by Liu, Yajiao, Chen, Congliang, Yang, Junchi +1 · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences