Liu, Kangqiao
- Strength of Minibatch Noise in SGD
2021/02/10 by Liu Ziyin, Ziyin, Liu, Kangqiao Liu +5 · 4 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Neural Networks and Applications #Stochastic Gradient Optimization Techniques
- Noise and Fluctuation of Finite Learning Rate Stochastic Gradient Descent
2020/12/07 by Kangqiao Liu, Liu Ziyin, Liu, Kangqiao +3 · 3 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Neural Networks and Applications #Stochastic Gradient Optimization Techniques
- Power-law escape rate of SGD
2021/05/20 by T. Mori, Liu Ziyin, Mori, Takashi +5 · 3 citations
Mathematics · Physics and Astronomy · #Disordered Systems and Neural Networks (cond-mat.dis-nn) #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Statistical Mechanics (cond-mat.stat-mech) #Statistical Mechanics and Entropy #Theoretical and Computational Physics