Liu Ziyin
- Neural Networks Fail to Learn Periodic Functions and How to Fix It
2020/06/15 by Liu Ziyin, Tilman Hartwig, Ziyin, Liu +3 · 42 citations
Computer Science · Decision Sciences · Mathematics · Physics and Astronomy · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Model Reduction and Neural Networks #Neural Networks and Applications #Stock Market Forecasting Methods #cs.LG #stat.ML
- Think Locally, Act Globally: Federated Learning with Local and Global Representations
2020/01/06 by Paul Pu Liang, Liang, Paul Pu, Terrance Liu +15 · 29 citations
Computer Science · Mathematics · Social Sciences · #Distributed #FOS: Computer and information sciences #Human Mobility and Location-Based Analysis #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Parallel #Privacy, Security, and Data Protection #Privacy-Preserving Technologies in Data #and Cluster Computing (cs.DC) #cs.DC #cs.LG #stat.ML
- Deep Gamblers: Learning to Abstain with Portfolio Theory
2019/06/29 by Liu Ziyin, Zhikang Wang, Ziyin, Liu +10 · 11 citations
Computer Science · Economics, Econometrics and Finance · Engineering · Mathematics · #FOS: Computer and information sciences #Financial Markets and Investment Strategies #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Reservoir Engineering and Simulation Methods #Sports Analytics and Performance #cs.LG #stat.ML
- Strength of Minibatch Noise in SGD
2021/02/10 by Liu Ziyin, Kangqiao Liu, Ziyin, Liu +6 · 6 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Neural Networks and Applications #Stochastic Gradient Optimization Techniques #cs.LG #stat.ML
- Noise and Fluctuation of Finite Learning Rate Stochastic Gradient Descent
2020/12/07 by Kangqiao Liu, Liu Ziyin, Liu, Kangqiao +3 · 6 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Neural Networks and Applications #Stochastic Gradient Optimization Techniques #cs.LG #stat.ML
- Symmetry Induces Structure and Constraint of Learning
2023/09/29 by Liu Ziyin, Ziyin, Liu · 1 voice · 10 citations
Computer Science · Materials Science · Mathematics · #Machine Learning in Materials Science #Medical Image Segmentation Techniques #Neural Networks and Applications #cs.LG #stat.ML
- LaProp: Separating Momentum and Adaptivity in Adam
2020/02/12 by Liu Ziyin, Ziyin, Liu, Zhikang T. Wang +3 · 4 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.LG #stat.ML
- Understanding the Emergence of Multimodal Representation Alignment
2025/02/22 by Megan Tjandrasuwita, Chanakya Ekbote, Tjandrasuwita, Megan +5 · 1 voice · 14 citations
Computer Science · Psychology · #Language, Metaphor, and Cognition #cs.AI #cs.LG
- Power-law escape rate of SGD
2021/05/20 by T. Mori, Takashi Mori, Mori, Takashi +6 · 4 citations
Computer Science · Mathematics · Physics and Astronomy · #Disordered Systems and Neural Networks (cond-mat.dis-nn) #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Statistical Mechanics (cond-mat.stat-mech) #Statistical Mechanics and Entropy #Theoretical and Computational Physics #cond-mat.dis-nn #cond-mat.stat-mech #cs.LG #stat.ML
- On the Stepwise Nature of Self-Supervised Learning
2023/03/27 by James B. Simon, Maksis Knutins, Simon, James B. +9 · 6 citations
Computer Science · Physics and Astronomy · #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Model Reduction and Neural Networks #Neural Networks and Applications
- Machine Learning Decoding of Circuit-Level Noise for Bivariate Bicycle Codes
2025/04/17 by John Blue, Harshil Avlani, Blue, John +7 · 12 citations
Computer Science · Engineering · #FOS: Physical sciences #Quantum Physics (quant-ph)
- Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent
2024/02/11 by Liu Ziyin, Mingze Wang, Ziyin, Liu +4 · 7 citations
Physics and Astronomy · #Advanced Thermodynamics and Statistical Mechanics #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Optimization and Control (math.OC)
- Universal Thermodynamic Uncertainty Relation in Non-Equilibrium Dynamics
2022/02/27 by Liu Ziyin, Ziyin, Liu, Masahito Ueda +1 · 3 citations
Economics, Econometrics and Finance · Physics and Astronomy · #Advanced Thermodynamics and Statistical Mechanics #Economic theories and models #FOS: Physical sciences #Statistical Mechanics (cond-mat.stat-mech) #Statistical Mechanics and Entropy
- An Investigation of how Label Smoothing Affects Generalization
2020/10/23 by Blair Chen, Liu Ziyin, Chen, Blair +5 · 2 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #cs.LG #stat.ML
- spred: Solving L1 Penalty with SGD
2022/10/03 by Liu Ziyin, Zihao Wang, Ziyin, Liu +1 · 2 citations
Computer Science · Engineering · Mathematics · #Domain Adaptation and Few-Shot Learning #Sparse and Compressive Sensing Techniques #Statistical Methods and Inference
- What shapes the loss landscape of self-supervised learning?
2022/10/02 by Liu Ziyin, Ziyin, Liu, Ekdeep Singh Lubana +5 · 2 citations
Computer Science · #Data Analysis #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #FOS: Physical sciences #Imbalanced Data Classification Techniques #Machine Learning (cs.LG) #Machine Learning and Data Classification #Statistics and Probability (physics.data-an)
- Formation of Representations in Neural Networks
2024/10/03 by Liu Ziyin, Isaac L. Chuang, Ziyin, Liu +5 · 6 citations
Computer Science · #Disordered Systems and Neural Networks (cond-mat.dis-nn) #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Neural Networks and Applications
- Parameter Symmetry Potentially Unifies Deep Learning Theory
2025/02/07 by Liu Ziyin, Ziyin, Liu, Yizhou Xu +5 · 5 citations
Computer Science · #Neural Networks and Applications
- Learning Not to Learn in the Presence of Noisy Labels
2020/02/16 by Liu Ziyin, Ziyin, Liu, Blair Chen +12 · 4 citations
Computer Science · Mathematics · #FOS: Computer and information sciences #Information Theory (cs.IT) #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and Algorithms #Machine Learning and Data Classification #Text and Document Classification Technologies #cs.IT #cs.LG #math.IT #stat.ML
- Remove Symmetries to Control Model Expressivity and Improve Optimization
2024/08/28 by Liu Ziyin, Yizhou Xu, Ziyin, Liu +4 · 1 voice · 3 citations
Computer Science · Mathematics · #Artificial intelligence #Biology #Computer science #Control (management) #Expressivity #Genetics #Geometry #Homogeneous space #Mathematics #Neural Networks and Applications #cs.AI #cs.LG #stat.ML
- SGD with a Constant Large Learning Rate Can Converge to Local Maxima
2021/07/25 by Liu Ziyin, Ziyin, Liu, Botao Li +5 · 1 citation
Computer Science · Mathematics · #Advanced Neural Network Applications #FOS: Computer and information sciences #FOS: Mathematics #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Markov Chains and Monte Carlo Methods #Optimization and Control (math.OC) #Stochastic Gradient Optimization Techniques
- Posterior Collapse of a Linear Latent Variable Model
2022/05/09 by Zihao Wang, Liu Ziyin, Wang, Zihao +1 · 1 citation
Computer Science · #Bayesian Methods and Mixture Models #FOS: Computer and information sciences #Gaussian Processes and Bayesian Inference #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Self-Assembly of a Biologically Plausible Learning Circuit
2024/12/28 by Qianli Liao, Liu Ziyin, Liao, Qianli +8 · 4 citations
Engineering · Biochemistry, Genetics and Molecular Biology · #Modular Robots and Swarm Intelligence #Electrowetting and Microfluidic Technologies #DNA and Biological Computing
- Type-II Saddles and Probabilistic Stability of Stochastic Gradient Descent
2023/03/23 by Liu Ziyin, Ziyin, Liu, Botao Li +5 · 1 citation
Computer Science · Materials Science · Physics and Astronomy · #Data Analysis #FOS: Computer and information sciences #FOS: Mathematics #FOS: Physical sciences #Machine Learning (cs.LG) #Machine Learning in Materials Science #Model Reduction and Neural Networks #Optimization and Control (math.OC) #Statistics and Probability (physics.data-an) #Stochastic Gradient Optimization Techniques
- Proof of a perfect platonic representation hypothesis
2025/07/01 by Liu Ziyin, Ziyin, Liu, Isaac L. Chuang +1 · 3 citations
Computer Science · Physics and Astronomy · #Disordered Systems and Neural Networks (cond-mat.dis-nn) #FOS: Biological sciences #FOS: Computer and information sciences #FOS: Physical sciences #Generative Adversarial Networks and Image Synthesis #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neurons and Cognition (q-bio.NC) #Statistical Mechanics and Entropy #Stochastic Gradient Optimization Techniques
- Neural Thermodynamics: Entropic Forces in Deep and Universal Representation Learning
2025/05/18 by Liu Ziyin, Ziyin, Liu, Yizhou Xu +3 · 1 voice · 3 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · Mathematics · Physics and Astronomy · #cs.LG #cond-mat.dis-nn #cond-mat.stat-mech #math-ph #q-bio.NC #stat.ML
- Compositional Generalization via Forced Rendering of Disentangled Latents
2025/01/30 by Qiyao Liang, Liang, Qiyao, Liu Ziyin +4 · 3 citations
Computer Science · Chemistry · #Geochemistry and Geologic Mapping #History and advancements in chemistry #Computational Drug Discovery Methods