Kunin, Daniel
- From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks
2024/09/22 by Clémentine C. J. Dominé, Clémentine Dominé, Nicolas Anguita +13 · 1 voice · 15 citations
Computer Science · #Neural Networks and Applications
- Get rich quick: exact solutions reveal how unbalanced initializations promote rapid feature learning
2024/06/10 by Daniel Kunin, Allan Raventós, Kunin, Daniel +11 · 4 voices · 6 citations
Computer Science · #Machine Learning and Data Classification
- Neural Mechanics: Symmetry and Broken Conservation Laws in Deep Learning\n Dynamics
2020/12/08 by Daniel Kunin, Kunin, Daniel, Javier Sagastuy-Breña +7 · 10 citations
Computer Science · #Stochastic Gradient Optimization Techniques #Adversarial Robustness in Machine Learning #Generative Adversarial Networks and Image Synthesis
- Loss Landscapes of Regularized Linear Autoencoders
2019/01/23 by Kunin, Daniel, Bloom, Jonathan M., Goeva, Aleksandrina +1 · 4 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)
- Stochastic Collapse: How Gradient Noise Attracts SGD Dynamics Towards Simpler Subnetworks
2023/06/07 by Feng Chen, Chen, Feng, Daniel Kunin +5 · 7 citations
Computer Science · #Artificial Intelligence (cs.AI) #Domain Adaptation and Few-Shot Learning #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications #Stochastic Gradient Optimization Techniques
- Two Routes to Scalable Credit Assignment without Weight Symmetry
2020/02/28 by Daniel Kunin, Kunin, Daniel, Aran Nayebi +9 · 3 citations
Computer Science · Engineering · #Advanced Memory and Neural Computing #Domain Adaptation and Few-Shot Learning #FOS: Biological sciences #FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Neural and Evolutionary Computing (cs.NE) #Neurons and Cognition (q-bio.NC)
- Beyond the Quadratic Approximation: the Multiscale Structure of Neural Network Loss Landscapes
2022/04/24 by Chao Ma, Daniel Kunin, Ma, Chao +5 · 2 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · Physics and Astronomy · #Advanced Mathematical Modeling in Engineering #Advanced Electron Microscopy Techniques and Applications #Model Reduction and Neural Networks
- Alternating Gradient Flows: A Theory of Feature Learning in Two-layer Neural Networks
2025/06/06 by Kunin, Daniel, Marchetti, Giovanni Luca, Chen, Feng +5 · 2 citations
#FOS: Computer and information sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML)