Шун-ичи Амари
- Natural Gradient Works Efficiently in Learning
1998/02/01 by Shun-ichi Amari, Шун-ичи Амари · 130 citations
Computer Science · Biochemistry, Genetics and Molecular Biology · #Blind Source Separation Techniques #Neural Networks and Applications #Fractal and DNA sequence analysis
- Learning Patterns and Pattern Sequences by Self-Organizing Nets of Threshold Elements
1972/11/01 by S.-I. Amari, Шун-ичи Амари · 52 citations
Computer Science · #Neural Networks and Applications #Fuzzy Logic and Control Systems
- Interpolating between Optimal Transport and MMD using Sinkhorn Divergences
2018/10/18 by Jean Feydy, Thibault Séjourné, Feydy, Jean +9 · 38 citations
Physics and Astronomy · Computer Science · #Statistical Mechanics and Entropy #Adversarial Robustness in Machine Learning #Computational Drug Discovery Methods
- Universal Statistics of Fisher Information in Deep Neural Networks: Mean Field Approach
2018/06/04 by Ryo Karakida, Karakida, Ryo, Shotaro Akaho +3 · 12 citations
Computer Science · Physics and Astronomy · #Disordered Systems and Neural Networks (cond-mat.dis-nn) #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Neural Networks and Applications #Statistical Mechanics and Entropy
- Fisher Information and Natural Gradient Learning of Random Deep Networks
2018/08/22 by Шун-ичи Амари, Ryo Karakida, Amari, Shun-ichi +3 · 13 citations
Computer Science · Engineering · #Stochastic Gradient Optimization Techniques #Neural Networks and Applications #Sparse and Compressive Sensing Techniques
- Pathological spectra of the Fisher information metric and its variants in deep neural networks
2019/10/14 by Ryo Karakida, Shotaro Akaho, Karakida, Ryo +3 · 7 citations
Physics and Astronomy · Computer Science · #Statistical Mechanics and Entropy #Gaussian Processes and Bayesian Inference #stochastic dynamics and bifurcation
- The Normalization Method for Alleviating Pathological Sharpness in Wide Neural Networks
2019/06/07 by Ryo Karakida, Shotaro Akaho, Karakida, Ryo +3 · 4 citations
Computer Science · #Adversarial Robustness in Machine Learning #Disordered Systems and Neural Networks (cond-mat.dis-nn) #FOS: Computer and information sciences #FOS: Physical sciences #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Neural Networks and Applications #Stochastic Gradient Optimization Techniques
- When Does Preconditioning Help or Hurt Generalization?
2020/06/18 by Шун-ичи Амари, Amari, Shun-ichi, Jimmy Ba +13 · 4 citations
Computer Science · Engineering · #FOS: Computer and information sciences #Face and Expression Recognition #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Machine Learning and ELM #Sparse and Compressive Sensing Techniques
- Wasserstein Statistics in One-dimensional Location-Scale Model
2020/07/21 by Шун-ичи Амари, Takeru Matsuda, Amari, Shun-ichi +1 · 3 citations
Mathematics · #Morphological variations and asymmetry #Geometric Analysis and Curvature Flows #Point processes and geometric inequalities