- Structure-Preserving Physics-Informed Neural Network for the Korteweg--de Vries (KdV) Equation
2025/11/01 by Victory Obieke, Emmanuel Oguadimma, Obieke, Victory +1 · 3 citations
Computer Science · Mathematics · Physics and Astronomy · #Artificial neural network #Backpropagation #Hamiltonian (control theory) #Initialization #Korteweg–de Vries equation #Model Reduction and Neural Networks #Neural Networks and Reservoir Computing #Nonlinear system #Ordinary differential equation #Partial differential equation #Quantum many-body systems #Regularization (linguistics) #cs.LG #math-ph #math.MP #nlin.PS #physics.flu-dyn
- Training of Physical Neural Networks
2024/06/05 by Ali Momeni, Babak Rahmani, Momeni, Ali +55 · 4 voices · 42 citations
Computer Science · Materials Science · Physics and Astronomy · #Artificial intelligence #Artificial neural network #Backpropagation #Computer science #Data science #Inference #Leverage (statistics) #Machine Learning in Materials Science #Machine learning #Neural Networks and Applications #Scale (ratio) #cs.LG #physics.app-ph
- Gradients without Backpropagation
2022/02/17 by Atılım Güneş Baydin, Barak A. Pearlmutter, Baydin, Atılım Güneş +7 · 3 voices · 17 citations
Computer Science · Engineering · Mathematics · #Algorithm #Artificial intelligence #Artificial neural network #Automatic differentiation #Backpropagation #Computation #Computer science #Descent direction #Directional derivative #Engineering #Gradient descent #Gradient method #Machine Learning and Algorithms #Machine Learning and ELM #Mathematical analysis #Mathematics #Mode (computer interface) #Neural Networks and Applications #Range (aeronautics)
- Reverse Differentiation via Predictive Coding
2021/03/08 by Tommaso Salvatori, Yuhang Song, Salvatori, Tommaso +8 · 1 voice · 4 citations
Computer Science · Engineering · Mathematics · Neuroscience · #Advanced Memory and Neural Computing #Algorithm #Artificial intelligence #Artificial neural network #Backpropagation #Coding (social sciences) #Computational neuroscience #Computer science #Deep learning #Inference #Machine learning #Mathematics #Neural Networks and Applications #Neural dynamics and brain function #Perceptron #Predictive coding #Recurrent neural network
- Event-based backpropagation can compute exact gradients for spiking neural networks
2020/09/17 by Timo C. Wunderlich, Christian Pehle · 2 voices · 22 citations
Computer Science · Engineering · #Activation function #Advanced Memory and Neural Computing #Artificial neural network #Backpropagation #Ferroelectric and Negative Capacitance Devices #Learning rule #MNIST database #Neural Networks and Reservoir Computing #Spike (software development) #Spike train #Spiking neural network
- Predictive Coding Approximates Backprop along Arbitrary Computation Graphs
2020/06/07 by Beren Millidge, Alexander Tschantz, Millidge, Beren +3 · 3 voices · 12 citations
Computer Science · Engineering · Mathematics · Neuroscience · #Advanced Memory and Neural Computing #Algorithm #Artificial intelligence #Artificial neural network #Automatic differentiation #Backpropagation #Coding (social sciences) #Computation #Computer science #Differentiable function #Ferroelectric and Negative Capacitance Devices #Graph #Hebbian theory #Machine learning #Mathematics #Models of neural computation #Neural dynamics and brain function #Perceptron #Predictive coding #Theoretical computer science #cs.LG #cs.NE
- Gradient Descent: The Ultimate Optimizer
2019/09/29 by Kartik Chandra, Audrey Xie, Chandra, Kartik +5 · 2 voices
Computer Science · Mathematics · #Advanced Neural Network Applications #Algorithm #Artificial intelligence #Artificial neural network #Backpropagation #Computer science #Gradient descent #Hyperparameter #Machine Learning and Data Classification #Machine learning #Simple (philosophy) #Stochastic Gradient Optimization Techniques #Task (project management) #cs.LG #stat.ML
- Review of second-order optimization techniques in artificial neural networks backpropagation
2019/06/07 by Hong Hui Tan, King Hann Lim · 1 citation
Engineering · Mathematics · #Advanced Numerical Analysis Techniques #Advanced Optimization Algorithms Research #Algorithm #Applied mathematics #Artificial intelligence #Artificial neural network #Backpropagation #Computer science #Convergence (economics) #Gradient descent #Hessian matrix #Iterative Methods for Nonlinear Equations #Mathematical optimization #Mathematics #Optimization problem
- Demystifying Differentiable Programming: Shift/Reset the Penultimate Backpropagator
2018/03/27 by Fei Wang, Wang, Fei, Daniel Zheng +9 · 4 voices · 1 citation
Computer Science · Engineering · Mathematics · #Advanced Neural Network Applications #Algorithm #Artificial intelligence #Artificial neural network #Backpropagation #Computation #Computer science #Deep learning #Differentiable function #Ferroelectric and Negative Capacitance Devices #Gradient descent #Mathematics #Operator (biology) #Parameterized complexity #Stochastic Gradient Optimization Techniques #Theoretical computer science #cs.LG #stat.ML
- Neural Networks with Few Multiplications
2015/10/11 by Zhouhan Lin, Matthieu Courbariaux, Lin, Zhouhan +5 · 2 voices · 4 citations
Computer Science · Mathematics · #Advanced Neural Network Applications #Algorithm #Arithmetic #Artificial intelligence #Artificial neural network #Backpropagation #Binary number #Computation #Computer science #Deep neural networks #Gradient descent #Layer (electronics) #MNIST database #Mathematics #Multiplication (music) #Neural Networks and Applications #Pattern recognition (psychology) #Point (geometry) #Sign (mathematics) #Stochastic Gradient Optimization Techniques #Stochastic gradient descent #Training (meteorology) #cs.LG #cs.NE
- Deep learning
2015/05/26 by Yann LeCun, Yoshua Bengio, Geoffrey E. Hinton +1 · 4 citations
Computer Science · #Abstraction #Anomaly Detection Techniques and Applications #Artificial intelligence #Artificial neural network #Backpropagation #Computer science #Convolutional neural network #Deep learning #Feature learning #Generative Adversarial Networks and Image Synthesis #Layer (electronics) #Neural Networks and Applications #Object (grammar) #Pattern recognition (psychology) #Representation (politics) #Speech recognition
- Random feedback weights support learning in deep neural networks
2014/11/02 by Timothy Lillicrap, Timothy P. Lillicrap, Daniel Cownden +7 · 1 voice · 24 citations
Biochemistry, Genetics and Molecular Biology · Computer Science · Engineering · Neuroscience · #Advanced Memory and Neural Computing #Artificial intelligence #Artificial neural network #Backpropagation #Blame #Computer science #Deep learning #Mechanism (biology) #Mistake #Neural Networks and Applications #Neural dynamics and brain function #Synaptic weight #cs.NE #q-bio.NC
- Let a biogeography-based optimizer train your Multi-Layer Perceptron
2014/02/03 by Seyedali Mirjalili, Seyed Mohammad Mirjalili, Andrew Lewis · 18 citations
Computer Science · Mathematics · #Algorithm #Artificial intelligence #Artificial neural network #Backpropagation #Computer science #Convergence (economics) #Heuristic #Initialization #Machine Learning and ELM #Machine learning #Mathematical optimization #Mathematics #Maxima and minima #Metaheuristic Optimization Algorithms Research #Multilayer perceptron #Neural Networks and Applications #Perceptron
- Artificial neural networks, back propagation, and the Kelley-Bryson gradient procedure
1990/09/01 by Stuart E. Dreyfus · 1 citation
Computer Science · Physics and Astronomy · #Artificial intelligence #Artificial neural network #Backpropagation #Blind Source Separation Techniques #Computer science #Control theory (sociology) #Geology #Neural Networks and Applications #Scientific Research and Discoveries
- Phoneme recognition using time-delay neural networks
1989/03/01 by Alexander Waibel, Toshiyuki Hanazawa, Geoffrey E. Hinton +2 · 4 citations
Computer Science · Engineering · #Speech Recognition and Synthesis #Speech and Audio Processing #Music and Audio Processing #Speech recognition #Computer science #Artificial neural network #Hidden Markov model #Time delay neural network #Task (project management) #Backpropagation #Pattern recognition (psychology) #Artificial intelligence #Word error rate #Hierarchy #Engineering
- Learning representations by back-propagating errors
1986/10/01 by David E. Rumelhart, Geoffrey E. Hinton, Ronald J. Williams · 15 citations
Computer Science · Engineering · Mathematics · #Algorithm #Artificial intelligence #Artificial neural network #Backpropagation #Blind Source Separation Techniques #Computer science #Control Systems and Identification #Convergence (economics) #Data mining #Domain (mathematical analysis) #Engineering #Mathematics #Measure (data warehouse) #Multilayer perceptron #Neural Networks and Applications #Pattern recognition (psychology) #Perceptron #Task (project management)