Accelerating gradient descent and Adam via fractional gradients

2023/01/11 by Yeonjong Shin, Jérôme Darbon, George Em Karniadakis · 4 citations
Mathematics · Computer Science · Physics and Astronomy · #Fractional Differential Equations Solutions #Machine Learning and ELM #Model Reduction and Neural Networks

paper · doi:10.1016/j.neunet.2023.01.002

Citations

• An overview of gradient descent optimization algorithms

Cited by

• Enhancing Fractional Gradient Descent with Learned Optimizers
• Fractional-Order Nesterov Dynamics for Convex Optimization
• Fractional Spike Differential Equations Neural Network with Efficient Adjoint Parameters Training
• An Adaptive Order Caputo Fractional Gradient Descent Method for Multi-objective Optimization Problems