BDF schemes for accelerated gradient flows in projection-free approximation of nonconvex constrained variational minimization

2024/09/23 by Dong, Guozhi, Gong, Zikang, Xie, Ziqing +1 · 1 citation
#65B99 #65K10 #65M15 #FOS: Mathematics #Numerical Analysis (math.NA) #Optimization and Control (math.OC)

paper · doi:10.48550/arxiv.2409.14670

Abstract

We propose novel algorithms combining accelerated gradient flows with linearized projection-free treatments of non-convex constraints and BDF pseudo-temporal discretization for quadratic energy minimization. A general framework is developed to analyze constraint violations in such projection-free techniques for quadratic constraints. This analysis proves to be universal to all projection-free iterative methods, and constraint error bounds depend solely on iterate regularity. For BDF-k(k=1,2,3,4), we derive both unconditional and conditional high-order constraint violation estimates for accelerated gradient flows using our framework. We further discover a new family of BDF-k accelerated gradient methods achieving modified energy stability for arbitrary positive integer k. Numerical experiments validate our theoretical results and demonstrate superior efficiency and accuracy compared to existing gradient flow approaches.

Cited by

• A decoupled, stable, and second-order integrator for the Landau--Lifshitz--Gilbert equation with magnetoelastic effects

Related

• Accelerated gradient flows for large bending deformations of nonlinear plates
• Variational Extrapolation of Implicit Schemes for General Gradient Flows
• The Geometry of Constrained Optimization: Constrained Gradient Flows via Reparameterization: A-Stable Implicit Schemes, KKT from Stationarity, and Geometry-Respecting Algorithms
• Global constraints preserving SAV schemes for gradient flows
• Structured Nonconvex and Nonsmooth Optimization: Algorithms and Iteration Complexity Analysis