vix.ing · top · new · best · stats · spec

Proximal Quasi-Newton Method for Composite Optimization over the Stiefel Manifold

2025/01/16 by Qinsi Wang, Yang Wei, Wang, Qinsi +1 · 2 citations
Engineering · #Advanced Numerical Analysis Techniques

paper · pdf · doi:10.48550/arxiv.2501.09516

Abstract

In this paper, we consider the composite optimization problems over the Stiefel manifold. A successful method to solve this class of problems is the proximal gradient method proposed by Chen et al. Motivated by the proximal Newton-type techniques in the Euclidean space, we present a Riemannian proximal quasi-Newton method, named ManPQN, to solve the composite optimization problems. The global convergence of the ManPQN method is proved and iteration complexity for obtaining an ε-stationary point is analyzed. Under some mild conditions, we also establish the local linear convergence result of the ManPQN method. Numerical results are encouraging, which shows that the proximal quasi-Newton technique can be used to accelerate the proximal gradient method.

Cited by

Related