2024/04/23 by Anton Rodomanov, Rodomanov, Anton · 4 citations
Engineering · #FOS: Mathematics #Optimization and Control (math.OC) #Systems Engineering Methodologies and Applications
paper · pdf · doi:10.48550/arxiv.2404.15051
openalex publication_date 2024/04/23 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
In this paper, we present a global complexity analysis of the classical BFGS method with inexact line search, as applied to minimizing a strongly convex function with Lipschitz continuous gradient and Hessian. We consider a variety of standard line search strategies including the backtracking line search based on the Armijo condition, Armijo-Goldstein and Wolfe-Powell line searches. Our analysis suggests that the convergence of the algorithm proceeds in several different stages before the fast superlinear convergence actually begins. Furthermore, once the initial point is far away from the minimizer, the starting moment of superlinear convergence may be quite large. We show, however, that this drawback can be easily rectified by using a simple restarting procedure.