vix.ing · top · new · best · stats · spec

Convergence of the Gradient Sampling Algorithm on Directionally Lipschitz Functions

2021/07/10 by James V. Burke, Burke, James V., Qiuying Lin +1 · 1 citation
Computer Science · Engineering · Mathematics · #49J22 #65K05 #65K10 #90C26 #FOS: Mathematics #Numerical methods in inverse problems #Optimization and Control (math.OC) #Optimization and Variational Analysis #Sparse and Compressive Sensing Techniques

paper · pdf · doi:10.48550/arxiv.2107.04918

openalex publication_date 2021/07/10 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

The convergence theory for the gradient sampling algorithm is extended to directionally Lipschitz functions. Although directionally Lipschitz functions are not necessarily locally Lipschitz, they are almost everywhere differentiable and well approximated by gradients and so are a natural candidate for the application of the gradient sampling algorithm. The main obstacle to this extension is the potential unboundedness or emptiness of the Clarke subdifferential at points of interest. The convergence analysis we present provides one path to addressing these issues. In particular, we recover the usual convergence theory when the function is locally Lipschitz. Moreover, if the algorithm does not drive a certain measure of criticality to zero, then the iterates must converge to a point at which either the Clarke subdifferential is empty or the direction of steepest descent is degenerate in the sense that it does lie in the interior of the domain of the regular subderivative.

Cited by

Related