2014/03/31 by Lorenzo Rosasco, Silvia Villa, Rosasco, Lorenzo +4
Computer Science · Mathematics · #47H05 #65K10 #90C15 #90C25 #Advanced Optimization Algorithms Research #FOS: Mathematics #Numerical methods in inverse problems #Optimization and Control (math.OC) #Optimization and Variational Analysis #math.OC #msc:47H05 #msc:65K10 #msc:90C15 #msc:90C25
paper · pdf · doi:10.48550/arxiv.1403.7999
20 pages
openalex publication_date 2014/03/31 · arxiv created 2015/02/20 · arxiv updated 2015/02/23 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
We propose and analyze the convergence of a novel stochastic forward-backward splitting algorithm for solving monotone inclusions given by the sum of a maximal monotone operator and a single-valued maximal monotone cocoercive operator. This latter framework has a number of interesting special cases, including variational inequalities and convex minimization problems, while stochastic approaches are practically relevant to account for perturbations in the data. The algorithm we propose is a stochastic extension of the classical deterministic forward-backward method, and is obtained considering the composition of the resolvent of the maximal monotone operator with a forward step based on a stochastic estimate of the single-valued operator. Our study provides a non-asymptotic error analysis in expectation for the strongly monotone case, as well as almost sure convergence under weaker assumptions. The approach we consider allows to avoid averaging, a feature critical when considering methods based on sparsity, and, for minimization problems, it allows to obtain convergence rates matching those obtained by stochastic extensions of so called accelerated methods. Stochastic quasi Fejer's sequences are a key technical tool to prove almost sure convergence.