2021/11/01 by Guanghui Lan, Lan, Guanghui, Yuyuan Ouyang +1
Computer Science · Engineering · #FOS: Mathematics #Optimization and Control (math.OC) #Optimization and Variational Analysis #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques
paper · pdf · doi:10.48550/arxiv.2111.00996
openalex publication_date 2021/11/01 · openalex created_date 2021/11/08 · openalex updated_date 2026/07/28
In this paper we propose new algorithms for solving a class of structured monotone variational inequality (VI) problems over compact feasible sets. By identifying the gradient components existing in the operator of VI, we show that it is possible to skip computations of the gradients from time to time, while still maintaining the optimal iteration complexity for solving these VI problems. Specifically, for deterministic VI problems involving the sum of the gradient of a smooth convex function ∇ G and a monotone operator H, we propose a new algorithm, called the mirror-prox sliding method, which is able to compute an ε-approximate weak solution with at most O((L/ε)1/2) evaluations of ∇ G and O((L/ε)1/2+M/ε) evaluations of H, where L and M are Lipschitz constants of ∇ G and H, respectively. Moreover, for the case when the operator H can only be accessed through its stochastic estimators, we propose a stochastic mirror-prox sliding method that can compute a stochastic ε-approximate weak solution with at most O((L/ε)1/2) evaluations of ∇ G and O((L/ε)1/2+M/ε + σ2/ε2) samples of H, where σ is the variance of the stochastic samples of H.