2021/03/18 by Ryo Hayakawa, Hayakawa, Ryo
Computer Science · Engineering · Mathematics · #FOS: Computer and information sciences #FOS: Electrical engineering #FOS: Mathematics #Information Theory (cs.IT) #Numerical methods in inverse problems #Optimization and Control (math.OC) #Signal Processing (eess.SP) #Sparse and Compressive Sensing Techniques #Stochastic Gradient Optimization Techniques #electronic engineering #information engineering
paper · pdf · doi:10.48550/arxiv.2103.10300
openalex publication_date 2021/03/18 · openalex created_date 2021/03/29 · openalex updated_date 2026/07/28
Proximal splitting-based convex optimization is a promising approach to linear inverse problems because we can use some prior knowledge of the unknown variables explicitly. An understanding of the behavior of the optimization algorithms would be important for the tuning of the parameters and the development of new algorithms. In this paper, we first analyze the asymptotic property of the proximity operator for the squared loss function, which appears in the update equations of some proximal splitting methods for linear inverse problems. Our analysis shows that the output of the proximity operator can be characterized with a scalar random variable in the large system limit. Moreover, we apply the asymptotic result to the prediction of optimization algorithms for compressed sensing. Simulation results demonstrate that the MSE performance of the Douglas-Rachford algorithm can be well predicted in compressed sensing with the ℓ1 optimization. We also examine the behavior of the prediction for the case with nonconvex smoothly clipped absolute deviation (SCAD) and minimax concave penalty (MCP) regularization.