vix.ing · top · new · best · stats · spec

Learning Fast Approximations of Sparse Nonlinear Regression

2020/10/26 by Song Yuhai, Song, Yuhai, Zhong Cao +7 · 1 citation
Computer Science · Engineering · Mathematics · #Blind Source Separation Techniques #FOS: Computer and information sciences #Machine Learning (cs.LG) #Sparse and Compressive Sensing Techniques #Tensor decomposition and applications

paper · pdf · doi:10.48550/arxiv.2010.13490

openalex publication_date 2020/10/26 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

The idea of unfolding iterative algorithms as deep neural networks has been widely applied in solving sparse coding problems, providing both solid theoretical analysis in convergence rate and superior empirical performance. However, for sparse nonlinear regression problems, a similar idea is rarely exploited due to the complexity of nonlinearity. In this work, we bridge this gap by introducing the Nonlinear Learned Iterative Shrinkage Thresholding Algorithm (NLISTA), which can attain a linear convergence under suitable conditions. Experiments on synthetic data corroborate our theoretical results and show our method outperforms state-of-the-art methods.

Citations

Cited by

Related