vix.ing · top · new · best · stats

Efficient Sparse Group Feature Selection via Nonconvex Optimization

2012/05/23 by Shuo Xiang, Xiang, Shuo, Xiaotong Shen +3
Computer Science · Engineering · Mathematics · Medicine · #FOS: Computer and information sciences #Face and Expression Recognition #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Sparse and Compressive Sensing Techniques #Systemic Lupus Erythematosus Research #cs.LG #stat.ML

paper · pdf · doi:10.48550/arxiv.1205.5075

Accepted by the 30th International Conference on Machine Learning (ICML 2013)

openalex publication_date 2012/05/23 · arxiv created 2013/01/18 · arxiv updated 2013/01/22 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Sparse feature selection has been demonstrated to be effective in handling high-dimensional data. While promising, most of the existing works use convex methods, which may be suboptimal in terms of the accuracy of feature selection and parameter estimation. In this paper, we expand a nonconvex paradigm to sparse group feature selection, which is motivated by applications that require identifying the underlying group structure and performing feature selection simultaneously. The main contributions of this article are twofold: (1) statistically, we introduce a nonconvex sparse group feature selection model which can reconstruct the oracle estimator. Therefore, consistent feature selection and parameter estimation can be achieved; (2) computationally, we propose an efficient algorithm that is applicable to large-scale problems. Numerical results suggest that the proposed nonconvex method compares favorably against its competitors on synthetic data and real-world applications, thus achieving desired goal of delivering high performance.

Citations

Related