vix.ing · top · new · best · stats · spec

Supervised feature selection with orthogonal regression and feature weighting

2019/10/09 by Xia Wu, Xueyuan Xu, Wu, Xia +9 · 3 citations
Chemistry · Computer Science · #FOS: Computer and information sciences #Face and Expression Recognition #Image Retrieval and Classification Techniques #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Spectroscopy and Chemometric Analyses

paper · pdf · doi:10.48550/arxiv.1910.03787

openalex publication_date 2019/10/09 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Effective features can improve the performance of a model, which can thus help us understand the characteristics and underlying structure of complex data. Previous feature selection methods usually cannot keep more local structure information. To address the defects previously mentioned, we propose a novel supervised orthogonal least square regression model with feature weighting for feature selection. The optimization problem of the objection function can be solved by employing generalized power iteration (GPI) and augmented Lagrangian multiplier (ALM) methods. Experimental results show that the proposed method can more effectively reduce the feature dimensionality and obtain better classification results than traditional feature selection methods. The convergence of our iterative method is proved as well. Consequently, the effectiveness and superiority of the proposed method are verified both theoretically and experimentally.

Cited by

Related