vix.ing · top · new · best · stats · spec

On-the-Fly Joint Feature Selection and Classification

2020/04/21 by Yasitha Warahena Liyanage, Daphney–Stavroula Zois, Daphney-Stavroula Zois +4
Computer Science · Mathematics · #Anomaly Detection Techniques and Applications #FOS: Computer and information sciences #Face and Expression Recognition #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Neural Networks and Applications #cs.LG #stat.ML

paper · pdf · doi:10.48550/arxiv.2004.10245

arxiv created 2020/04/21 · openalex publication_date 2020/04/21 · arxiv updated 2020/04/23 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

Joint feature selection and classification in an online setting is essential for time-sensitive decision making. However, most existing methods treat this coupled problem independently. Specifically, online feature selection methods can handle either streaming features or data instances offline to produce a fixed set of features for classification, while online classification methods classify incoming instances using full knowledge about the feature space. Nevertheless, all existing methods utilize a set of features, common for all data instances, for classification. Instead, we propose a framework to perform joint feature selection and classification on-the-fly, so as to minimize the number of features evaluated for every data instance and maximize classification accuracy. We derive the optimum solution of the associated optimization problem and analyze its structure. Two algorithms are proposed, ETANA and F-ETANA, which are based on the optimum solution and its properties. We evaluate the performance of the proposed algorithms on several public datasets, demonstrating (i) the dominance of the proposed algorithms over the state-of-the-art, and (ii) its applicability to broad range of application domains including clinical research and natural language processing.

Citations

Related