Wrappers for feature subset selection

1997/12/01 by Ron Kohavi, George H. John · 8,959 citations
Computer Science · #Artificial intelligence #Computer science #Face and Expression Recognition #Feature (linguistics) #Feature selection #Imbalanced Data Classification Techniques #Machine Learning and Data Classification #Machine learning #Pattern recognition (psychology) #Selection (genetic algorithm)

paper · doi:10.1016/s0004-3702(97)00043-x

published in Artificial Intelligence 97(1-2), 273-324 (Elsevier BV)

openalex publication_date 1997/12/01 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/05

Citations

• A Branch and Bound Algorithm for Feature Subset Selection
• A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting
• Artificial intelligence: a modern approach
• Rough sets

Cited by

• Positive approximation: An accelerator for attribute reduction in rough set theory
• Constraint Score: A new filter method for feature selection with pairwise constraints
• Theoretical Properties of Multivariate Random Forest in Feature Selection and its Application to Facial Morphology-Gene Detection
• A survey on feature selection methods
• Less Noise, More Signal: the DRR Effect for Better Optimizations of a Range of SE Tasks
• Linear independence properties of the signature components of time-augmented stochastic processes
• Mapping Bug Reports to Relevant Files: A Ranking Model, a Fine-Grained Benchmark, and Feature Evaluation
• An Empirical Study of Feature Selection Granularity
• Toward better feature weighting algorithms: a focus on Relief
• A Regularized Method for Selecting Nested Groups of Relevant Genes from Microarray Data
• The Impact of Feature Selection on Predicting the Number of Bugs
• The All Relevant Feature Selection using Random Forest
• Theoretical Foundations of Forward Feature Selection Methods based on Mutual Information
• How Low Can You Go? The Data-Light SE Challenge
• Scalable branch-and-bound model selection with non-monotonic criteria including AIC, BIC and Mallows's C_p
• Driver Drowsiness Classification Based on Eye Blink and Head Movement Features Using the k-NN Algorithm
• Learning to Sketch Human Facial Portraits using Personal Styles by Case-Based Reasoning
• Partial multivariate transformer as a tool for cryptocurrencies time series prediction
• Quantum Adiabatic Feature Selection
• A Bootstrap Machine Learning Approach to Identify Rare Disease Patients from Electronic Health Records
• Feature selection methods and their combinations in high-dimensional classification of speaker likability, intelligibility and personality traits
• Graph Autoencoder-Based Unsupervised Feature Selection with Broad and Local Data Structure Preservation
• A Serial MRI–based Deep Learning Model to Predict Survival in Patients with Locoregionally Advanced Nasopharyngeal Carcinoma
• Concrete Autoencoders for Differentiable Feature Selection and Reconstruction
• Feature Selection through Minimization of the VC dimension
• End-to-end lightweight berry number prediction for supporting table grape cultivation
• MEL: Efficient Multi-Task Evolutionary Learning for High-Dimensional Feature Selection
• Two generalizations of Markov blankets
• DCNet: Large-Scale Point Cloud Semantic Segmentation With Discriminative and Efficient Feature Aggregation
• Impact of Legal Requirements on Explainability in Machine Learning
• MINERVA: Mutual Information Neural Estimation for Supervised Feature Selection
• An Information Theoretic Feature Selection Framework for Big Data under Apache Spark
• ParMAC: distributed optimisation of nested functions, with application to learning binary autoencoders
• Hybrid feature selection by combining filters and wrappers
• Feature Gradients: Scalable Feature Selection via Discrete Relaxation
• Software defect prediction using wrapper-based dynamic arithmetic optimization for feature selection
• Correlation and variable importance in random forests
• Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learning
• A Spiking Neural Learning Classifier System
• Local rough set: A solution to rough data analysis in big data
• Distributionally Robust Feature Selection
• HeFS: Helper-Enhanced Feature Selection via Pareto-Optimized Genetic Search
• Evaluating Airborne Hyperspectral Scanner (AHS) for the mapping of soil organic matter and clay in a Mediterranean forest ecosystem
• Feature selection for classification with class-separability strategy and data envelopment analysis
• Use of Tracer Kinetic Models for Selection of Semi-Quantitative Features for DCE-MRI Data Classification
• Interpretable feature subset selection: A Shapley value based approach
• SDQM: Synthetic Data Quality Metric for Object Detection Dataset Evaluation
• LLM-FS-Agent: A Deliberative Role-based Large Language Model Architecture for Transparent Feature Selection
• Cause-and-effect approach to turbulence forecasting
• Double Relief with progressive weighting function
• An enhanced statistical feature fusion approach using an improved distance evaluation algorithm and weighted K-nearest neighbor for bearing fault diagnosis
• A Novel Feature-Based Approach to Characterize Algorithm Performance for the Traveling Salesman Problem
• Cryptocurrency Market Analysis from the Open Innovation Perspective
• Interactive, Shallow Machine Learning-Based Semantic Segmentation of 2D and 3D Geophysical Data from Archaeological Sites
• An experience selecting quality features of apps for people with disabilities using abductive approach to explanatory theory generation
• Feature Selection with Redundancy-complementariness Dispersion
• Overcoming Output Dimension Collapse: When Sparsity Enables Zero-shot Brain-to-Image Reconstruction at Small Data Scales
• Objective discovery of dominant dynamical processes with intelligible machine learning
• A Review of Feature Selection Methods Based on Mutual Information
• Supervised Infinite Feature Selection
• Machine learning-driven error correction and feature analysis for near-surface wind fields in complex terrain
• Interactive Reinforcement Learning for Feature Selection with Decision Tree in the Loop
• Linear Time Feature Selection for Regularized Least-Squares
• SparseEMG: Computational Design of Sparse EMG Layouts for Sensing Gestures
• Predictive and Causal Implications of using Shapley Value for Model Interpretation
• Variational Information Maximization for Feature Selection
• Sparse evolutionary Deep Learning with over one million artificial neurons on commodity hardware
• Machine Learning for Detecting Data Exfiltration: A Review
• A Review of Feature Selection Methods for Machine Learning-Based Disease Risk Prediction
• Simultaneous Feature and Expert Selection within Mixture of Experts
• Distance Rank Score: Unsupervised filter method for feature selection on imbalanced dataset
• Variable selection for clustering with Gaussian mixture models: state of the art
• How to Allocate Resources For Features Acquisition?
• A review of ADHD detection studies with machine learning methods using rsfMRI data
• Classification of Functioning, Disability, and Health for Children and Youth: ICF-CY Self Care (SCADI Dataset) Using Predictive Analytics
• Benchmark Performance of Machine And Deep Learning Based Methodologies for Urdu Text Document Classification
• Feature Selection Based on Unique Relevant Information for Health Data
• Learning in High-Dimensional Multimedia Data: The State of the Art
• Mutual Information-Based Unsupervised Feature Transformation for Heterogeneous Feature Subset Selection
• Context-dependent feature analysis with random forests
• Cardiac Cohort Classification based on Morphologic and Hemodynamic Parameters extracted from 4D PC-MRI Data
• Comparing Bayesian Network Classifiers
• MFL_COVID19: Quantifying Country-based Factors affecting Case Fatality Rate in Early Phase of COVID-19 Epidemic via Regularised Multi-task Feature Learning
• ECO-AMLP: A Decision Support System using an Enhanced Class Outlier with Automatic Multilayer Perceptron for Diabetes Prediction
• An Immuno-Inspired Approach to Misbehavior Detection in Ad Hoc Wireless Networks
• Higher Order Mutual Information Approximation for Feature Selection
• HCVR: A Hybrid Approach with Correlation-aware Voting Rules for Feature Selection
• A Strongly Consistent Sparse k-means Clustering with Direct l₁ Penalization on Variable Weights
• Earthquake Detection in 1-D Time Series Data with Feature Selection and Dictionary Learning
• FSinR: an exhaustive package for feature selection
• Fibonacci and k-Subsecting Recursive Feature Elimination
• Scalable and Accurate Online Feature Selection for Big Data
• Differentiable Unsupervised Feature Selection based on a Gated Laplacian
• Efficient Approximate Solutions to Mutual Information Based Global Feature Selection
• Machine Learning for Predictive Analytics of Compute Cluster Jobs
• Autoregressive short-term prediction of turning points using support vector regression
• ASlib: A Benchmark Library for Algorithm Selection
• SAND: One-Shot Feature Selection with Additive Noise Distortion
• Analysis of Drifting Features
• Privacy-preserving feature selection: A survey and proposing a new set of protocols
• Predicting Human Depression with Hybrid Data Acquisition utilizing Physical Activity Sensing and Social Media Feeds
• A Copula Based Supervised Filter for Feature Selection in Diabetes Risk Prediction Using Machine Learning
• Efficient Reinforced Feature Selection via Early Stopping Traverse Strategy
• Ensemble Methods for Multi-label Classification
• Artificial Intelligence in Tumor Subregion Analysis Based on Medical Imaging: A Review
• Learning Dynamic Feature Selection for Fast Sequential Prediction
• Evaluation of the Performance of the Markov Blanket Bayesian Classifier Algorithm
• A Distance-Based Branch and Bound Feature Selection Algorithm
• Detecting Dead Weights and Units in Neural Networks
• Streamlining HTTP Flooding Attack Detection through Incremental Feature Selection
• Benchmark for filter methods for feature selection in high-dimensional classification data
• Estimating informativeness of samples with Smooth Unique Information
• Feature Selection via Regularized Trees
• Sequential Feature Classification in the Context of Redundancies
• Random Subspace with Trees for Feature Selection Under Memory Constraints
• Continuous Optimization for Feature Selection with Permutation-Invariant Embedding and Policy-Guided Search
• Learning Compact Models for Planning with Exogenous Processes
• A Multi-Dimensional approach towards Intrusion Detection System
• Identification of relevant diffusion MRI metrics impacting cognitive functions using a novel feature selection method
• Learning Selectively Conditioned Forest Structures with Applications to DBNs and Classification
• Exploiting the Accumulated Evidence for Gene Selection in Microarray Gene Expression Data
• Fast selection of spectral variables with B-spline compression
• Transforming Graph Representations for Statistical Relational Learning
• Population-Robust Feature Selection via Generalized Welfare Optimization
• Voxel selection framework based on meta-heuristic search and mutual information for brain decoding
• Predicting Fault-Prone Software Modules with Rank Sum Classification
• Piecewise-Linear Approximation for Feature Subset Selection in a Sequential Logit Model
• A concise method for feature selection via normalized frequencies
• Variable selection through CART
• Feature selection for high-dimensional data in astronomy
• A Shapley Value Solution to Game Theoretic-based Feature Reduction in False Alarm Detection
• Bayesian Network Classifiers
• Meta learning of bounds on the Bayes classifier error
• Automatic Parkinson disease detection at early stages as a pre-diagnosis tool by using classifiers and a small set of vocal features
• Variable selection using random forests
• Intentional-Deception Detection Based on Facial Muscle Movements in an Interactive Social Context
• A survey of modern authorship attribution methods
• Performance comparison of machine learning algorithms and number of independent components used in fMRI decoding of belief vs. disbelief
• Adaptive Graph-based Generalized Regression Model for Unsupervised Feature Selection
• Feature Selection via <i>l</i>₁-Penalized Squared-Loss Mutual Information
• Possibilistic Fuzzy Local Information C-Means with Automated Feature Selection for Seafloor Segmentation
• Recent advances in feature selection and its applications
• Hepatitis C Virus prediction based on machine learning framework: a real-world case study in Egypt
• FRI-Feature Relevance Intervals for Interpretable and Interactive Data Exploration
• A Hybrid Approach Towards Intrusion Detection Based on Artificial Immune System and Soft Computing
• Astroinformatics-based search for globular clusters in the Fornax Deep Survey
• Towards responsible AI for education: Hybrid human-AI to confront the Elephant in the room
• Simple and Scalable Sparse k-means Clustering via Feature Ranking
• Data preprocessing techniques for classification without discrimination
• MINIMUM REDUNDANCY FEATURE SELECTION FROM MICROARRAY GENE EXPRESSION DATA
• Seasonal-adjustment Based Feature Selection Method for Predicting Epidemic with Large-scale Search Engine Logs
• Naive Automated Machine Learning -- A Late Baseline for AutoML
• Causality-based Feature Selection: Methods and Evaluations
• Data Mining Attribute Selection Approach for Drought Modelling : A Case Study for Greater Horn of Africa
• Towards precise classification of cancers based on robust gene functional expression profiles. [europepmc]
• Protein subcellular localization prediction for Gram-negative bacteria using amino acid subalphabets and a combination of multiple support vector machines. [europepmc]
• Identification of novel and candidate miRNAs in rice by high throughput sequencing. [europepmc]
• A comparative study of different machine learning methods on microarray gene expression data. [europepmc]
• Gene selection algorithm by combining reliefF and mRMR. [europepmc]
• Modular prediction of protein structural classes from sequences of twilight-zone identity with predicting sequences. [europepmc]
• Identification of novel Coxiella burnetii Icm/Dot effectors and genetic analysis of their involvement in modulating a mitogen-activated protein kinase pathway. [europepmc]
• Integrative network analysis of TCGA data for ovarian cancer. [europepmc]
• Kernel regression based segmentation of optical coherence tomography images with diabetic macular edema. [europepmc]
• Physical Human Activity Recognition Using Wearable Sensors. [europepmc]
• biosigner: A New Method for the Discovery of Significant Molecular Signatures from Omics Data. [europepmc]
• Quantitative radiomics studies for tissue characterization: a review of technology and methodological procedures. [europepmc]
• Promises, Pitfalls, and Basic Guidelines for Applying Machine Learning Classifiers to Psychiatric Imaging Data, with Autism as an Example. [europepmc]
• Minimum redundancy maximum relevance feature selection approach for temporal gene expression data. [europepmc]
• Machine learning and systems genomics approaches for multi-omics data. [europepmc]
• Predicting RTS,S Vaccine-Mediated Protection from Transcriptomes in a Malaria-Challenge Clinical Trial. [europepmc]
• PhosphoPredict: A bioinformatics tool for prediction of human kinase-specific phosphorylation substrates and sites by integrating heterogeneous feature selection. [europepmc]
• Design and Selection of Machine Learning Methods Using Radiomics and Dosiomics for Normal Tissue Complication Probability Modeling of Xerostomia. [europepmc]
• Identifying Objective Physiological Markers and Modifiable Behaviors for Self-Reported Stress and Mental Health Status Using Wearable Sensors and Mobile Phones: Observational Study. [europepmc]
• Decision Variants for the Automatic Determination of Optimal Feature Subset in RF-RFE. [europepmc]
• Artificial Neural Network Modeling of Novel Coronavirus (COVID-19) Incidence Rates across the Continental United States. [europepmc]
• Directed acyclic graphs and causal thinking in clinical risk prediction modeling. [europepmc]
• Deep learning encodes robust discriminative neuroimaging representations to outperform standard machine learning. [europepmc]
• Feature selection revisited in the single-cell era. [europepmc]
• A Review of Feature Selection Methods for Machine Learning-Based Disease Risk Prediction. [europepmc]