vix.ing · top · new · best · stats · spec

False Variable Selection Rates in Regression

2013/02/10 by Max Grazier G'Sell, Max G’Sell, G'Sell, Max Grazier +4
Decision Sciences · Mathematics · #FOS: Computer and information sciences #Methodology (stat.ME) #Optimal Experimental Design Methods #Statistical Methods and Inference #Statistical Methods in Clinical Trials #stat.ME

paper · pdf · doi:10.48550/arxiv.1302.2303

14 figures, 21 pages. Submitted to Annals of Applied Statistics

arxiv created 2013/02/10 · openalex publication_date 2013/02/10 · arxiv updated 2013/02/12 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

There has been recent interest in extending the ideas of False Discovery Rates (FDR) to variable selection in regression settings. Traditionally the FDR in these settings has been defined in terms of the coefficients of the full regression model. Recent papers have struggled with controlling this quantity when the predictors are correlated. This paper shows that this full model definition of FDR suffers from unintuitive and potentially undesirable behavior in the presence of correlated predictors. We propose a new false selection error criterion, the False Variable Rate (FVR), that avoids these problems and behaves in a more intuitive manner. We discuss the behavior of this criterion and how it compares with the traditional FDR, as well as presenting guidelines for determining which is appropriate in a particular setting. Finally, we present a simple estimation procedure for FVR in stepwise variable selection. We analyze the performance of this estimator and draw connections to recent estimators in the literature.

Citations

Related