Efficient Predictor Ranking and False Discovery Proportion Control in High-Dimensional Regression

2018/04/09 by X. Jessie Jeng, Jeng, X. Jessie, Xiongzhi Chen +1
Mathematics · #Statistical Methods and Inference #Advanced Causal Inference Techniques #Statistical Methods and Bayesian Inference

paper · pdf · doi:10.48550/arxiv.1804.03274

Abstract

We propose a ranking and selection procedure to prioritize relevant predictors and control false discovery proportion (FDP) of variable selection. Our procedure utilizes a new ranking method built upon the de-sparsified Lasso estimator. We show that the new ranking method achieves the optimal order of minimum non-zero effects in ranking relevant predictors ahead of irrelevant ones. Adopting the new ranking method, we develop a variable selection procedure to asymptotically control FDP at a user-specified level. We show that our procedure can consistently estimate the FDP of variable selection as long as the de-sparsified Lasso estimator is asymptotically normal. In numerical analyses, our procedure compares favorably to existing methods in ranking efficiency and FDP control when the regression model is relatively sparse.

Citations

• Rate optimal multiple testing procedure in high-dimensional regression

Related

• Post-Lasso Inference for High-Dimensional Regression
• False Discovery Rate Control via Debiased Lasso
• Rank-based Lasso -- efficient methods for high-dimensional robust model selection
• Trade-off between predictive performance and FDR control for high-dimensional Gaussian model selection
• The Complete Lasso Tradeoff Diagram