2015/06/22 by Willem van den Boom, Galen Reeves, Boom, Willem van den +3 · 1 citation
Computer Science · Mathematics · #Advanced Multi-Objective Optimization Algorithms #Bayesian Methods and Mixture Models #Computation (stat.CO) #FOS: Computer and information sciences #Statistical Methods and Inference #stat.CO
paper · pdf · doi:10.48550/arxiv.1506.06629
10 pages, 4 figures, PDFLaTeX, submitted to the Twenty-ninth Annual Conference on Neural Information Processing Systems (NIPS 2015)
arxiv created 2015/06/22 · openalex publication_date 2015/06/22 · arxiv updated 2015/06/23 · openalex created_date 2016/06/24 · openalex updated_date 2026/07/28
In many contexts, there is interest in selecting the most important variables from a very large collection, commonly referred to as support recovery or variable, feature or subset selection. There is an enormous literature proposing a rich variety of algorithms. In scientific applications, it is of crucial importance to quantify uncertainty in variable selection, providing measures of statistical significance for each variable. The overwhelming majority of algorithms fail to produce such measures. This has led to a focus in the scientific literature on independent screening methods, which examine each variable in isolation, obtaining p-values measuring the significance of marginal associations. Bayesian methods provide an alternative, with marginal inclusion probabilities used in place of p-values. Bayesian variable selection has advantages, but is impractical computationally beyond small problems. In this article, we show that approximate message passing (AMP) and Bayesian compressed regression (BCR) can be used to rapidly obtain accurate approximations to marginal inclusion probabilities in high-dimensional variable selection. Theoretical support is provided, simulation studies are conducted to assess performance, and the method is applied to a study relating brain networks to creative reasoning.