2018/10/31 by Spencer Woody, Oscar Hernan Madrid Padilla, Oscar Hernán Madrid Padilla +1
Computer Science · Mathematics · #Artificial intelligence #Bayes factor #Bayes' theorem #Bayesian Methods and Mixture Models #Bayesian inference #Bayesian probability #Computer science #Econometrics #Estimator #Frequentist inference #Inference #Mathematics #Prior probability #Statistical Methods and Bayesian Inference #Statistical Methods and Inference #Statistics #stat.ME
paper · pdf · doi:10.1093/biomet/asab014
openalex created_date 2018/11/02 · arxiv created 2020/11/13 · openalex publication_date 2021/02/25 · arxiv updated 2021/03/02 · openalex updated_date 2026/08/05
Summary Many recently developed Bayesian methods focus on sparse signal detection. However, much less work has been done on the natural follow-up question: how does one make valid inferences for the magnitude of those signals after selection? Ordinary Bayesian credible intervals suffer from selection bias, as do ordinary frequentist confidence intervals. Existing Bayesian methods for correcting this bias produce credible intervals with poor frequentist properties. Further, existing frequentist approaches require sacrificing the benefits of shrinkage typical in Bayesian methods, resulting in confidence intervals that are needlessly wide. We address this gap by proposing a nonparametric empirical Bayes approach to constructing optimal selection-adjusted confidence sets. Our method produces confidence sets that are as short as possible on average, while both adjusting for selection and maintaining exact frequentist coverage uniformly over the parameter space. We demonstrate an important consistency property of our procedure: under mild conditions, it asymptotically converges to the results of an oracle-Bayes analysis in which the prior distribution of signal sizes is known exactly. Across a series of examples, the method is found to outperform existing frequentist techniques for post-selection inference, producing confidence sets that are notably shorter, but with the same coverage guarantee.