vix.ing · top · new · best · stats · spec

On Estimating Many Means, Selection Bias, and the Bootstrap

2013/11/15 by Simon, Noah, Simon, Richard · 1 citation
#FOS: Computer and information sciences #Machine Learning (stat.ML) #Methodology (stat.ME)

paper · doi:10.48550/arxiv.1311.3709

Abstract

With recent advances in high throughput technology, researchers often find themselves running a large number of hypothesis tests (thousands+) and esti- mating a large number of effect-sizes. Generally there is particular interest in those effects estimated to be most extreme. Unfortunately naive estimates of these effect-sizes (even after potentially accounting for multiplicity in a testing procedure) can be severely biased. In this manuscript we explore this bias from a frequentist perspective: we give a formal definition, and show that an oracle estimator using this bias dominates the naive maximum likelihood estimate. We give a resampling estimator to approximate this oracle, and show that it works well on simulated data. We also connect this to ideas in empirical Bayes.

Cited by

Related