2025/05/05 by Bernt Damian Glaser, Heemin Kang, Kristin Audunsdottir +2 · 1 voice
Decision Sciences · Agricultural and Biological Sciences · #Meta-analysis and systematic reviews #Psychometric Methodologies and Testing #Sensory Analysis and Statistical Methods
paper · pdf · doi:10.31234/osf.io/h368x_v2
Effect sizes are useful for understanding the magnitude of study results and for planning new studies using power analysis. But despite their wide usage, effect sizes are often misinterpreted. This is mostly due to an over-reliance on general effect size benchmarks that were not intended for broad application across a range of different research fields. Inaccurate effect size interpretations can consequently lead to incorrect conclusions regarding the magnitude of study results, as well as incorrect sample size estimates, which can increase the likelihood of false positive results. This article introduces the ESDist R package, which is designed to calculate empirically derived effect size benchmarks or a range of reliably detectable empirical effect sizes for a specific research question or field of interest by the calculation of effect size distributions (ESDs). This package can be used on data that can be easily extracted from pre-existing meta-analyses to help researchers more accurately plan new studies or to better understand how an individual study might relate to other studies in their field of interest. ESDist includes a set of features that make it easy to use in a priori power analysis. Moreover, the package includes a feature for estimating effect size benchmarks that account for publication bias and are weighted by effect sizes variances, which addresses existing limitations of using ESDs for study planning or interpretation.