Publication bias, statistical power and reporting practices in the Journal of Sports Sciences: potential barriers to replicability

2023/08/18 by Cristian Mesquida, Jennifer Murphy, Daniël Lakens +1 · 1 voice
Decision Sciences · Economics, Econometrics and Finance · #Meta-analysis and systematic reviews #Sports Analytics and Performance #scientometrics and bibliometrics research

paper · doi:10.1080/02640414.2023.2269357

openalex publication_date 2023/08/18 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

-values, effect sizes and confidence intervals. Our results indicate that there was some indication of publication bias and the average observed power was low (53% for significant and non-significant findings and 61% for only significant findings). Finally, the usage and reporting practices of a-priori power analyses as well as statistical results including test statistics, effect sizes and confidence intervals were suboptimal.

Citations

• Sequential hypothesis testing with Bayes factors: Efficiently testing mean differences.
• Estimating the reproducibility of psychological science
• The file drawer problem and tolerance for null results.
• The Abuse of Power
• Power failure: why small sample size undermines the reliability of neuroscience
• Sample Size Planning for Statistical Power and Accuracy in Parameter Estimation
• Consequences of prejudice against the null hypothesis.
• Recommendations for Increasing Replicability in Psychology
• Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs
• Why Most Published Research Findings Are False
• Small Telescopes
• False-Positive Psychology
• Power, precision, and sample size estimation in sport and exercise science research
• An Excess of Positive Results: Comparing the Standard Psychology Literature With Registered Reports
• P-curve: A key to the file-drawer.
• Using anchor-based methods to determine the smallest effect size of interest
• Sample Size Justification
• Understanding The New Statistics
• Big little lies: a compendium and simulation of p -hacking strategies

Discussions

• The call for specifying SESOIs in sport and exercise sciences has already been made @crist14n.bsky.social doi.org/10.1080/0264... [bsky, 0 points, 1 comments]