2018/11/12 by Bert Baumgaertner, Baumgaertner, Bert, Berna Devezer +5 · 1 voice
Decision Sciences · Environmental Science · Mathematics · #FOS: Computer and information sciences #Meta-analysis and systematic reviews #Other Statistics (stat.OT) #Scientific Computing and Data Management #Species Distribution and Climate Change #stat.OT
paper · pdf · doi:10.48550/arxiv.1811.04525
22 pages, 2 figures. All authors contributed equally. Under review
openalex publication_date 2018/11/12 · arxiv published 2018/11/12 · arxiv created 2019/10/28 · arxiv updated 2019/10/30 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
This paper investigates the conceptual relationship between openness and reproducibility using a model-centric approach, heavily informed by probability theory and statistics. We first clarify the concepts of reliability, auditability, replicability, and reproducibility--each of which denotes a potential scientific objective. Then we advance a conceptual analysis to delineate the relationship between open scientific practices and these objectives. Using the notion of an idealized experiment, we identify which components of an experiment need to be reported and which need to be repeated to achieve the relevant objective. The model-centric framework we propose aims to contribute precision and clarity to the discussions surrounding the so-called reproducibility crisis.