Variability in the analysis of a single neuroimaging dataset by many teams

2020/05/20 by Rotem Botvinik‐Nezer, Rotem Botvinik-Nezer, Felix Holzmeister +212 · 36 citations
Decision Sciences · Neuroscience · Psychology · #Functional Brain Connectivity Studies #Mental Health Research Topics #Meta-analysis and systematic reviews

paper · doi:10.1038/s41586-020-2314-9

crossref issued 2020/05/20 · crossref published 2020/05/20 · crossref published-online 2020/05/20 · openalex publication_date 2020/05/20 · crossref created 2020/05/20 · crossref published-print 2020/06/04 · crossref deposited 2024/11/28 · openalex created_date 2025/10/10 · crossref indexed 2026/07/30 · openalex updated_date 2026/07/31

Citations

• Estimating the reproducibility of psychological science
• Registered Reports
• False-Positive Psychology
• Increasing Transparency Through a Multiverse Analysis

Cited by

• Seeing more than the Tip of the Iceberg: Approaches to Subthreshold Effects in Functional Magnetic Resonance Imaging of the Brain
• Exploring a formal approach to selecting studies for replication: A feasibility study in social neuroscience
• Reproducibility and robustness of economics and political science research
• Ten simple rules for good research practice
• Implementing code review in the scientific workflow: Insights from ecology and evolutionary biology
• Protecting against researcher bias in secondary data analysis: challenges and potential solutions
• Sharing neurophysiology data from the Allen Brain Observatory
• Statisticians, Roll Up Your Sleeves! There's A Crisis to be Solved
• Neurodatascience: Past, Present, and Future
• fNIRS reproducibility varies with data quality, analysis pipelines, and researcher experience
• The replication crisis has led to positive structural, procedural, and community changes
• Reproducible brain-wide association studies require thousands of individuals
• Do EEG Metrics Derived from Trailers Predict the Commercial Success of Movies? A Systematic Analysis of Five Independent Datasets
• We don't know what you did last summer. On the importance of transparent reporting of reaction time data pre-processing
• The Agentic Garden of Forking Paths
• The evolving landscape of neuroscience
• A Window Into the State of the Science: Current Reporting Practices Related to Generalizability in MRI and Functional-MRI Studies
• A scoping review on metrics to quantify reproducibility: a multitude of questions leads to a multitude of metrics
• Precise Topology of Adjacent Domain-General and Sensory-Biased Regions in the Human Brain
• Challenges and future directions for representations of functional brain organization
• Same data, different analysts: variation in effect sizes due to analytical decisions in ecology and evolutionary biology
• Examining the replicability of online experiments selected by a decision market
• Representation of Anticipated Rewards and Punishments in the Human Brain
• Predicting replication outcomes and generalizability of results
• Biomni: A General-Purpose Biomedical AI Agent
• Dump the “dimorphism”: Comprehensive synthesis of human brain studies reveals few male-female differences beyond size
• Reproducible Brain Charts: An open data resource for mapping brain development and its associations with mental health
• Reliability and predictability of phenotype information from functional connectivity in large imaging datasets
• In the Search for Truth: Navigating Variability in Neuroimaging Software Pipelines
• Translational network neuroscience: Nine roadblocks and possible solutions
• Toward a more credible assessment of the credibility of science by many-analyst studies
• A reproducible and generalizable software workflow for analysis of large-scale neuroimaging data collections using BIDS Apps
• The past, present and future of neuroscience data sharing: a perspective on the state of practices and infrastructure for FAIR
• Seeing more than the tip of the iceberg: Approaches to subthreshold effects in functional magnetic resonance imaging of the brain
• A Multi-Dataset Evaluation of Frame Censoring for Motion Correction in Task-Based fMRI
• Enhancing precision in human neuroscience