Variability in the analysis of a single neuroimaging dataset by many teams
2020/05/20 by Rotem Botvinik‐Nezer, Rotem Botvinik-Nezer, Felix Holzmeister +212 · 54 citations
Decision Sciences · Neuroscience · Psychology · #Functional Brain Connectivity Studies #Mental Health Research Topics #Meta-analysis and systematic reviews
paper · doi:10.1038/s41586-020-2314-9
crossref issued 2020/05/20 · crossref published 2020/05/20 · crossref published-online 2020/05/20 · openalex publication_date 2020/05/20 · crossref created 2020/05/20 · crossref published-print 2020/06/04 · crossref deposited 2024/11/28 · openalex created_date 2025/10/10 · crossref indexed 2026/07/30 · openalex updated_date 2026/07/31
Citations
Cited by
- Seeing more than the Tip of the Iceberg: Approaches to Subthreshold Effects in Functional Magnetic Resonance Imaging of the Brain
- Exploring a formal approach to selecting studies for replication: A feasibility study in social neuroscience
- Reproducibility and robustness of economics and political science research
- Ten simple rules for good research practice
- Implementing code review in the scientific workflow: Insights from ecology and evolutionary biology
- Protecting against researcher bias in secondary data analysis: challenges and potential solutions
- Sharing neurophysiology data from the Allen Brain Observatory
- Statisticians, Roll Up Your Sleeves! There's A Crisis to be Solved
- Neurodatascience: Past, Present, and Future
- fNIRS reproducibility varies with data quality, analysis pipelines, and researcher experience
- The replication crisis has led to positive structural, procedural, and community changes
- Reproducible brain-wide association studies require thousands of individuals
- Do EEG Metrics Derived from Trailers Predict the Commercial Success of Movies? A Systematic Analysis of Five Independent Datasets
- We don't know what you did last summer. On the importance of transparent reporting of reaction time data pre-processing
- The Agentic Garden of Forking Paths
- The evolving landscape of neuroscience
- A Window Into the State of the Science: Current Reporting Practices Related to Generalizability in MRI and Functional-MRI Studies
- A scoping review on metrics to quantify reproducibility: a multitude of questions leads to a multitude of metrics
- Precise Topology of Adjacent Domain-General and Sensory-Biased Regions in the Human Brain
- Challenges and future directions for representations of functional brain organization
- Same data, different analysts: variation in effect sizes due to analytical decisions in ecology and evolutionary biology
- Examining the replicability of online experiments selected by a decision market
- Representation of Anticipated Rewards and Punishments in the Human Brain
- Predicting replication outcomes and generalizability of results
- Biomni: A General-Purpose Biomedical AI Agent
- Dump the “dimorphism”: Comprehensive synthesis of human brain studies reveals few male-female differences beyond size
- Reproducible Brain Charts: An open data resource for mapping brain development and its associations with mental health
- Reliability and predictability of phenotype information from functional connectivity in large imaging datasets
- In the Search for Truth: Navigating Variability in Neuroimaging Software Pipelines
- Translational network neuroscience: Nine roadblocks and possible solutions
- Toward a more credible assessment of the credibility of science by many-analyst studies
- A reproducible and generalizable software workflow for analysis of large-scale neuroimaging data collections using BIDS Apps
- The past, present and future of neuroscience data sharing: a perspective on the state of practices and infrastructure for FAIR
- Seeing more than the tip of the iceberg: Approaches to subthreshold effects in functional magnetic resonance imaging of the brain
- A Multi-Dataset Evaluation of Frame Censoring for Motion Correction in Task-Based fMRI
- Enhancing precision in human neuroscience
- Technical Report: Quality Assessment Tool for Machine Learning with Clinical CT
- Multidimensional Signals and Analytic Flexibility: Estimating Degrees of Freedom in Human-Speech Analyses
- Revised cytoarchitectonic mapping of the human premotor cortex identifies seven areas and refines the localisation of frontal eye fields
- Moving beyond processing- and analysis-related variation in resting-state functional brain imaging
- Global p-Values in Multi-Design Studies
- Complex Coordinate-Based Meta-Analysis with Probabilistic Programming
- Generalizability of choice architecture interventions
- Same model, same data, but different outcomes: Evaluating the impact of method choices in structural equation modeling
- Placebo Analgesia Reduces Costly Prosocial Helping to Lower Another Person’s Pain
- ETHOS.REFLOW: An open-source workflow for reproducible renewable energy potential assessments
- The search for the neural correlate of consciousness: Progress and challenges
- Experimenting with financial professionals
- Same data, different conclusions: Radical dispersion in empirical results when independent analysts operationalize and test the same hypothesis
- Taming uncertainty with MDE: an historical perspective
- Towards Reproducible Brain-Wide Association Studies
- Proceedings of the OHBM Brainhack 2022
- NeuroAgent: LLM Agents for Multimodal Neuroimaging Analysis and Research
- Formal definition and implementation of reproducibility tenets for computational workflows