Shall we Really do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences
2009/06/01 by Stefan Schmidt · 1 voice · 807 citations
Arts and Humanities · Computer Science · Mathematics · Psychology · #Bayesian Modeling and Causal Inference #Cognitive science #Computer science #Computer security #Data science #Epistemology #Exploit #Mathematics #Mental Health Research Topics #Philosophy and History of Science #Point (geometry) #Psychology #Replication (statistics) #Set (abstract data type)
paper · doi:10.1037/a0015108
published in Review of General Psychology 13(2), 90-100 (SAGE Publications)
crossref issued 2009/06/01 · crossref published 2009/06/01 · crossref published-online 2009/06/01 · crossref published-print 2009/06/01 · openalex publication_date 2009/06/01 · crossref created 2009/06/01 · crossref deposited 2025/03/10 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/05 · crossref indexed 2026/08/05
Abstract
Replication is one of the most important tools for the verification of facts within the empirical sciences. A detailed examination of the notion of replication reveals that there are many different meanings to this concept and the relevant procedures, but hardly any systematic literature. This paper analyzes the concept of replication from a theoretical point of view. It demonstrates that the theoretical demands are scarcely met in everyday work within the social sciences. Some demands are just not feasible, whereas others are constricted by restrictions relating to publication. A new classification scheme based on a functional approach that distinguishes between different types of replication is proposed. Next, it will be argued that replication addresses the important connection between existing and new knowledge. To do so it has to be applied explicitly and systematically. The paper ends with a description of procedures how this could be done and a set of recommendations how to handle the concept of replication in the future to exploit its potential to the full.
Citations
Cited by
- A Framework for Moving Beyond Computational Reproducibility: Lessons from Three Reproductions of Geographical Analyses of COVID‐19
- How Software Development Conceals and Constrains Critical Analytic Decisions: Tracing the Encoded Choices Behind a Failure to Reproduce a Spatial Scan Statistic
- Why We Disagree About the Success of Replications
- Unequal academic achievement in high school: the mediating roles of concerted cultivation and close friends
- Estimating the reproducibility of psychological science
- Bayes Factor Hypothesis Testing in Meta-Analyses: Practical Advantages and Methodological Considerations
- Attachment style as a moderating influence on the efficacy of cognitive-behavioral and interpersonal psychotherapy for depression: A failure to replicate.
- Ten simple rules for designing and conducting undergraduate replication projects
- Not every story has two sides: the effect of false balance on perceived scientific consensus about interrogation practices
- Replication studies in second language acquisition research: Definitions, issues, resources, and future directions
- Registered Reports
- Exploring a formal approach to selecting studies for replication: A feasibility study in social neuroscience
- The Alleged Crisis and the Illusion of Exact Replication
- Replication Studies in TESOL
- Making replication mainstream
- Revisiting Patterns and Controls of Productivity in a Mesic Grassland 30 Years Later: Do We Know Now What We Knew Then?
- Using open geographic information science practices to create cascading improvements in research quality and to support discovery
- The Wisdom of Some: Do We Always Need High Consensus to Shape Consumer Behavior?
- The process of replication target selection in psychology: what to consider?
- Interactive Tools for Reproducible Science -- Understanding, Supporting, and Motivating Reproducible Science Practices
- Toward coherence in curriculum, instruction, and assessment: A review of learning progression literature
- A possible disconnect in JDM research articles: Results sections display an estimation perspective while Discussion sections belie an estimation mindset
- Testing the Efficacy of a Tier 2 Mathematics Intervention
- Initial evidence of research quality of registered reports compared with the standard publishing model
- Sign-Congruence, External Validity, and Replication
- Replication, a Hallmark of Good Science: Unraveling the Factors That Predict Replication Success
- The Design of Current Replication Studies: A Systematic Literature Review on the Variation of Study Characteristics
- Replicability Crisis in Social Psychology: Looking at the Past to Find New Pathways for the Future
- General Cognitive Ability and job performance in personnel selection in Sweden: A meta-analysis
- RETRACTED ARTICLE: High replicability of newly discovered social-behavioural findings is achievable
- Comparing early-stage L2 processing of derived and inflected words: a conceptual replication of Jacob et al. (2018) with Chinese learners of L2 English
- Acute Alcohol Response Phenotype in Heavy Social Drinkers is Robust and Reproducible
- Meaningful Work and Affective Commitment: A Moderated Mediation Model of Positive Work Reflection and Work Centrality
- Concerns About Replicability Across Two Crises in Social Psychology
- Same Test, Better Scores: Boosting the Reliability of Short Online Intelligence Recruitment Tests with Nested Logit Item Response Theory Models
- Security Smells in Ansible and Chef Scripts: A Replication Study
- Openness and Reproducibility: Insights from a Model-Centric Approach
- Longitudinal associations between the use of sexually explicit material and adolescents' attitudes and behaviors: A narrative review of studies
- Development of the CLARIFY (CheckList stAndardising the Reporting of Interventions For Yoga) guidelines: a Delphi study
- Replication Study of the Effect of Different Loading Conditions on Running Mechanics at Different Velocities
- Supporting replication research in management journals: Qualitative analysis of editorials published between 1970 and 2015
- Challenges for assessing replicability in preclinical cancer biology
- Metaresearch for Evaluating Reproducibility in Ecology and Evolution
- Scientific Utopia
- “Repeated sampling from the same population?” A critique of Neyman and Pearson’s responses to Fisher
- Sex differences in the right tail of cognitive abilities: An update and cross cultural extension
- Shifting Republican views on climate change through targeted advertising
- Facts Are More Important Than Novelty
- Replicability and Reproducibility in Comparative Psychology
- Top 10 Replicated Findings From Behavioral Genetics
- An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science
- Publication and other reporting biases in cognitive sciences: detection, prevalence, and prevention
- Replication crisis [wikipedia]
- An open investigation of the reproducibility of cancer biology research. [europepmc]
- After a pair of self-control-intensive tasks, sucrose swishing improves subsequent working memory performance. [europepmc]
- Replication, falsification, and the crisis of confidence in social psychology. [europepmc]
- Replication, Communication, and the Population Dynamics of Scientific Discovery. [europepmc]
- Replicating research in ecology and evolution: feasibility, incentives, and the cost-benefit conundrum. [europepmc]
- Top 10 Replicated Findings From Behavioral Genetics. [europepmc]
- Depressed Mood During Early to Middle Adolescence: A Bi-national Longitudinal Study of the Unique Impact of Family Conflict. [europepmc]
- The (mis)measurement of the Dark Triad Dirty Dozen: exploitation at the core of the scale. [europepmc]
- Couple Resilience to Economic Pressure Over Time and Across Generations. [europepmc]
- The natural selection of bad science. [europepmc]
- Making sense of replications. [europepmc]
- We need more replication research - A case for test-retest reliability. [europepmc]
- Replicability and Reproducibility in Comparative Psychology. [europepmc]
- Cross-Validation Approaches for Replicability in Psychology. [europepmc]
- Replicability or reproducibility? On the replication crisis in computational neuroscience and sharing only relevant detail. [europepmc]
- Scientific discovery in a model-centric framework: Reproducibility, innovation, and epistemic diversity. [europepmc]
- What is replication? [europepmc]
- Dimensionality of the Chinese CES-D: Is It Stable across Gender, Time, and Samples? [europepmc]
- Parallel age-related cognitive effects in autism: A cross-sectional replication study. [europepmc]
- Challenges for assessing replicability in preclinical cancer biology. [europepmc]
- Development of the CLARIFY (CheckList stAndardising the Reporting of Interventions For Yoga) guidelines: a Delphi study. [europepmc]
- Transparent, Open, and Reproducible Prevention Science. [europepmc]
- Methods for Heart Rate Variability Biofeedback (HRVB): A Systematic Review and Guidelines. [europepmc]
- Attention and behavior problems in childhood predict adult financial status, health, and criminal activity: A conceptual replication and extension of Moffitt et al. (2011) using cohorts from the United States and the United Kingdom. [europepmc]
- High replicability of newly discovered social-behavioural findings is achievable. [europepmc]
Discussions
Related