Shall we Really do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences
2009/06/01 by Stefan Schmidt · 1 voice · 29 citations
Arts and Humanities · Psychology · Computer Science · #Philosophy and History of Science #Mental Health Research Topics #Bayesian Modeling and Causal Inference
paper · doi:10.1037/a0015108
Abstract
Replication is one of the most important tools for the verification of facts within the empirical sciences. A detailed examination of the notion of replication reveals that there are many different meanings to this concept and the relevant procedures, but hardly any systematic literature. This paper analyzes the concept of replication from a theoretical point of view. It demonstrates that the theoretical demands are scarcely met in everyday work within the social sciences. Some demands are just not feasible, whereas others are constricted by restrictions relating to publication. A new classification scheme based on a functional approach that distinguishes between different types of replication is proposed. Next, it will be argued that replication addresses the important connection between existing and new knowledge. To do so it has to be applied explicitly and systematically. The paper ends with a description of procedures how this could be done and a set of recommendations how to handle the concept of replication in the future to exploit its potential to the full.
Citations
Cited by
- A Framework for Moving Beyond Computational Reproducibility: Lessons from Three Reproductions of Geographical Analyses of COVID‐19
- How Software Development Conceals and Constrains Critical Analytic Decisions: Tracing the Encoded Choices Behind a Failure to Reproduce a Spatial Scan Statistic
- Why We Disagree About the Success of Replications
- Unequal academic achievement in high school: the mediating roles of concerted cultivation and close friends
- Estimating the reproducibility of psychological science
- Bayes Factor Hypothesis Testing in Meta-Analyses: Practical Advantages and Methodological Considerations
- Attachment style as a moderating influence on the efficacy of cognitive-behavioral and interpersonal psychotherapy for depression: A failure to replicate.
- Ten simple rules for designing and conducting undergraduate replication projects
- Not every story has two sides: the effect of false balance on perceived scientific consensus about interrogation practices
- Replication studies in second language acquisition research: <i>Definitions, issues, resources, and future directions</i>
- Registered Reports
- Exploring a formal approach to selecting studies for replication: A feasibility study in social neuroscience
- The Alleged Crisis and the Illusion of Exact Replication
- Replication Studies in TESOL
- Making replication mainstream
- Revisiting Patterns and Controls of Productivity in a Mesic Grassland 30 Years Later: Do We Know Now What We Knew Then?
- Using open geographic information science practices to create cascading improvements in research quality and to support discovery
- The Wisdom of Some: Do We Always Need High Consensus to Shape Consumer Behavior?
- The process of replication target selection in psychology: what to consider?
- Interactive Tools for Reproducible Science -- Understanding, Supporting, and Motivating Reproducible Science Practices
- Toward coherence in curriculum, instruction, and assessment: A review of learning progression literature
- A possible disconnect in JDM research articles: <i>Results</i> sections display an estimation perspective while <i>Discussion</i> sections belie an estimation mindset
- Testing the Efficacy of a Tier 2 Mathematics Intervention
- Initial evidence of research quality of registered reports compared with the standard publishing model
- Sign-Congruence, External Validity, and Replication
- Replication, a Hallmark of Good Science: Unraveling the Factors That Predict Replication Success
- The Design of Current Replication Studies: A Systematic Literature Review on the Variation of Study Characteristics
- Replicability Crisis in Social Psychology: Looking at the Past to Find New Pathways for the Future
- General Cognitive Ability and job performance in personnel selection in Sweden: A meta-analysis
Discussions
Related