A Validity-Based Framework for Understanding Replication in Psychology

2020/07/27 by Leandre R. Fabrigar, Duane T. Wegener, Richard E. Petty · 1 voice · 3 citations
Psychology · #Behavioral Health and Interventions #Cultural Differences and Values #Mental Health Research Topics

paper · doi:10.1177/1088868320931366

openalex publication_date 2020/07/27 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/19

Abstract

In recent years, psychology has wrestled with the broader implications of disappointing rates of replication of previously demonstrated effects. This article proposes that many aspects of this pattern of results can be understood within the classic framework of four proposed forms of validity: statistical conclusion validity, internal validity, construct validity, and external validity. The article explains the conceptual logic for how differences in each type of validity across an original study and a subsequent replication attempt can lead to replication "failure." Existing themes in the replication literature related to each type of validity are also highlighted. Furthermore, empirical evidence is considered for the role of each type of validity in non-replication. The article concludes with a discussion of broader implications of this classic validity framework for improving replication rates in psychological research.

Citations

• Estimating the reproducibility of psychological science
• Subject effects in laboratory research: An examination of subject roles, demand characteristics, and valid inference.
• Priming, Replication, and the Hardest Science
• Availability: A heuristic for judging frequency and probability
• The weirdest people in the world?
• Consequences of prejudice against the null hypothesis.
• Moral credentials and the expression of prejudice.
• The Alleged Crisis and the Illusion of Exact Replication
• False-Positive Psychology
• Contextual sensitivity in scientific reproducibility
• Making replication mainstream
• P-curve: A key to the file-drawer.
• The impact of perceived message complexity and need for cognition on information processing and attitudes
• Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling

Cited by

• Sixty Years After Orne’s <i>American Psychologist</i> Article: A Conceptual Framework for Subjective Experiences Elicited by Demand Characteristics
• Towards a cumulative science of vocal markers of autism: a cross-linguistic meta-analysis-based investigation of acoustic markers in American and Danish autistic children
• Thinking Clearly About Sampling and Representation With the Total Survey Error Framework

Discussions

• 📚 A validity-based framework for understanding replication in psychology. doi.org/10.1177/1088... "The article explains the conceptual logic for how differences in each type of validity across an or [bsky, 3 points, 1 comments]

Related

• Making replication mainstream
• Replication, a Hallmark of Good Science: Unraveling the Factors That Predict Replication Success
• Estimating the reproducibility of psychological science
• Eleven years of student replication projects provide evidence on the correlates of replicability in psychology
• The Design of Current Replication Studies: A Systematic Literature Review on the Variation of Study Characteristics