Evaluating Effect Size in Psychological Research: Sense and Nonsense
2019/05/08 by David C. Funder, Daniel J. Ozer · 1 voice · 63 citations
Decision Sciences · Psychology · #Behavioral Health and Interventions #Mental Health Research Topics #Meta-analysis and systematic reviews
paper · pdf · doi:10.1177/2515245919847202
openalex publication_date 2019/05/08 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/31
Abstract
Effect sizes are underappreciated and often misinterpreted—the most common mistakes being to describe them in ways that are uninformative (e.g., using arbitrary standards) or misleading (e.g., squaring effect-size rs). We propose that effect sizes can be usefully evaluated by comparing them with well-understood benchmarks or by considering them in terms of concrete consequences. In that light, we conclude that when reliably estimated (a critical consideration), an effect-size r of .05 indicates an effect that is very small for the explanation of single events but potentially consequential in the not-very-long run, an effect-size r of .10 indicates an effect that is still small at the level of single events but potentially more ultimately consequential, an effect-size r of .20 indicates a medium effect that is of some explanatory and practical use even in the short run and therefore even more important, and an effect-size r of .30 indicates a large effect that is potentially powerful in both the short and the long run. A very large effect size ( r = .40 or greater) in the context of psychological research is likely to be a gross overestimate that will rarely be found in a large sample or in a replication. Our goal is to help advance the treatment of effect sizes so that rather than being numbers that are ignored, reported without interpretation, or interpreted superficially or incorrectly, they become aspects of research reports that can better inform the application and theoretical development of psychological research.
Citations
Cited by
- Personality and Compassion for Animals
- Developmental psychologists should adopt citizen science to improve generalization and reproducibility
- Does gratitude moderate the bystander effect? A registered report
- Moral grandstanding in public discourse: Status-seeking motives as a potential explanatory mechanism in predicting conflict
- The power of many small sex differences in cognition, personality, and interests
- The role of the family in youth psychiatric readmission: a scoping review
- Individual differences in adolescent cortical development are associated with neighborhood characteristics: Longitudinal findings from the ABCD study
- The levers of political persuasion with conversational artificial intelligence
- The use and interpretation of unstandardized and standardized effect sizes in psychology: current practices and challenges
- Individual differences in sick face sensitivity: females are more sensitive to lassitude facial expressions than males
- Perception of own centrality in social networks
- Hippocampal abnormality and response to vagus nerve stimulation in epilepsy
- Personality and prosocial behavior: A theoretical framework and meta-analysis.
- Cheat, cheat, repeat: On the consistency of dishonest behavior in structurally comparable situations
- Understanding the Links Between Climate Change Risk Perceptions and the Action Response to Inform Climate Services Interventions
- What correlations mean for individual people: A tutorial for researchers, students and the public
- Test anxiety in primary school children: A 20-year systematic review and meta-analysis
- Factors Associated with Quality of Life in Relatives of Adults with Serious Mental Illness: A Systematic Review
- Association Between Adverse Childhood Experiences Score and Traumatic Brain Injury Occurrence: A Systematic Review and Meta-Analysis
- Annual Research Review: The role of caregiver sensitivity in children's developmental outcomes – an umbrella review
- What Is the Test-Retest Reliability of Common Task-Functional MRI Measures? New Empirical Evidence and a Meta-Analysis
- Using multi-method data for more accurate research findings
- How Many Participants Do I Need to Test an Interaction? Conducting an Appropriate Power Analysis and Achieving Sufficient Power to Detect an Interaction
- Choosing between human and algorithmic advisors: The role of responsibility sharing
- The Misinformation Susceptibility Test (MIST): A psychometrically validated measure of news veracity discernment
- Longitudinal associations of dispositional forgivingness with multidimensional well-being: a two-wave outcome-wide analysis in the Global Flourishing Study
- A Systematic Review and Meta-Analysis: Paternal Anxiety and the Emotional and Behavioral Outcomes in Their Offspring
- Moral foundations partially explain the association of the Dark Triad traits with homophobia and transphobia
- Lifestyle Polarization on a College Campus: Do Liberals and Conservatives Behave Differently in Everyday Life?
- Emotion Knowledge Relates to Cortisol for Children Attending Head Start Preschool
- Addressing Covid-19 Vaccination Conspiracy Theories and Vaccination Intentions
- Aligning Behavioral Assumptions Underlying Policy Instruments: A Principle for Designing Policy Mixes Targeting Behavioral Change
- Associations of common mental disorders with personality traits over a 17-year period
- Ontological diversity in gaming disorder measurement: a nationally representative registered report
- Countering Misinformation and Fake News Through Inoculation and Prebunking
- Does sexualization in video games cause harm in players? A meta-analytic examination
- Bridges over troubled water: A meta-analysis of the associations of character strengths with well-being and common mental health disorders
- Understanding the use of child-related sexual fantasy and fictional sexual materials by people who are attracted to children
- "Mirror" Language AI Models of Depression are Criterion-Contaminated
- Assessing Nudge Impact: A Comprehensive Second‐Order Meta‐Analysis
- The Harmful Dysfunction Analysis applied to the concept of behavioral addiction: toward a new theoretical framework
- Associations between short video addiction and peer relationships among adolescents: The mediating role of alexithymia and body mass index
- Reversible white matter changes following a 4‐week high phenylalanine exposure in adults with phenylketonuria
- Fake news game confers psychological resistance against online misinformation
- Escaping the digital panopticon? Longitudinal effects of dataveillance salience shocks on privacy attitudes and inhibited behaviors
- A multi-lab test of the facial feedback hypothesis by the Many Smiles Collaboration
- Emphasising herd immunity in vaccine advocacy: a systematic review and meta-analysis
- Emotion regulation, not executive functioning, mediates longitudinal links between unpredictability in adolescence and social connectedness in young adulthood
- The Benefits of Work: A Meta-analysis of the Latent Deprivation and Agency Restriction Models
- Shear Stress Targeted Delivery of Nitroglycerin to Brain Collaterals Improves Ischaemic Stroke Outcome
- Individual differences in relational body image: Within-person variability predicts maladaptive trait body image
- Testing the applicability of idionomic statistics in longitudinal studies: The example of ‘doing what matters’
- The exposome of healthy and accelerated aging across 40 countries
- The efficacy of an online self‐administered single session intervention to promote growth mindset in adolescents: A randomised controlled trial
- Using multi-rater and test-retest data to detect overlap within and between psychological scales
- Linking sense of purpose and multiple markers of health in older adulthood: A bidirectional approach
- Psychometric properties of telepressure measures in the workplace and private life among French-speaking employees
- Characterizing Prolog Programming Techniques.
- Best practices for addressing missing data through multiple imputation
- Parental emotion socialization and internalizing problems in childhood and adolescence: A meta-analytic review
- Strengthening connections: A randomized controlled trial examining the impact of a supervisor support intervention on loneliness and military couple relationships
- A multi-study examination of intra-individual feedback loops between competence and value beliefs, procrastination, and goal achievement
- ‘Personality in its Natural Habitat’ Revisited: A Pooled, Multi–sample Examination of the Relationships between the Big Five Personality Traits and Daily Behaviour and Language Use
- Long-distance texting: Text messaging is linked with higher relationship satisfaction in long-distance relationships
Discussions
Related