Effect size estimates: Current use, calculations, and interpretation.

2011/08/08 by Catherine O. Fritz, Peter E. Morris, Jennifer J. Richler · 61 citations
Decision Sciences · Psychology · #Meta-analysis and systematic reviews #Cognitive and psychological constructs research #Mental Health Research Topics

paper · doi:10.1037/a0024338

Abstract

The Publication Manual of the American Psychological Association (American Psychological Association, 2001, American Psychological Association, 2010) calls for the reporting of effect sizes and their confidence intervals. Estimates of effect size are useful for determining the practical or theoretical importance of an effect, the relative contributions of factors, and the power of an analysis. We surveyed articles published in 2009 and 2010 in the Journal of Experimental Psychology: General, noting the statistical analyses reported and the associated reporting of effect size estimates. Effect sizes were reported for fewer than half of the analyses; no article reported a confidence interval for an effect size. The most often reported analysis was analysis of variance, and almost half of these reports were not accompanied by effect sizes. Partial η2 was the most commonly reported effect size estimate for analysis of variance. For t tests, 2/3 of the articles did not report an associated effect size estimate; Cohen's d was the most often reported. We provide a straightforward guide to understanding, selecting, calculating, and interpreting effect sizes for many types of data and to methods for calculating effect size confidence intervals and power analysis.

Citations

• Primary, Secondary, and Meta-Analysis of Research
• A Primer on the Understanding, Use, and Calculation of Confidence Intervals that are Based on Central and Noncentral Distributions
• The Abuse of Power
• A History of Effect Size Indices
• Standardized or simple effect size: What should be reported?

Cited by

• Inspiratory muscle fatigue and pulmonary deposition/perfusion imaging predict sleep dysfunction in long COVID: Evidence from MTC scintigraphy and FIT performance metrics
• Lighting and circadian cues shape locomotor strategies for balance and navigation in larval zebrafish
• Women climate scientists are connected, productive, and successful but have shorter careers
• One App to Rule Them All: A One-Stop Calculator and Guide for 95 Effect-Size Variants for Two-Group Comparisons of Central Tendency, Variability, Overlap, Dominance, and Distributional Tails
• Neopolyploidy has variable effects on the diversity and composition of the wild strawberry microbiome
• Perspective from the Literature on the Role of Expert Judgment in Scientific and Statistical Research and Practice
• Cluster-guided LLM-Based Anonymization of Software Analytics Data: Studying Privacy-Utility Trade-offs in JIT Defect Prediction
• Dinosaurs as skeletons or lifelike replicas - effects on interest in extinct animals
• Fragmentary and dispersed
• Individuals with Down syndrome possess lower handgrip strength, appendicular lean mass, and muscle quality versus weight-matched adults
• Children with ADHD Have a Greater Lifetime History of Concussion: Results from the ABCD Study
• Using Behavior-Specific Praise in a High School Setting
• Designing for interaction, thinking and academic achievement in a Tanzanian undergraduate chemistry course
• An Exploratory Study of Incels’ Dating App Experiences, Mental Health, and Relational Well-Being
• Photoresponsive Rotaxanes Switch Lipid Bilayer Neuromorphic Behavior with Light
• Achievement Motivation and Academic Dishonesty: A Meta-Analytic Investigation
• Bayesian estimation supersedes the t test.
• Outdoor Overground Gait Biomechanics and Energetics in Individuals With Transtibial Amputation Walking With a Prescribed Passive Prosthesis and a Bionic Myoelectric Prosthesis
• The 10‐year trajectory of aggressive behaviours in autistic individuals
• Tissue-resident glial cells associate with tumoral vasculature and promote cancer progression
• Familiarity is familiarity is familiarity: Event-related brain potentials reveal qualitatively similar representations of personally familiar and famous faces.
• Effects of Complex Vs. Compound Training on Competitive Throwing Performance
• Central questions about meta-analyses in psychological research: An annotated reading list
• Learning Through Teaching: A Study of Social Work PhD Students in Their Roles as Educators and Learners of Research
• Early Vocabulary Profiles of Young Deaf Children Who Use Cochlear Implants
• To see or not to see: Does foot visualization in immersive virtual reality influence gait parameters of youths with neuromotor impairments when performing walking-related activities?
• Symptoms of anorexia nervosa and bulimia nervosa have differential relationships to borderline personality disorder symptoms
• The use and interpretation of unstandardized and standardized effect sizes in psychology: current practices and challenges
• Fear of Failure as Motivation: A Novel Conceptualization and Measure
• The infected blood inquiry: Impact on public perceptions of blood supply risk, safety, and donation attitudes
• Debiasing the Influence of Demographic and Appearance Cues in Social Engineering via Role-Taking: Negative Results
• Sex differences in quantitative ultrasonographic measurements of the rectus femoris in children
• Exploring the association between adolescent psychotic-like experiences and components of social performance using a multi-level virtual reality paradigm
• Voice user interfaces for effortless navigation in medical virtual reality environments
• Investigating the Links Between Cultural Values and Belief in Conspiracy Theories: The Key Roles of Collectivism and Masculinity
• Bayesian data analysis for newcomers
• Individuals With Transtibial Amputation Using a Prescribed Prosthesis and a Portable Bionic Prosthesis Under Myoelectric Control During a Stepping Activity
• Confidence and gradation in causal judgment
• The effect of depression and hopelessness on suicidal risk in young people: The mediating role of impulsivity
• Being critical is innovative: Constructive patriotism and collective actions are related to social entrepreneurship intentions
• Looking guilty: Handcuffing suspects influences judgements of deception
• Towards an Embodied Composition Framework for Organizing Immersive Computational Notebooks
• The autonomy-enhancing effects of choice on cognitive load, motivation and learning with digital media
• Same or different? Insights on public perception and acceptance of carbon capture and storage or utilization in Germany
• Improving Electroencephalogram-Based Deception Detection in Concealed Information Test under Low Stimulus Heterogeneity
• Exploring Organizational Strategies in Immersive Computational Notebooks
• Psychometric Evaluation of the Culture around Systemic Change Survey: A tool for Assessing Departmental Culture in Physics
• Collaboration enhances later individual memory for emotional material
• Assessing the Reliability and Validity of a Balance Mat for Measuring Postural Stability: A Combined Robot-Human Approach
• A new look at the relationship between the gamer and the game character: An exploratory study of internal dialogical activity
• Chatbot’s Complementary Motivation Support in Developing Study Plan of E-Learning English Lecture
• (Science) Teacher Education in a Knowledge Society. Good Practice at the University of Geneva
• The second victim phenomenon among German emergency medical technicians: a cross-sectional study based on the SeViD questionnaire (SeViD-VIII)
• Tower of London: problem parameters and error analysis in 5-year-old children from unsatisfied basic needs homes
• Evolution of Alzheimer's Disease Cerebrospinal Fluid Biomarkers in Early Parkinson's Disease
• Portable Biomechanics Laboratory: Clinically Accessible Movement Analysis from a Handheld Smartphone
• Can Large Language Models Automate Phishing Warning Explanations? A Controlled Experiment on Effectiveness and User Perception
• GPT Chatbots for Alleviating Anxiety and Depression: A Pilot Randomized Controlled Trial with Afghan Women
• Tailoring the Morphology of Cellulose Nanocrystals via Controlled Aggregation
• Assessing L1 Mandarin and L2 English influence on the L3 production of French obstruent coda voicing
• How effectively can EFL students use automated written corrective feedback (AWCF) in research writing?

Related

• Evaluating Effect Size in Psychological Research: Sense and Nonsense
• Standardized or simple effect size: What should be reported?
• Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs
• The use and interpretation of unstandardized and standardized effect sizes in psychology: current practices and challenges
• Correlational effect size benchmarks.