How Big Is “Big”? Interpreting Effect Sizes in L2 Research
2014/10/15 by Luke Plonsky, Frederick L. Oswald · 1,904 citations
Decision Sciences · Mathematics · Psychology · #Cognitive psychology #Field (mathematics) #Linguistics #Mathematics #Psychology #Psychometric Methodologies and Testing #Statistics
paper · doi:10.1111/lang.12079
published in Language Learning 64(4), 878-912 (Wiley)
openalex publication_date 2014/10/15 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Abstract
The calculation and use of effect sizes—such as d for mean differences and r for correlations—has increased dramatically in second language (L2) research in the last decade. Interpretations of these effects, however, have been rare and, when present, have largely defaulted to Cohen's levels of small ( d = .2, r = .1), medium (.5, .3), and large (.8, .5), which were never intended as prescriptions but rather as a general guide. As Cohen himself and many others have argued, effect sizes are best understood when interpreted within a particular discipline or domain. This article seeks to promote more informed and field‐specific interpretations of d and r by presenting a description of L2 effects from 346 primary studies and 91 meta‐analyses ( N > 604,000). Results reveal that Cohen's benchmarks generally underestimate the effects obtained in L2 research. Based on our analysis, we propose a field‐specific scale for interpreting effect sizes, and we outline eight key considerations for gauging relative magnitude and practical significance in primary and secondary studies, such as theoretical maturity in the domain, the degree of experimental manipulation, and the presence of publication bias.
Citations
Cited by
- Corpus Use in Language Learning: A Meta‐Analysis
- Contrasting Fixed‐ and Mixed‐Effects Modeling in Vocabulary Research: Reanalyzing Laufer (2024) and McLean et al. (2020)
- Effects of Task Complexity on L2 Writing Behaviors and Linguistic Complexity
- Reporting and Interpreting Quantitative Research Findings: What Gets Reported and Recommendations for the Field
- Metacognitive Instruction Enhances the Effectiveness of Corrective Feedback: Variable Effects of Feedback Types and Linguistic Targets
- Effects of Second Language Pronunciation Teaching Revisited: A Proposed Measurement Framework and Meta‐Analysis
- The Effects of Spaced Practice on Second Language Learning: A Meta‐Analysis
- Optimizing Fluency Training for Speaking Skills Transfer: Comparing the Effects of Blocked and Interleaved Task Repetition
- Multiple Regression in L2 Research: A Methodological Synthesis and Guide to InterpretingR2Values
- Developing L2 semantic knowledge of English modality through concept‐based language instruction: Do cognitive linguistics materials have an advantage?
- Misconduct and Questionable Research Practices: The Ethics of Quantitative Data Handling and Reporting in Applied Linguistics
- The Effect of Perception of Teacher Characteristics on Spanish EFL Learners’ Anxiety and Enjoyment
- A Control–Value Theory Approach to Boredom in English Classes Among University Students in China
- A Meta‐Analysis of Reliability Coefficients in Second Language Research
- A Meta‐Analysis of Hybrid Language Instruction and Call for Future Research
- Examining the Effectiveness of Peer Feedback in Second Language Writing: A Meta‐Analysis
- Identifying Linguistic Markers of Collaboration in Second Language Peer Interaction: A Lexico‐grammatical Approach
- The Interplay of Task Characteristics, Linguistic Complexity, and Language Proficiency in High‐Stakes English as a Foreign Language Writing
- A tutorial for calculating field-specific effect size distributions
- The Effects of Corpus Use on Second Language Vocabulary Learning: A Multilevel Meta-analysis
- Generative AI and English essay writing: exploring the role of ChatGPT in enhancing learners’ task engagement
- The Effectiveness of Second Language Pronunciation Instruction: A Meta-Analysis
- Coming of age: the past, present, and future of quantitative SLA research
- Corpora in language teaching and learning
- Does informal digital language learning really contribute to second language achievement? Evidence from a multilevel meta-analysis
- The stability, change, and predictive value of L2 grit: A longitudinal study
- TASK REPETITION AND SECOND LANGUAGE SPEECH PROCESSING
- A BIBLIOMETRIC ANALYSIS OF SECOND LANGUAGE ACQUISITION BETWEEN 1997 AND 2018
- LINGUISTIC DIMENSIONS OF COMPREHENSIBILITY AND PERCEIVED FLUENCY: AN INVESTIGATION OF COMPLEXITY, ACCURACY, AND FLUENCY IN SECOND LANGUAGE ARGUMENTATIVE SPEECH
- LINGUISTIC DIMENSIONS OF L2 ACCENTEDNESS AND COMPREHENSIBILITY VARY ACROSS SPEAKING TASKS
- High variability phonetic training (HVPT): A meta-analysis of L2 perceptual training studies
- Explicit Instruction within a Task: Before, During, or After?
- Fluency and multilingualism in study abroad: Lessons from a scoping review
- Changes in interlanguage complexity during study abroad: A meta-analysis
- Additional languages learning and use in a multilingual study abroad context
- Exploring English as a Foreign Language Learners’ Adoption and Utilisation of ChatGPT for Speaking Practice Through an Extended Technology Acceptance Model
- The effects of task type on the resolution of grammatical cognitive conflict episodes and grammar learning
- L2 Chinese Grammatical Acquisition and Processing: A Substantive and Methodological Review
- Mixed‐Effects Modeling with a Multinomial Dependent Variable
- Data-driven Learning in and out of the Language Classroom
- Speech fluency among L1 Arabic elementary and intermediate learners of English as a foreign language
- How Does Access to L1 Speech Affect L2 and L3 Perceived Fluency?
- Syntactic awareness as a mediator of reading–writing relations in young Chinese L2 learners
- Are foreign language learners’ enjoyment and anxiety specific to the teacher? An investigation into the dynamics of learners’ classroom emotions
- Levels of foreign language enjoyment, anxiety and boredom in emergency remote teaching and in in-person classes
- The effects of recasts on L2 grammar: a meta-analysis
- The neglected emotion of boredom in teaching English to advanced learners
- Incorporating ChatGPT Into Genre‐Based Instruction for Argumentative Writing Among EFL College Students
- BASIC PSYCHOLOGICAL NEEDS, MOTIVATIONAL ORIENTATIONS, EFFORT, AND VOCABULARY KNOWLEDGE
- EFFECTS OF MASSING AND SPACING ON THE LEARNING OF SEMANTICALLY RELATED AND UNRELATED WORDS
- SECOND LANGUAGE ANXIETY AND ACHIEVEMENT
- MULTIPLE REGRESSION AS A FLEXIBLE ALTERNATIVE TO ANOVA IN L2 RESEARCH
- EXAMINING THE RELATIVE EFFECTS OF TASK COMPLEXITY AND COGNITIVE DEMANDS ON STUDENTS’ WRITING IN A SECOND LANGUAGE
- MASSED TASK REPETITION IS A DOUBLE-EDGED SWORD FOR FLUENCY DEVELOPMENT
- Why you should stop using the ideal L2 self and the L2 motivational self-system to measure motivation (Reaction to Al-Hoorie, Hiver & In’nami, 2024)
- A CALL FOR CAUTIOUS INTERPRETATION OF META-ANALYTIC REVIEWS
- Exploring the relationship of working memory to the temporal distribution of pausing and revision behaviors during L2 writing
- Towards more appropriate modelling of linguistic complexity measures: Beyond traditional regression models
- Explicit information and working memory in second-language acquisition of the Spanish subjunctive: A replication and extension of Fernández (2008)
- Long-term effects of structure-based versus dynamic usage-based instructional programs for French
- Oral lexical gains in Spanish as a second language
- Reexamining the role of regulatory focus in second language achievement
- Assessment of Task-Based Pragmatic Performance: Measuring Pragmatic Complexity and Accuracy
- Exposure or age? The effect of additional CLIL instruction on young learners’ grammatical complexity while performing an oral task
- Feedforwarding diagnostic language assessment: Artificial intelligence- (AI-) driven weakness identification and contextualised feedback for second language speaking
- Do gender-pairings and age/proficiency interplay in LRE production? A preliminary study with young CLIL learners
- Bridging the gap: Exploring authorial voice in medical ethics blogs and research papers
- The role of cognitive individual differences in digital versus pen-and-paper writing
- Clarifying the role of inhibitory control in L2 phonological processing: A preregistered, close replication of Darcy et al. (2016)
- Robust evidence for the simple view of second language reading: Secondary meta-analysis of Jeon and Yamashita (2022)
- Exploring the Influence of Individual Speaking Style, Cross-Linguistic Transfer of Language-Specific Fluency Patterns, and Proficiency on Second Language Oral Fluency
- Investigating L2 writing processes across independent and integrated tasks: A mixed-methods study
- A methodological synthesis and meta-analysis of judgment tasks in second language research
- Impact of automated writing evaluation on teacher feedback, student revision, and writing improvement
- The effectiveness of app-based and classroom-based instruction on L2 learning and motivation
- Achievement emotions and control-value appraisals in foreign language learning
- Modelling the predictive effect of enjoyment on willingness to communicate in a foreign language: the chain mediating role of growth mindset and grit
- Learning L2 constructions from captioned audio-visual exposure: The effect of learner-related factors
- Technology-enhanced vocabulary learning: The role of self-regulation and prior knowledge
- Setting them up for (grammatical) success: on the impact of metalinguistic explanations on young learners’ metalinguistic awareness and language learning aptitude
- Variability in young learners’ English proficiency gains: The impact of learning context and learner background factors
- Anxiety, enjoyment, and boredom in language learning amongst junior secondary students in rural China: How do they contribute to L2 achievement?
- THE EFFECTS OF IMMEDIATE AND DELAYED CORRECTIVE FEEDBACK ON L2 DEVELOPMENT
- CONFLICTING EVIDENCE OF EXPLICIT AND IMPLICIT KNOWLEDGE FROM OBJECTIVE AND SUBJECTIVE MEASURES
- LEARNING CONDITION, LINGUISTIC COMPLEXITY, AND FIRST LANGUAGE TRANSFER IN SEMIARTIFICIAL LANGUAGE LEARNING
- Understanding pre-adolescent learners’ foreign language enjoyment: a mixed-methods study on Chinese primary school students of English
- Effectiveness of Artificial Intelligence (AI) in language teaching
- Reducing anxiety in the foreign language classroom: A positive psychology approach
- Regulated learning and self-efficacy beliefs in peer collaborative writing: An exploratory study of L2 learners’ written products, task discussions, and self-reports
- Extensive viewing in young English as a foreign language learners
- Multilingual, bilingual, and monolingual Arabic teachers’ development of learner self‐regulation and language awareness in the Emirates
- Foreign language reading anxiety and its correlates: a meta-analysis
- Eta- and partial eta-squared in L2 research: A cautionary review and guide to more appropriate usage
- The impact of CLIL intensity and extramural English on the receptive skills of young EFL learners
- Assessing L1 Mandarin and L2 English influence on the L3 production of French obstruent coda voicing
- Effects of using the WhatsApp application on language learners motivation: a controlled investigation using structural equation modelling
- Effects of different input modes on blended EFL speaking instruction: a quasi-experimental study
- Using Expectancy Value Theory to understand motivation, persistence, and achievement in university‐level foreign language learning
- Task-Based Versus Task-Supported Language Instruction: An Experimental Study
- The capacity of ChatGPT-4 for L2 writing assessment: A closer look at accuracy, specificity, and relevance
- Task-Based Learner Production: A Substantive and Methodological Review
- Interpreting the relationships between TOEFL iBT scores and GPA: Language proficiency, policy, and profiles
- Task design, L1 literacy, and second language oracy
- First language effects on incidental vocabulary learning through bimodal input
- Understanding indirect meaning: A close replication
- Exploring the potential of using an AI language model for automated essay scoring
- Speaking performances, stakeholder perceptions, and test scores: Extrapolating from the Duolingo English test to the university
- Second language speech comprehensibility and acceptability in academic settings: Listener perceptions and speech stream influences
- Revisiting US Undergraduate Perceptions of Non-native English Varieties: From Millennials to Generation Z
- Effects of different forms of explicit instruction on L2 development: A meta‐analysis
- Conceptualisation and measurement of foreign language learning burnout among Chinese EFL students
- Unravelling the relationship between language anxiety and foreign language speech fluency in a monologue production
- L2 Gamers' Use of Learning and Communication Strategies in Massively Multiplayer Online Games (MMOs)
- A Meta-analysis of L2 Willingness to Communicate and Its Three High-Evidence Correlates
- A Comparative Study of Two Scales for Foreign Language Classroom Enjoyment
- Future selves, enjoyment and anxiety as predictors of L2 writing achievement
- Do mobile games improve language learning? A meta-analysis
- Tracing the diachronic effects of data-driven learning on lexical complexity in EFL learners’ argumentative writing
- Understanding the potential role of GenAI-mediated informal digital learning of English (GenAI-IDLE) in the Global South: AI literacy, emotions, and willingness to communicate as outcomes
- The effect of high-immersion virtual reality environments on L2 learners’ socio-emotional variables: A meta-analysis
- Trait Emotional Intelligence and Classroom Emotions: A Positive Psychology Investigation and Intervention Among Chinese EFL Learners. [europepmc]
- An Extensive Knowledge Mapping Review of Measurement and Validity in Language Assessment and SLA Research. [europepmc]
- Examining the Relationship Between Grit and Foreign Language Performance: Enjoyment and Anxiety as Mediators. [europepmc]
- Migrants With Schizophrenia in Forensic Psychiatric Hospitals Benefit From High-Intensity Second Language Programs. [europepmc]
- A systematic review of screen-time literature to inform educational policy and practice during COVID-19. [europepmc]
- Conceptualization and Measurement of Flow in a Chinese Blended English as a Foreign Language Learning Context. [europepmc]
- Dual Coding or Cognitive Load? Exploring the Effect of Multimodal Input on English as a Foreign Language Learners' Vocabulary Learning. [europepmc]
- How Does the Optimism of Students Learning a Foreign Language Affect Their Creative Self-Efficacy? The Mediating Effects of Hope and Empathy. [europepmc]
- The Predicative Power of Learner and Teacher Variables on Flow in a Chinese Blended English as a Foreign Language Learning Context. [europepmc]
- How Accurate Is Your Correlation? Different Methods Derive Different Results and Different Interpretations. [europepmc]
- The Relationship Between Foreign Language Classroom Anxiety, Enjoyment, and Expectancy-Value Motivation and Their Predictive Effects on Chinese High School Students' Self-Rated Foreign Language Proficiency. [europepmc]
- The roles of motivation, anxiety and learning strategies in online Chinese learning among Thai learners of Chinese as a foreign language. [europepmc]
- Examining the relationship between perceived teacher support and students' academic engagement in foreign language learning: Enjoyment and boredom as mediators. [europepmc]
- Students' Isolation Challenges in Blended EFL Learning During COVID-19: How Can Social Presence and Interaction Help Develop Sense of Community? [europepmc]
- The effectiveness of self-regulated learning (SRL) interventions on L2 learning achievement, strategy employment and self-efficacy: A meta-analytic study. [europepmc]
- Motivation in second language acquisition: A bibliometric analysis between 2000 and 2021. [europepmc]
- Measuring Chinese English-as-a-foreign-language learners' resilience: Development and validation of the foreign language learning resilience scale. [europepmc]
- Connecting foreign language enjoyment and English proficiency levels: The mediating role of L2 motivation. [europepmc]
- Unpacking the relationships between emotions and achievement of EFL learners in China: Engagement as a mediator. [europepmc]
- The predictive effect of subjective well-being and stress on foreign language enjoyment: The mediating effect of positive language education. [europepmc]
- The Impact of Altruistic Teaching on English as a Foreign Language (EFL) Learners' Emotion Regulation: An Intervention Study. [europepmc]
- Teacher support, grit and L2 willingness to communicate: the mediating effect of foreign language enjoyment. [europepmc]
- Emotional factor matters in language learning? A meta-analysis of emotional intelligence on language achievement. [europepmc]
- Modeling the relationships between growth language mindset, L2 grit, and foreign language learning burnout. [europepmc]
- The impact of anxiety on Chinese as a second language achievement: a meta-analytic perspective. [europepmc]
Related