vix.ing · top · new · best · stats · spec

Do intelligent tutoring systems benefit K-12 students? A meta-analysis and evaluation of heterogeneity of treatment effects in the U.S

2025/11/07 by Leite, Walter L., Zhang, Huibin, Rana, Shibani +4
Computer Science · Decision Sciences · Social Sciences · #FOS: Computer and information sciences #Global Educational Reforms and Inequalities #Human-Computer Interaction (cs.HC) #Intelligent Tutoring Systems and Adaptive Learning #Psychometric Methodologies and Testing

paper · doi:10.48550/arxiv.2511.04997

openalex publication_date 2025/11/07 · openalex created_date 2025/11/11 · openalex updated_date 2026/07/28

Abstract

To expand the use of intelligent tutoring systems (ITS) in K-12 schools, it is essential to understand the conditions under which their use is most beneficial. This meta-analysis evaluated the heterogeneity of ITS effects across studies focusing on elementary, middle, and high schools in the U.S. It included 18 studies with 77 effect sizes across 11 ITS. Overall, there was a significant positive effect size of ITS on U.S. K-12 students' learning outcomes (g=0.271, SE=0.011, p=0.001). Furthermore, effect sizes were similar across elementary and middle schools, and for low-achieving students, but were lower in studies including rural schools. A MetaForest analysis showed that providing worked-out examples, intervention duration, intervention condition, type of learning outcome, and immediate measurement were the most important moderators of treatment effects.

Related