2025/02/14 by Abubakir Siedahmed, Siedahmed, Abubakir, Pei, Yanping +9
Computer Science · #Applications (stat.AP) #Computer science #Data science #FOS: Computer and information sciences #Knowledge management #Methodology (stat.ME) #Online Learning and Analytics
paper · pdf · doi:10.48550/arxiv.2502.10545
openalex publication_date 2025/02/14 · openalex created_date 2025/10/10 · openalex updated_date 2026/08/05
Computer-based learning platforms (CBLPs) have become a common medium in schools, transforming how students learn and interact with educational content. However, researchers still lack adequate tools to address the diverse set of challenges that students face in these environments. In this paper, we introduce Ed-Tech Research Infrastructure to Advance Learning Sciences (E-TRIALS), a free tool developed by ASSISTments to help researchers conduct randomized controlled trials in the realm of learning sciences. We describe its features, the types of experiments it supports, and how it can address critical research questions. We showcase E-TRIALS' capabilities through two real-world interventions. Finally, we evaluate the efficacy of interventions using three average treatment effect (ATE) estimators. Student's t-test, regression, and Leave-One-Out Potential outcomes (LOOP). The results demonstrate that the unbiased LOOP estimator can achieve greater precision by adjusting for baseline covariates compared to the Student's t test. Our work demonstrates the potential of E-TRIALS to advance research and contribute to the development of more effective, inclusive, and adaptive CBLP. The code used for this work is available at https://osf.io/xp6ch/.