vix.ing · top · new · best · stats · spec

Assessing the validity of new paradigmatic complexity measures as criterial features for proficiency in L2 writings in English

2025/03/13 by Cyrielle Mallart, Andrew J. Simpkin, Mallart, Cyriel +13
Computer Science · Social Sciences · #Computation and Language (cs.CL) #Educational Innovations and Challenges #Educational Methods and Teacher Development #FOS: Computer and information sciences #Foreign Language Teaching Methods #Machine Learning (cs.LG)

paper · pdf · doi:10.48550/arxiv.2503.10220

openalex publication_date 2025/03/13 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28

Abstract

This article addresses Second Language (L2) writing development through an investigation of new grammatical and structural complexity metrics. We explore the paradigmatic production in learner English by linking language functions to specific grammatical paradigms. Using the EFCAMDAT as a gold standard and a corpus of French learners as an external test set, we employ a supervised learning framework to operationalise and evaluate seven microsystems. We show that learner levels are associated with the seven microsystems (MS). Using ordinal regression modelling for evaluation, the results show that all MS are significant but yield a low impact if taken individually. However, their influence is shown to be impactful if taken as a group. These microsystems and their measurement method suggest that it is possible to use them as part of broader-purpose CALL systems focused on proficiency assessment.

Related