Automated evaluation of children's speech fluency for low-resource languages

2025/05/26 by Zhang, Bowen, Latiff, Nur Afiqah Abdul, Kan, Justin +4 · 1 citation
#Artificial Intelligence (cs.AI) #Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering

paper · doi:10.48550/arxiv.2505.19671

Abstract

Assessment of children's speaking fluency in education is well researched for majority languages, but remains highly challenging for low resource languages. This paper proposes a system to automatically assess fluency by combining a fine-tuned multilingual ASR model, an objective metrics extraction stage, and a generative pre-trained transformer (GPT) network. The objective metrics include phonetic and word error rates, speech rate, and speech-pause duration ratio. These are interpreted by a GPT-based classifier guided by a small set of human-evaluated ground truth examples, to score fluency. We evaluate the proposed system on a dataset of children's speech in two low-resource languages, Tamil and Malay and compare the classification performance against Random Forest and XGBoost, as well as using ChatGPT-4o to predict fluency directly from speech input. Results demonstrate that the proposed approach achieves significantly higher accuracy than multimodal GPT or other methods.

Cited by

• CLARITY: Contextual Linguistic Adaptation and Accent Retrieval for Dual-Bias Mitigation in Text-to-Speech Generation

Related

• Speaker Fluency Level Classification Using Machine Learning Techniques
• Non-native Children's Automatic Speech Assessment Challenge (NOCASA)
• An ASR-free Fluency Scoring Approach with Self-Supervised Learning
• A Dataset for measuring reading levels in India at scale
• Predicting lexical skills from oral reading with acoustic measures