2021/10/13 by Anuj Saraswat, Saraswat, Anuj, Mehar Bhatia +6
Psychology · Social Sciences · #Computation and Language (cs.CL) #FOS: Computer and information sciences #Language Development and Disorders #Multilingual Education and Policy #Phonetics and Phonology Research
paper · pdf · doi:10.48550/arxiv.2110.06507
openalex publication_date 2021/10/13 · openalex created_date 2025/10/10 · openalex updated_date 2026/07/28
Recent studies in speech perception have been closely linked to fields of cognitive psychology, phonology, and phonetics in linguistics. During perceptual attunement, a critical and sensitive developmental trajectory has been examined in bilingual and monolingual infants where they can best discriminate common phonemes. In this paper, we compare and identify these cognitive aspects on deep neural-based visual lip-reading models. We conduct experiments on the two most extensive public visual speech recognition datasets for English and Mandarin. Through our experimental results, we observe a strong correlation between these theories in cognitive psychology and our unique modeling. We inspect how these computational models develop similar phases in speech perception and acquisitions.