Improved Language Identification Through Cross-Lingual Self-Supervised Learning

2021/07/08 by Tjandra, Andros, Choudhury, Diptanu Gon, Zhang, Frank +6
#Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering

paper · doi:10.48550/arxiv.2107.04082

Abstract

Language identification greatly impacts the success of downstream tasks such as automatic speech recognition. Recently, self-supervised speech representations learned by wav2vec 2.0 have been shown to be very effective for a range of speech tasks. We extend previous self-supervised work on language identification by experimenting with pre-trained models which were learned on real-world unconstrained speech in multiple languages and not just on English. We show that models pre-trained on many languages perform better and enable language identification systems that require very little labeled data to perform well. Results on a 26 languages setup show that with only 10 minutes of labeled data per language, a cross-lingually pre-trained model can achieve over 89.2% accuracy.

Related

• Accidental Learners: Spoken Language Identification in Multilingual Self-Supervised Models
• Unsupervised Cross-lingual Representation Learning for Speech\n Recognition
• Simple and Effective Zero-shot Cross-lingual Phoneme Recognition
• Self-supervised Adaptive Pre-training of Multilingual Speech Models for Language and Dialect Identification
• XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale