PhoWhisper: Automatic Speech Recognition for Vietnamese

2024/03/27 by Thanh-Thien Le, Le, Thanh-Thien, Linh The Nguyen +3 · 4 citations
Computer Science · #Speech Recognition and Synthesis #Speech and Audio Processing #Natural Language Processing Techniques

paper · pdf · doi:10.48550/arxiv.2406.02555

Abstract

We introduce PhoWhisper in five versions for Vietnamese automatic speech recognition. PhoWhisper's robustness is achieved through fine-tuning the Whisper model on an 844-hour dataset that encompasses diverse Vietnamese accents. Our experimental study demonstrates state-of-the-art performances of PhoWhisper on benchmark Vietnamese ASR datasets. We have open-sourced PhoWhisper at: https://github.com/VinAIResearch/PhoWhisper

Cited by

• VietLyrics: A Large-Scale Dataset and Models for Vietnamese Automatic Lyrics Transcription
• TSPC: A Two-Stage Phoneme-Centric Architecture for code-switching Vietnamese-English Speech Recognition
• Whisper based Cross-Lingual Phoneme Recognition between Vietnamese and English
• Flavors of Moonshine: Tiny Specialized ASR Models for Edge Devices

Related

• Whisper based Cross-Lingual Phoneme Recognition between Vietnamese and English
• VietASR: Achieving Industry-level Vietnamese ASR with 50-hour labeled data and Large-Scale Speech Pretraining
• TSPC: A Two-Stage Phoneme-Centric Architecture for code-switching Vietnamese-English Speech Recognition
• ViCocktail: Automated Multi-Modal Data Collection for Vietnamese Audio-Visual Speech Recognition
• VietMed: A Dataset and Benchmark for Automatic Speech Recognition of Vietnamese in the Medical Domain