Leveraging translations for speech transcription in low-resource settings

2018/03/23 by Anastasopoulos, Antonis, Chiang, David · 1 citation
#Computation and Language (cs.CL) #FOS: Computer and information sciences

paper · doi:10.48550/arxiv.1803.08991

Abstract

Recently proposed data collection frameworks for endangered language documentation aim not only to collect speech in the language of interest, but also to collect translations into a high-resource language that will render the collected resource interpretable. We focus on this scenario and explore whether we can improve transcription quality under these extremely low-resource settings with the assistance of text translations. We present a neural multi-source model and evaluate several variations of it on three low-resource datasets. We find that our multi-source model with shared attention outperforms the baselines, reducing transcription character error rate by up to 12.3%.

Cited by

• Breaking the Transcription Bottleneck: Fine-tuning ASR Models for Extremely Low-Resource Fieldwork Languages

Related

• A case study on using speech-to-translation alignments for language\n documentation
• Low-Resource Speech-to-Text Translation
• Enabling Interactive Transcription in an Indigenous Community
• AlloST: Low-resource Speech Translation without Source Transcription
• Leveraging End-to-End ASR for Endangered Language Documentation: An Empirical Study on Yoloxóchitl Mixtec