ESPnet-ST: All-in-One Speech Translation Toolkit

2020/04/21 by Inaguma, Hirofumi, Kiyono, Shun, Duh, Kevin +4 · 1 citation
#Audio and Speech Processing (eess.AS) #Computation and Language (cs.CL) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering

paper · doi:10.48550/arxiv.2004.10234

Abstract

We present ESPnet-ST, which is designed for the quick development of speech-to-speech translation systems in a single framework. ESPnet-ST is a new project inside end-to-end speech processing toolkit, ESPnet, which integrates or newly implements automatic speech recognition, machine translation, and text-to-speech functions for speech translation. We provide all-in-one recipes including data pre-processing, feature extraction, training, and decoding pipelines for a wide range of benchmark datasets. Our reproducible results can match or even outperform the current state-of-the-art performances; these pre-trained models are downloadable. The toolkit is publicly available at https://github.com/espnet/espnet.

Cited by

• End-to-End Speech Translation for Low-Resource Languages Using Weakly Labeled Data

Related

• ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit
• ESPnet-SLU: Advancing Spoken Language Understanding through ESPnet
• The 2020 ESPnet update: new features, broadened applications, performance improvements, and future plans
• ESPnet-SE++: Speech Enhancement for Robust Speech Recognition, Translation, and Understanding
• ESPnet-ST IWSLT 2021 Offline Speech Translation System