State-of-the-art Speech Recognition using EEG and Towards Decoding of Speech Spectrum From EEG

2019/08/14 by Krishna, Gautam, Han, Yan, Tran, Co +2
#Audio and Speech Processing (eess.AS) #FOS: Computer and information sciences #FOS: Electrical engineering #Sound (cs.SD) #electronic engineering #information engineering

paper · doi:10.48550/arxiv.1908.05743

Abstract

In this paper we first demonstrate continuous noisy speech recognition using electroencephalography (EEG) signals on English vocabulary using different types of state of the art end-to-end automatic speech recognition (ASR) models, we further provide results obtained using EEG data recorded under different experimental conditions. We finally demonstrate decoding of speech spectrum from EEG signals using a long short term memory (LSTM) based regression model and Generative Adversarial Network (GAN) based model. Our results demonstrate the feasibility of using EEG signals for continuous noisy speech recognition under different experimental conditions and we provide preliminary results for synthesis of speech from EEG features.

Related

• Speech Recognition with no speech or with noisy speech
• Improving EEG based continuous speech recognition using GAN
• EEG based Continuous Speech Recognition using Transformers
• Continuous Silent Speech Recognition using EEG
• Analysis of EEG frequency bands for Envisioned Speech Recognition