Speech Synthesis using EEG

2020/02/22 by Krishna, Gautam, Tran, Co, Han, Yan +1 · 1 citation
#Audio and Speech Processing (eess.AS) #FOS: Biological sciences #FOS: Computer and information sciences #FOS: Electrical engineering #Machine Learning (cs.LG) #Machine Learning (stat.ML) #Quantitative Methods (q-bio.QM) #Sound (cs.SD) #electronic engineering #information engineering

paper · doi:10.48550/arxiv.2002.12756

Abstract

In this paper we demonstrate speech synthesis using different electroencephalography (EEG) feature sets recently introduced in [1]. We make use of a recurrent neural network (RNN) regression model to predict acoustic features directly from EEG features. We demonstrate our results using EEG features recorded in parallel with spoken speech as well as using EEG recorded in parallel with listening utterances. We provide EEG based speech synthesis results for four subjects in this paper and our results demonstrate the feasibility of synthesizing speech directly from EEG features.

Cited by

• Decoding Speaker-Normalized Pitch from EEG for Mandarin Perception

Related

• Generating EEG features from Acoustic features
• Predicting Different Acoustic Features from EEG and towards direct synthesis of Audio Waveform from EEG
• Advancing Speech Synthesis using EEG
• Neural networks based EEG-Speech Models
• Spoken Speech Enhancement using EEG