Representation Learning with Graph Neural Networks for Speech Emotion Recognition

2022/08/21 by Junghun Kim, Kim, Junghun, Jihie Kim +1
Psychology · Computer Science · #Emotion and Mood Recognition #Sentiment Analysis and Opinion Mining #Advanced Graph Neural Networks

paper · pdf · doi:10.48550/arxiv.2208.09830

Abstract

Learning expressive representation is crucial in deep learning. In speech emotion recognition (SER), vacuum regions or noises in the speech interfere with expressive representation learning. However, traditional RNN-based models are susceptible to such noise. Recently, Graph Neural Network (GNN) has demonstrated its effectiveness for representation learning, and we adopt this framework for SER. In particular, we propose a cosine similarity-based graph as an ideal graph structure for representation learning in SER. We present a Cosine similarity-based Graph Convolutional Network (CoGCN) that is robust to perturbation and noise. Experimental results show that our method outperforms state-of-the-art methods or provides competitive results with a significant model size reduction with only 1/30 parameters.

Related

• Compact Graph Architecture for Speech Emotion Recognition
• Knowledge Transfer For On-Device Speech Emotion Recognition with Neural Structured Learning
• SDR-GNN: Spectral Domain Reconstruction Graph Neural Network for Incomplete Multimodal Learning in Conversational Emotion Recognition
• Long-Short Distance Graph Neural Networks and Improved Curriculum Learning for Emotion Recognition in Conversation
• S+PAGE: A Speaker and Position-Aware Graph Neural Network Model for Emotion Recognition in Conversation