vix.ing · top · new · best · stats · spec

Locally temporal-spatial pattern learning with graph attention mechanism for EEG-based emotion recognition

2022/08/19 by Yiwen Zhu, Zhu, Yiwen, Kaiyu Gan +3
Neuroscience · Psychology · #Artificial Intelligence (cs.AI) #Computer Vision and Pattern Recognition (cs.CV) #EEG and Brain-Computer Interfaces #Emotion and Mood Recognition #FOS: Computer and information sciences #FOS: Electrical engineering #Functional Brain Connectivity Studies #Human-Computer Interaction (cs.HC) #Machine Learning (cs.LG) #Signal Processing (eess.SP) #electronic engineering #information engineering

paper · pdf · doi:10.48550/arxiv.2208.11087

openalex publication_date 2022/08/19 · openalex created_date 2022/08/25 · openalex updated_date 2026/07/28

Abstract

Technique of emotion recognition enables computers to classify human affective states into discrete categories. However, the emotion may fluctuate instead of maintaining a stable state even within a short time interval. There is also a difficulty to take the full use of the EEG spatial distribution due to its 3-D topology structure. To tackle the above issues, we proposed a locally temporal-spatial pattern learning graph attention network (LTS-GAT) in the present study. In the LTS-GAT, a divide-and-conquer scheme was used to examine local information on temporal and spatial dimensions of EEG patterns based on the graph attention mechanism. A dynamical domain discriminator was added to improve the robustness against inter-individual variations of the EEG statistics to learn robust EEG feature representations across different participants. We evaluated the LTS-GAT on two public datasets for affective computing studies under individual-dependent and independent paradigms. The effectiveness of LTS-GAT model was demonstrated when compared to other existing mainstream methods. Moreover, visualization methods were used to illustrate the relations of different brain regions and emotion recognition. Meanwhile, the weights of different time segments were also visualized to investigate emotion sparsity problems.

Related