文献类型：期刊文献

英文题名：Semi-supervised EEG emotion recognition model based on enhanced graph fusion and GCN

作者：Li, Guangqiang[1];Chen, Ning[1];Jin, Jing[1]

机构：[1]East China Univ Sci & Technol, Sch Informat Sci & Engn, Shanghai 200237, Peoples R China

年份：2022

卷号：19

期号：2

外文期刊名：JOURNAL OF NEURAL ENGINEERING

收录：;EI(收录号：20221712042599);WOS:【SCI-EXPANDED(收录号:WOS:000782497500001)】；

基金：This work was supported by the National Natural Science Foundation of China [Grant Number 61771196]. I'd like to thank Saeedeh Bahrami for providing the code of the AMSSL scheme in [29]. The authors would like to thank the anonymous reviewers and the associate editor for their insightful comments that significantly improved the quality of this paper.

语种：英文

外文关键词：EEG; emotion recognition; Graph Convolutional Network (GCN); graph fusion; network enhancement

摘要：Objective. To take full advantage of both labeled data and unlabeled ones, the Graph Convolutional Network (GCN) was introduced in electroencephalography (EEG) based emotion recognition to achieve feature propagation. However, a single feature cannot represent the emotional state entirely and precisely due to the instability of the EEG signal and the complexity of the emotional state. In addition, the noise existing in the graph may affect the performance greatly. To solve these problems, it was necessary to introduce feature/similarity fusion and noise reduction strategies. Approach. A semi-supervised EEG emotion recognition model combining graph fusion, network enhancement, and feature fusion was proposed. Firstly, different features were extracted from EEG and then compacted by Principal Component Analysis (PCA), respectively. Secondly, a Sample-by-sample Similarity Matrix (SSM) was constructed based on each feature, and similarity network fusion (SNF) was adopted to fuse the graphs corresponding to different SSMs to take advantage of their complementarity. Then, Network Enhancement (NE) was performed on the fused graph to reduce the noise in it. Finally, GCN was performed on the concatenated features and the enhanced fused graph to achieve feature propagation. Main results. Experimental results demonstrated that: (a) When 5.30% of SEED and 7.20% of SEED-IV samples were chosen as the labeled samples, respectively, the minimum classification accuracy improvement achieved by the proposed scheme over state-of-the-art schemes were 1.52% on SEED and 13.14% on SEED-IV, respectively. (b) When 8.00% of SEED and 9.60% of SEED-IV samples were chosen as the labeled samples, respectively, the minimum training time reduction achieved by the proposed scheme over state-of-the-art schemes were 46.75 s and 22.55 s, respectively. (c) Graph fusion, network enhancement, and feature fusion all contributed to the performance enhancement. (d) The key hyperparameters that affect the performance were relatively few and easy to set to obtain outstanding performance. Significance. This paper demonstrated that the combination of graph fusion, network enhancement, and feature fusion help to enhance GCN-based EEG emotion recognition.