文献类型：期刊文献

英文题名：Spatial-frequency convolutional self-attention network for EEG emotion recognition

作者：Li, Dongdong[1];Xie, Li[1];Chai, Bing[1];Wang, Zhe[1];Yang, Hai[1]

机构：[1]East China Univ Sci & Technol, Dept Comp Sci & Engn, Shanghai 200237, Peoples R China

年份：2022

卷号：122

外文期刊名：APPLIED SOFT COMPUTING

收录：;EI(收录号：20221611992941);WOS:【SCI-EXPANDED(收录号:WOS:000793559700008)】；

基金：This work is supported by the National Key Research and Development Program of China under Grant No. 2021YFC2701800, Natural Science Foundation of China under Grant No. 61806078, No. 62076094, Shanghai Science and Technology Program "Distributed and generative few-shot algorithm and theory research" under Grant No. 20511100600.

语种：英文

外文关键词：Electroencephalogram; Emotion recognition; Spatial-frequency convolutional self-attention network (SFCSAN); Spatial; Frequency

摘要：Recently, the combination of neural network and attention mechanism is widely employed for electroencephalogram (EEG) emotion recognition (EER) and has achieved remarkable results. Never-theless, most of them ignored the individual information in and within different frequency bands, so they just applied a single-layer attention mechanism to the entire EEG signals, with relatively single feature expression. To overcome the shortcoming, a spatial-frequency convolutional self-attention network (SFCSAN) is proposed in this paper to integrate the feature learning from both spatial and frequency domain of EEG signals. In this model, the intra-frequency band self-attention is employed to learn frequency information from each frequency band, and inter-frequency band mapping further maps them into final attention representation to learn their complementary frequency information. Additionally, a parallel convolutional neural network (PCNN) layer is used to excavate the spatial information of EEG signals. By incorporating spatial and frequency band information, the SFCSAN can fully utilize the spatial and frequency domain information of EEG signals for emotion recognition. The experiments conducted on two public EEG emotion datasets achieved the average accuracy of 95.15%/95.76%/95.64%/95.86% on valence/arousal/dominance/liking label for DEAP dataset, and 93.77%/95.80%/96.26% on valence/arousal/dominance label for DREAMER dataset, which all demonstrate that the proposed method is conducive to enhancing the importing of emotion-salient information and generating better recognition performance. The code of our work is available on "https://github.com/qeebeast7/SFCSAN''. (C)& nbsp;2022 Elsevier B.V. All rights reserved.