{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,24]],"date-time":"2026-07-24T09:49:11Z","timestamp":1784886551842,"version":"3.55.0"},"reference-count":36,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2024,5,27]],"date-time":"2024-05-27T00:00:00Z","timestamp":1716768000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Social Science Foundation of China","award":["BCA220220"],"award-info":[{"award-number":["BCA220220"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Human emotions are complex psychological and physiological responses to external stimuli. Correctly identifying and providing feedback on emotions is an important goal in human\u2013computer interaction research. Compared to facial expressions, speech, or other physiological signals, using electroencephalogram (EEG) signals for the task of emotion recognition has advantages in terms of authenticity, objectivity, and high reliability; thus, it is attracting increasing attention from researchers. However, the current methods have significant room for improvement in terms of the combination of information exchange between different brain regions and time\u2013frequency feature extraction. Therefore, this paper proposes an EEG emotion recognition network, namely, self-organized graph pesudo-3D convolution (SOGPCN), based on attention and spatiotemporal convolution. Unlike previous methods that directly construct graph structures for brain channels, the proposed SOGPCN method considers that the spatial relationships between electrodes in each frequency band differ. First, a self-organizing map is constructed for each channel in each frequency band to obtain the 10 most relevant channels to the current channel, and graph convolution is employed to capture the spatial relationships between all channels in the self-organizing map constructed for each channel in each frequency band. Then, pseudo-three-dimensional convolution combined with partial dot product attention is implemented to extract the temporal features of the EEG sequence. Finally, LSTM is employed to learn the contextual information between adjacent time-series data. Subject-dependent and subject-independent experiments are conducted on the SEED dataset to evaluate the performance of the proposed SOGPCN method, which achieves recognition accuracies of 95.26% and 94.22%, respectively, indicating that the proposed method outperforms several baseline methods.<\/jats:p>","DOI":"10.3390\/s24113464","type":"journal-article","created":{"date-parts":[[2024,5,28]],"date-time":"2024-05-28T03:48:49Z","timestamp":1716868129000},"page":"3464","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["EEG Emotion Recognition Network Based on Attention and Spatiotemporal Convolution"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8493-1931","authenticated-orcid":false,"given":"Xiaoliang","family":"Zhu","sequence":"first","affiliation":[{"name":"National Engineering Research Center of Educational Big Data, Central China Normal University, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chen","family":"Liu","sequence":"additional","affiliation":[{"name":"National Engineering Research Center of Educational Big Data, Central China Normal University, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liang","family":"Zhao","sequence":"additional","affiliation":[{"name":"National Engineering Research Center of Educational Big Data, Central China Normal University, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shengming","family":"Wang","sequence":"additional","affiliation":[{"name":"National Engineering Research Center of Educational Big Data, Central China Normal University, Wuhan 430079, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,5,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/j.neucom.2019.10.096","article-title":"A GPSO-Optimized Convolutional Neural Networks for EEG-Based Emotion Recognition","volume":"380","author":"Gao","year":"2020","journal-title":"Neurocomputing"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"11907","DOI":"10.1109\/ACCESS.2020.2966144","article-title":"Emotion Feature Analysis and Recognition Based on Reconstructed EEG Sources","volume":"8","author":"Chen","year":"2020","journal-title":"IEEE Access"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"923","DOI":"10.1007\/s13042-019-01056-8","article-title":"Emotion Recognition Using Multimodal Deep Learning in Multiple Psychophysiological Signals and Video","volume":"11","author":"Wang","year":"2020","journal-title":"Int. J. Mach. Learn. Cybern."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1016\/j.neubiorev.2017.06.016","article-title":"Mechanisms of Facial Emotion Recognition in Autism Spectrum Disorders: Insights from Eye Tracking and Electroencephalography","volume":"80","author":"Black","year":"2017","journal-title":"Neurosci. Behav. Rev."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1007\/s00779-011-0479-9","article-title":"Ubiquitous Emotion-Aware Computing proceedings of the ubiquitous computing","volume":"17","author":"Broek","year":"2013","journal-title":"Pers. Ubiquitous Comput."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1161","DOI":"10.1037\/h0077714","article-title":"A Circumplex Model of Affect","volume":"39","author":"Russell","year":"1980","journal-title":"J. Personal. Soc. Psychol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"244","DOI":"10.3389\/fnins.2014.00244","article-title":"A Brain-Computer Interface for Potential Nonverbal Facial Communication Based on EEG Signals Related to Specific Emotions","volume":"8","author":"Kashihara","year":"2014","journal-title":"Front. Neurosci."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Tripathi, S., Acharya, S., Sharma, R., Mittal, S., and Bhattacharya, S. (2017, January 4\u20139). Using Deep and Convolutional Neural Networks for Accurate Emotion Classification on DEAP Dataset. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence(AAAI), San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i2.19105"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Al-Nafjan, A., Hosny, M., Al-Ohali, Y., and Al-Wabil, A. (2018, January 7\u20139). Recognition of Affective States via Electroencephalogram Analysis and Classification. Proceedings of the 1st International Conference on Intelligent Human Systems Integration(IHSI), Advances in Intelligent Systems and Computing, Dubai, United Arab Emirates.","DOI":"10.1007\/978-3-319-73888-8_38"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"155724","DOI":"10.1109\/ACCESS.2019.2949707","article-title":"The Fusion of Electroencephalography and Facial Expression for Continuous Emotion Recognition","volume":"7","author":"Li","year":"2019","journal-title":"IEEE Access"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Ding, Y., Robinson, N., Tong, C., Zeng, Q., and Guan, C. (2023). LGGNet: Learning from Local-Global-Graph Representations for Brain-Computer Interface. IEEE Trans. Neural Netw. Learn. Syst., 1\u201314. early access.","DOI":"10.1109\/TNNLS.2023.3236635"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2238","DOI":"10.1109\/TAFFC.2022.3169001","article-title":"TSception: Capturing Temporal Dynamics and Spatial Asymmetry from EEG for Emotion Recognition","volume":"14","author":"Ding","year":"2023","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"611653","DOI":"10.3389\/fnins.2021.611653","article-title":"Cross-Subject EEG Emotion Recognition with Self-Organized Graph Neural Network","volume":"15","author":"Li","year":"2021","journal-title":"Front. Neurosci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1290","DOI":"10.1109\/TAFFC.2020.2994159","article-title":"EEG-Based Emotion Recognition Using Regularized Graph Neural Networks","volume":"13","author":"Zhong","year":"2020","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"12064","DOI":"10.1007\/s10489-021-03070-2","article-title":"EEG Emotion Recognition Using Multichannel Weighted Multiscale Permutation Entropy","volume":"52","author":"Wang","year":"2022","journal-title":"Appl. Intell."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zhu, X., Rong, W., Zhao, L., He, Z., Yang, Q., Sun, J., and Liu, G. (2022). EEG Emotion Classification Network Based on Attention Fusion of Multi-channel Band Features. Sensors, 22.","DOI":"10.3390\/s22145252"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"108740","DOI":"10.1016\/j.asoc.2022.108740","article-title":"Spatial-Frequency Convolutional Self-Attention Network for EEG Emotion Recognition","volume":"122","author":"Li","year":"2022","journal-title":"Appl. Soft Comput."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1109\/TAFFC.2020.3025777","article-title":"EEG-Based Emotion Recognition via Channel-Wise Attention and Self Attention","volume":"14","author":"Tao","year":"2020","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"805","DOI":"10.1007\/s11571-021-09751-5","article-title":"4D Attention-Based Neural Network for EEG Emotion Recognition","volume":"16","author":"Xiao","year":"2022","journal-title":"Cogn. Neurodyn."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/TNNLS.2020.2978386","article-title":"A Comprehensive Survey on Graph Neural Networks","volume":"32","author":"Wu","year":"2021","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1109\/TAFFC.2018.2817622","article-title":"EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks","volume":"11","author":"Song","year":"2018","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1016\/j.neucom.2021.02.048","article-title":"A Novel Transferability Attention Neural Network Model for EEG Emotion Recognition","volume":"447","author":"Li","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1109\/TAMD.2015.2431497","article-title":"Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks","volume":"7","author":"Zheng","year":"2015","journal-title":"IEEE Trans. Auton. Ment. Dev."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1109\/TPAMI.2012.59","article-title":"3D Convolutional Neural Networks for Human Action Recognition","volume":"35","author":"Ji","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Qiu, Z., Yao, T., and Mei, T. (2017, January 22\u201329). Learning Spatiotemporal Representation with Pseudo-3D Residual Networks. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.590"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"3513","DOI":"10.1109\/TNSRE.2023.3309542","article-title":"3DSleepNet: A Multi-Channel Bio-Signal Based Sleep Stages Classification Method Using Deep Learning","volume":"31","author":"Ji","year":"2023","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2222","DOI":"10.1109\/TNNLS.2016.2582924","article-title":"LSTM: A Search Space Odyssey","volume":"28","author":"Greff","year":"2017","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhu, X., Liu, G., Zhao, L., Rong, W., Sun, J., and Liu, R. (2023). Emotion Classification from Multi-Band Electroencephalogram Data Using Dynamic Simplifying Graph Convolutional Network and Channel Style Recalibration Module. Sensors, 23.","DOI":"10.3390\/s23041917"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1109\/TNN.2010.2091281","article-title":"Domain Adaptation via Transfer Component Analysis","volume":"22","author":"Pan","year":"2011","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Fernando, B., Habrard, A., Sebban, M., and Tuytelaars, T. (2013, January 1\u20138). Unsupervised Visual Domain Adaptation Using Subspace Alignment. Proceedings of the 2013 IEEE International Conference on Computer Vision (ICCV), Sydney, NSW, Australia.","DOI":"10.1109\/ICCV.2013.368"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1109\/TCDS.2020.2999337","article-title":"A Novel Bi-Hemispheric Discrepancy Model for EEG Emotion Recognition","volume":"13","author":"Li","year":"2020","journal-title":"IEEE Trans. Cogn. Dev. Syst."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"494","DOI":"10.1109\/TAFFC.2018.2885474","article-title":"A Bi-Hemisphere Domain Adversarial Neural Network Model for EEG Emotion Recognition","volume":"12","author":"Li","year":"2018","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1528","DOI":"10.1109\/TAFFC.2020.3013711","article-title":"An Efficient LSTM Network for Emotion Recognition from Multichannel EEG Signals","volume":"13","author":"Du","year":"2022","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1109\/TCDS.2016.2587290","article-title":"Multichannel EEG-Based Emotion Recognition via Group Sparse Canonical Correlation Analysis","volume":"9","author":"Zheng","year":"2017","journal-title":"IEEE Trans. Cogn. Dev. Syst."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"839","DOI":"10.1109\/TCYB.2017.2788081","article-title":"Spatial\u2013Temporal Recurrent Neural Network for Emotion Recognition","volume":"49","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Cybern."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1007\/s11571-020-09634-1","article-title":"EEG-based emotion recognition using 4D convolutional recurrent neural network","volume":"14","author":"Shen","year":"2020","journal-title":"Cogn. Neurodyn."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/11\/3464\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:49:10Z","timestamp":1760107750000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/11\/3464"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,27]]},"references-count":36,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["s24113464"],"URL":"https:\/\/doi.org\/10.3390\/s24113464","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,27]]}}}