{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T21:51:02Z","timestamp":1782337862343,"version":"3.54.5"},"reference-count":34,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2023,9,13]],"date-time":"2023-09-13T00:00:00Z","timestamp":1694563200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key Research and Development Project","award":["2020YFB1313604"],"award-info":[{"award-number":["2020YFB1313604"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Most studies have demonstrated that EEG can be applied to emotion recognition. In the process of EEG-based emotion recognition, real-time is an important feature. In this paper, the real-time problem of emotion recognition based on EEG is explained and analyzed. Secondly, the short time window length and attention mechanisms are designed on EEG signals to follow emotion change over time. Then, long short-term memory with the additive attention mechanism is used for emotion recognition, due to timely emotion updates, and the model is applied to the SEED and SEED-IV datasets to verify the feasibility of real-time emotion recognition. The results show that the model performs relatively well in terms of real-time performance, with accuracy rates of 85.40% and 74.26% on SEED and SEED-IV, but the accuracy rate has not reached the ideal state due to data labeling and other losses in the pursuit of real-time performance.<\/jats:p>","DOI":"10.3390\/s23187853","type":"journal-article","created":{"date-parts":[[2023,9,14]],"date-time":"2023-09-14T10:09:22Z","timestamp":1694686162000},"page":"7853","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":46,"title":["Real-Time EEG-Based Emotion Recognition"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-1683-1748","authenticated-orcid":false,"given":"Xiangkun","family":"Yu","sequence":"first","affiliation":[{"name":"College of Computer Science and Technology, Qingdao University, Qingdao 266071, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhengjie","family":"Li","sequence":"additional","affiliation":[{"name":"School of Automation, Qingdao University, Qingdao 266071, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhibang","family":"Zang","sequence":"additional","affiliation":[{"name":"College of Computer Science and Technology, Qingdao University, Qingdao 266071, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yinhua","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Automation, Qingdao University, Qingdao 266071, China"},{"name":"Shandong Key Laboratory of Industrial Control Technology, Qingdao 266071, China"},{"name":"Institute for Future, Qingdao University, Qingdao 266071, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Picard, R.W. (2001, January 8). Building HAL: Computers that sense, recognize, and respond to human emotion. Proceedings of the Human Vision and Electronic Imaging VI, San Jose, CA, USA.","DOI":"10.1117\/12.429523"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2470","DOI":"10.1109\/JPROC.2013.2262913","article-title":"A Survey on Ambient Intelligence in Health Care","volume":"101","author":"Acampora","year":"2013","journal-title":"Proc. IEEE Inst. Electr. Electron. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"4386","DOI":"10.1109\/TCYB.2020.2987575","article-title":"Emotion Recognition from Multimodal Physiological Signals Using a Regularized Deep Fusion of Kernel Machine","volume":"51","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Cybern."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"2311","DOI":"10.1007\/s12652-020-02338-8","article-title":"Subject independent emotion recognition system for people with facial deformity: An EEG based approach","volume":"12","author":"Pandey","year":"2021","journal-title":"J. Ambient Intell. Human. Comput."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1016\/j.neulet.2005.09.004","article-title":"EEG correlates (event-related desynchronization) of emotional face elaboration: A temporal analysis","volume":"392","author":"Balconi","year":"2006","journal-title":"Neurosci. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1959","DOI":"10.1016\/j.neubiorev.2011.05.001","article-title":"Human brain EEG indices of emotions: Delineating responses to affective vocalizations by measuring frontal theta event-related synchronization","volume":"35","author":"Bekkedal","year":"2011","journal-title":"Neurosci. Biobehav. Rev."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"832","DOI":"10.1109\/TBME.2007.893452","article-title":"EEG-based lapse detection with high temporal resolution","volume":"54","author":"Davidson","year":"2007","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Nie, D., Wang, X.-W., Shi, L.-C., and Lu, B.-L. (May, January 27). EEG-based emotion recognition during watching movies. Proceedings of the 2011 5th International IEEE\/EMBS Conference on Neural Engineering, Cancun, Mexico.","DOI":"10.1109\/NER.2011.5910636"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Anh, V.H., Van, M.N., Ha, B.B., and Quyet, T.H. (2012, January 26\u201329). A real-time model based Support Vector Machine for emotion recognition through EEG. Proceedings of the 2012 International Conference on Control, Automation and Information Sciences (ICCAIS), Saigon, Vietnam.","DOI":"10.1109\/ICCAIS.2012.6466585"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1109\/JETCAS.2019.2951232","article-title":"Development and Validation of an EEG-Based Real-Time Emotion Recognition System Using Edge AI Computing Platform with Convolutional Neural Network System-on-Chip Design","volume":"9","author":"Fang","year":"2019","journal-title":"IEEE J. Emerg. Sel. Top. Circuits Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2493","DOI":"10.1109\/JBHI.2022.3148109","article-title":"Single-Channel Selection for EEG-Based Emotion Recognition Using Brain Rhythm Sequencing","volume":"26","author":"Li","year":"2022","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Li, Z., Qiu, L., and Li, R. (2020). Enhancing BCI-Based Emotion Recognition Using an Improved Particle Swarm Optimization for Feature Selection. Sensors, 20.","DOI":"10.3390\/s20113028"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1109\/TAFFC.2017.2660485","article-title":"Real-Time Movie-Induced Discrete Emotion Recognition from EEG Signals","volume":"9","author":"Liu","year":"2018","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1191","DOI":"10.1017\/S0954579419000695","article-title":"Emotion dysregulation as a dynamic process","volume":"31","author":"Cole","year":"2019","journal-title":"Dev. Psychopathol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1037\/a0014610","article-title":"Predicting the duration of emotional experience: Two experience sampling studies","volume":"9","author":"Verduyn","year":"2009","journal-title":"Emotion"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1248","DOI":"10.1037\/a0028289","article-title":"The relationship between self-distancing and the duration of negative and positive emotional experiences in daily life","volume":"12","author":"Verduyn","year":"2012","journal-title":"Emotion"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1037\/a0021239","article-title":"The relation between event processing and the duration of emotional experience","volume":"11","author":"Verduyn","year":"2011","journal-title":"Emotion"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Parikh, A., T\u00e4ckstr\u00f6m, O., Das, D., and Uszkoreit, J. (2016, January 6). A Decomposable Attention Model for Natural Language Inference. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.","DOI":"10.18653\/v1\/D16-1244"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ouyang, D., Yuan, Y., Li, G., and Guo, Z. (2022). The Effect of Time Window Length on EEG-Based Emotion Recognition. Sensors, 22.","DOI":"10.3390\/s22134939"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long Short-Term Memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Vinyals, O., Toshev, A., Bengio, S., and Erhan, D. (2015, January 7\u201312). Show and tell: A neural image caption generator. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298935"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1109\/TAMD.2015.2431497","article-title":"Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks","volume":"7","author":"Zheng","year":"2015","journal-title":"IEEE Trans. Auton. Ment. Dev."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Duan, R.-N., Zhu, J.-Y., and Lu, B.-L. (2013, January 6\u20138). Differential entropy feature for EEG-based emotion classification. Proceedings of the 2013 6th International IEEE\/EMBS Conference on Neural Engineering (NER), San Diego, CA, USA.","DOI":"10.1109\/NER.2013.6695876"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1110","DOI":"10.1109\/TCYB.2018.2797176","article-title":"EmotionMeter: A Multimodal Framework for Recognizing Human Emotions","volume":"49","author":"Zheng","year":"2019","journal-title":"IEEE Trans. Cybern."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Cimtay, Y., and Ekmekcioglu, E. (2020). Investigating the Use of Pretrained Convolutional Neural Network on Cross-Subject and Cross-Dataset EEG Emotion Recognition. Sensors, 20.","DOI":"10.3390\/s20072034"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"532","DOI":"10.1109\/TAFFC.2018.2817622","article-title":"EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks","volume":"11","author":"Song","year":"2020","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1109\/TAFFC.2017.2712143","article-title":"Identifying Stable Patterns over Time for Emotion Recognition from EEG","volume":"10","author":"Zheng","year":"2019","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Asghar, M.A., Khan, M.J., Amin, Y., Rizwan, M., Rahman, M., Badnava, S., and Mirjavadi, S.S. (2019). EEG-Based Multi-Modal Emotion Recognition using Bag of Deep Features: An Optimal Feature Selection Approach. Sensors, 19.","DOI":"10.3390\/s19235218"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Li, M., Qiu, M., Kong, W., Zhu, L., and Ding, Y. (2023). Fusion Graph Representation of EEG for Emotion Recognition. Sensors, 23.","DOI":"10.3390\/s23031404"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"189720","DOI":"10.1109\/ACCESS.2020.3031447","article-title":"Review of Methods for EEG Signal Classification and Development of New Fuzzy Classification-Based Approach","volume":"8","author":"Rabcan","year":"2020","journal-title":"IEEE Access"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wang, X.W., Nie, D., and Lu, B.L. (2011, January 13\u201317). EEG-based emotion recognition using frequency domain features and support vector machines. Proceedings of the International Conference on Neural Information Processing (ICONIP 2011), Shanghai, China.","DOI":"10.1007\/978-3-642-24955-6_87"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Li, Y., Zheng, W., Cui, Z., Zhang, T., and Zong, Y. (2018, January 13\u201319). A novel neural network model based on cerebral hemispheric asymmetry for EEG emotion recognition. Proceedings of the 27th International Joint Conference on Artificial Intelligence (IJCAI\u201918), Stockholm, Sweden.","DOI":"10.24963\/ijcai.2018\/216"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1109\/TCDS.2020.2999337","article-title":"A Novel Bi-Hemispheric Discrepancy Model for EEG Emotion Recognition","volume":"13","author":"Li","year":"2021","journal-title":"IEEE Trans. Cogn. Dev. Syst."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Lai, C.Q., Ibrahim, H., Suandi, S.A., and Abdullah, M.Z. (2022). Convolutional Neural Network for Closed-Set Identification from Resting State Electroencephalography. Mathematics, 10.","DOI":"10.3390\/math10193442"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/18\/7853\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:50:08Z","timestamp":1760129408000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/18\/7853"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,13]]},"references-count":34,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["s23187853"],"URL":"https:\/\/doi.org\/10.3390\/s23187853","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,13]]}}}