{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T18:12:50Z","timestamp":1790187170907,"version":"4.1.0"},"reference-count":37,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,12,26]],"date-time":"2022-12-26T00:00:00Z","timestamp":1672012800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Science and Technology Development Plan of Jilin Province, China","award":["20220402033GH"],"award-info":[{"award-number":["20220402033GH"]}]},{"name":"Science and Technology Development Plan of Jilin Province, China","award":["62102076"],"award-info":[{"award-number":["62102076"]}]},{"name":"Science and Technology Development Plan of Jilin Province, China","award":["RS-2022-00143336"],"award-info":[{"award-number":["RS-2022-00143336"]}]},{"name":"National Natural Science Foundation of China","award":["20220402033GH"],"award-info":[{"award-number":["20220402033GH"]}]},{"name":"National Natural Science Foundation of China","award":["62102076"],"award-info":[{"award-number":["62102076"]}]},{"name":"National Natural Science Foundation of China","award":["RS-2022-00143336"],"award-info":[{"award-number":["RS-2022-00143336"]}]},{"name":"Korea Agency for Infrastructure Technology Advancement (KAIA) grant funded by the Ministry of Land, Infrastructure and Transport","award":["20220402033GH"],"award-info":[{"award-number":["20220402033GH"]}]},{"name":"Korea Agency for Infrastructure Technology Advancement (KAIA) grant funded by the Ministry of Land, Infrastructure and Transport","award":["62102076"],"award-info":[{"award-number":["62102076"]}]},{"name":"Korea Agency for Infrastructure Technology Advancement (KAIA) grant funded by the Ministry of Land, Infrastructure and Transport","award":["RS-2022-00143336"],"award-info":[{"award-number":["RS-2022-00143336"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJERPH"],"abstract":"<jats:p>Music therapy is increasingly being used to promote physical health. Emotion semantic recognition is more objective and provides direct awareness of the real emotional state based on electroencephalogram (EEG) signals. Therefore, we proposed a music therapy method to carry out emotion semantic matching between the EEG signal and music audio signal, which can improve the reliability of emotional judgments, and, furthermore, deeply mine the potential influence correlations between music and emotions. Our proposed EER model (EEG-based Emotion Recognition Model) could identify 20 types of emotions based on 32 EEG channels, and the average recognition accuracy was above 90% and 80%, respectively. Our proposed music-based emotion classification model (MEC model) could classify eight typical emotion types of music based on nine music feature combinations, and the average classification accuracy was above 90%. In addition, the semantic mapping was analyzed according to the influence of different music types on emotional changes from different perspectives based on the two models, and the results showed that the joy type of music video could improve fear, disgust, mania, and trust emotions into surprise or intimacy emotions, while the sad type of music video could reduce intimacy to the fear emotion.<\/jats:p>","DOI":"10.3390\/ijerph20010378","type":"journal-article","created":{"date-parts":[[2022,12,27]],"date-time":"2022-12-27T04:42:47Z","timestamp":1672116167000},"page":"378","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["EEG Emotion Recognition Applied to the Effect Analysis of Music on Emotion Changes in Psychological Healthcare"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3258-0244","authenticated-orcid":false,"given":"Tie Hua","family":"Zhou","sequence":"first","affiliation":[{"name":"Department of Computer Science and Technology, School of Computer Science, Northeast Electric Power University, Jilin 132000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenlong","family":"Liang","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, School of Computer Science, Northeast Electric Power University, Jilin 132000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5262-2651","authenticated-orcid":false,"given":"Hangyu","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, School of Computer Science, Northeast Electric Power University, Jilin 132000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8956-0511","authenticated-orcid":false,"given":"Ling","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Technology, School of Computer Science, Northeast Electric Power University, Jilin 132000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Keun Ho","family":"Ryu","sequence":"additional","affiliation":[{"name":"Data Science Laboratory, Faculty of Information Technology, Ton Duc Thang University, Ho Chi Minh City 700000, Vietnam"},{"name":"Biomedical Engineering Institute, Chiang Mai University, Chiang Mai 50200, Thailand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9970-7863","authenticated-orcid":false,"given":"Kwang Woo","family":"Nam","sequence":"additional","affiliation":[{"name":"Department of Computer and Information Engineering, Kunsan National University, Gunsan 54150, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Shu, L., Xie, J., Yang, M., Li, Z., Li, Z., Liao, D., Xu, X., and Yang, X. (2018). A review of emotion recognition using physiological signals. Sensors, 18.","DOI":"10.3390\/s18072074"},{"key":"ref_2","unstructured":"Feng, Y., Zhuang, Y., and Pan, Y. (August, January 28). Popular music retrieval by detecting mood. Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Toronto, ON, Canada."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2986","DOI":"10.1007\/s11227-018-2499-y","article-title":"Are you emotional or depressed? Learning about your emotional state from your music using machine learning","volume":"75","author":"Panwar","year":"2019","journal-title":"J. Supercomput."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Corr\u00eaa, A.G.D., Ficheman, I.K., do Nascimento, M., and de Deus Lopes, R. (2009, January 15\u201317). Computer assisted music therapy: A case study of an augmented reality musical system for children with cerebral palsy rehabilitation. Proceedings of the 2009 Ninth IEEE International Conference on Advanced Learning Technologies, Riga, Latvia.","DOI":"10.1109\/ICALT.2009.111"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Guendil, Z., Lachiri, Z., Maaoui, C., and Pruski, A. (2016, January 21\u201323). Multiresolution framework for emotion sensing in physiological signals. Proceedings of the 2016 2nd International Conference on Advanced Technologies for Signal and Image Processing (ATSIP), Monastir, Tunisia.","DOI":"10.1109\/ATSIP.2016.7523190"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1109\/TAFFC.2015.2436926","article-title":"Analysis of EEG signals and facial expressions for continuous emotion detection","volume":"7","author":"Soleymani","year":"2015","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1109\/TAFFC.2017.2712143","article-title":"Identifying stable patterns over time for emotion recognition from EEG","volume":"10","author":"Zheng","year":"2019","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"344","DOI":"10.1511\/2001.28.344","article-title":"The nature of emotions: Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice","volume":"89","author":"Plutchik","year":"2001","journal-title":"Am. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1037\/0003-066X.50.5.372","article-title":"The emotion probe: Studies of motivation and attention","volume":"50","author":"Lang","year":"1995","journal-title":"Am. Psychol."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1005","DOI":"10.18517\/ijaseit.6.6.1072","article-title":"Human emotion detection via brain waves study by using electroencephalogram (EEG)","volume":"6","author":"Ismail","year":"2016","journal-title":"Int. J. Adv. Sci. Eng. Inf. Technol."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"26","DOI":"10.3389\/fnhum.2017.00026","article-title":"EEG correlates of ten positive emotions","volume":"11","author":"Hu","year":"2017","journal-title":"Front. Hum. Neurosci."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Gao, Z., Cui, X., Wan, W., and Gu, Z. (2019). Recognition of Emotional States Using Multiscale Information Analysis of High Frequency EEG Oscillations. Entropy, 21.","DOI":"10.3390\/e21060609"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"509","DOI":"10.3233\/THC-174836","article-title":"Emotion recognition from multichannel EEG signals using K-nearest neighbor classification","volume":"26","author":"Li","year":"2018","journal-title":"Technol. Health Care"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ahmed, M.Z.I., Sinha, N., Phadikar, S., and Ghadepour, E. (2022). Automated Feature Extraction on AsMap for Emotion Classification Using EEG. Sensors, 22.","DOI":"10.3390\/s22062346"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"12134","DOI":"10.1109\/ACCESS.2021.3051281","article-title":"Multi-Domain Feature Fusion for Emotion Classification Using DEAP Dataset","volume":"9","author":"Khateeb","year":"2021","journal-title":"IEEE Access"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Kostiuk, B., Costa, Y.M., Britto, A.S., Hu, X., and Silla, C.N. (2019, January 4\u20136). Multi-label Emotion Classification in Music Videos Using Ensembles of Audio and Video Features. Proceedings of the 2019 IEEE 31st International Conference on Tools with Artificial Intelligence (ICTAI), Portland, OR, USA.","DOI":"10.1109\/ICTAI.2019.00078"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Gkaintatzis, A., Van Der Lubbe, R., Karantinou, K., and Constantinides, E. (2019, January 18\u201320). Consumers\u2019 Cognitive, Emotional and Behavioral Responses towards Background Music: An EEG Study. Proceedings of the WEBIST, Vienna, Austria.","DOI":"10.5220\/0008346603140318"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Bai, J., Luo, K., Peng, J., Shi, J., Wu, Y., Feng, L., Li, J., and Wang, Y. (2017, January 26\u201328). Music emotions recognition by cognitive classification methodologies. Proceedings of the 2017 IEEE 16th International Conference on Cognitive Informatics & Cognitive Computing, Oxford, UK.","DOI":"10.1109\/ICCI-CC.2017.8109740"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Xu, J., Li, X., Hao, Y., and Yang, G. (2014, January 1\u20134). Source separation improves music emotion recognition. Proceedings of the International Conference on Multimedia Retrieval, Glasgow, UK.","DOI":"10.1145\/2578726.2578784"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Moreno Escobar, J.J., Morales Matamoros, O., Tejeida Padilla, R., Lina Reyes, I., Chanona Hern\u00e1ndez, L., and Ram\u00edrez Guti\u00e9rrez, A.G. (2020). Brain-Inspired Healthcare Smart System Based on Perception-Action Cycle. Appl. Sci., 10.","DOI":"10.3390\/app10103532"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Kinugasa, K., Yoshimura, H., Hori, M., Kishida, S., and Iwai, Y. (2014, January 24\u201329). Estimation of Emotion by Electroencephalography for Music Therapy. Proceedings of the International Conference on Human-Computer Interaction, Washington, DC, USA.","DOI":"10.1007\/978-3-319-07230-2_71"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"454","DOI":"10.1017\/S1478951516000663","article-title":"Music therapy for palliative care: A realist review","volume":"15","author":"McConnell","year":"2017","journal-title":"Palliat. Support. Care"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Hussain, I., Hossain, M.A., Jany, R., Bari, M.A., Uddin, M., Kamal, A.R.M., Ku, Y., and Kim, J.S. (2022). Quantitative Evaluation of EEG-Biomarkers for Prediction of Sleep Stages. Sensors, 22.","DOI":"10.3390\/s22083079"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Hussain, I., and Park, S.J. (2021). Quantitative Evaluation of Task-Induced Neurological Outcome after Stroke. Brain Sci., 11.","DOI":"10.3390\/brainsci11070900"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"213574","DOI":"10.1109\/ACCESS.2020.3040437","article-title":"HealthSOS: Real-Time Health Monitoring System for Stroke Prognostics","volume":"88","author":"Hussain","year":"2020","journal-title":"IEEE Access"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Hussain, I., Young, S., and Park, S.J. (2021). Driving-Induced Neurological Biomarkers in an Advanced Driver-Assistance System. Sensors, 21.","DOI":"10.3390\/s21216985"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"254","DOI":"10.3389\/fpsyg.2018.00254","article-title":"EEG-based analysis of the emotional effect of music therapy on palliative care cancer patients","volume":"9","author":"Ramirez","year":"2018","journal-title":"Front. Psychol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1109\/T-AFFC.2011.15","article-title":"Deap: A database for emotion analysis; using physiological signals","volume":"3","author":"Koelstra","year":"2011","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1109\/JBHI.2017.2688239","article-title":"DREAMER: A database for emotion recognition through EEG and ECG signals from wireless low-cost off-the-shelf devices","volume":"22","author":"Katsigiannis","year":"2017","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Wang, L., Liu, H., and Zhou, T. (2020). A Sequential Emotion Approach for Diagnosing Mental Disorder on Social Media. Appl. Sci., 10.","DOI":"10.3390\/app10051647"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Wang, L., Liu, H., Zhou, T., Liang, W., and Shan, M. (2021). Multidimensional Emotion Recognition Based on Semantic Analysis of Biomedical EEG Signal for Knowledge Discovery in Psychological Healthcare. Appl. Sci., 11.","DOI":"10.3390\/app11031338"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Phadikar, S., Sinha, N., Ghosh, R., and Ghaderpour, E. (2022). Automatic Muscle Artifacts Identification and Removal from Single-Channel EEG Using Wavelet Transform with Meta-Heuristically Optimized Non-Local Means Filter. Sensors, 22.","DOI":"10.3390\/s22082948"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"11043","DOI":"10.1038\/s41598-021-90437-7","article-title":"Eye-blink Artifact Removal from Single Channel EEG with k-means and SSA","volume":"11","author":"Maddirala","year":"2021","journal-title":"Sci. Rep."},{"key":"ref_34","unstructured":"Lartillot, O., and Toiviainen, P. (2007, January 10\u201315). A Matlab toolbox for musical feature extraction from audio. Proceedings of the International Conference on Digital Audio Effects, Bordeaux, France."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1961189.1961199","article-title":"LIBSVM: A library for support vector machines","volume":"2","author":"Chang","year":"2011","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/j.bspc.2018.01.015","article-title":"Music induced emotion using wavelet packet decomposition\u2014An EEG study","volume":"42","author":"Balasubramanian","year":"2018","journal-title":"Biomed. Signal Process. Control"},{"key":"ref_37","unstructured":"(2020, November 20). MATLAB Central File Exchange. Available online: https:\/\/www.mathworks.com\/matlabcentral\/fileexchange\/68882-cnn-classifier-using-1d-2d-and-3d-feature-vectors."}],"container-title":["International Journal of Environmental Research and Public Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1660-4601\/20\/1\/378\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:51:52Z","timestamp":1760147512000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1660-4601\/20\/1\/378"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,26]]},"references-count":37,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["ijerph20010378"],"URL":"https:\/\/doi.org\/10.3390\/ijerph20010378","relation":{},"ISSN":["1660-4601"],"issn-type":[{"value":"1660-4601","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,26]]}}}