{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,20]],"date-time":"2026-08-20T15:40:47Z","timestamp":1787240447565,"version":"build-2736575974"},"reference-count":50,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2024,2,26]],"date-time":"2024-02-26T00:00:00Z","timestamp":1708905600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Chinese MOST Project","award":["2023YFC3604100"],"award-info":[{"award-number":["2023YFC3604100"]}]},{"name":"Chinese MOST Project","award":["YG2021169"],"award-info":[{"award-number":["YG2021169"]}]},{"name":"Chinese MOST Project","award":["YS22247"],"award-info":[{"award-number":["YS22247"]}]},{"name":"Social Sciences Planning Office of Jiangxi Province","award":["2023YFC3604100"],"award-info":[{"award-number":["2023YFC3604100"]}]},{"name":"Social Sciences Planning Office of Jiangxi Province","award":["YG2021169"],"award-info":[{"award-number":["YG2021169"]}]},{"name":"Social Sciences Planning Office of Jiangxi Province","award":["YS22247"],"award-info":[{"award-number":["YS22247"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Brain Sciences"],"abstract":"<jats:p>In recent years, the integration of brain\u2013computer interface technology and neural networks in the field of music generation has garnered widespread attention. These studies aimed to extract individual-specific emotional and state information from electroencephalogram (EEG) signals to generate unique musical compositions. While existing research has focused primarily on brain regions associated with emotions, this study extends this research to brain regions related to musical composition. To this end, a novel neural network model incorporating attention mechanisms and steady-state activation mapping (SSAM) was proposed. In this model, the self-attention module enhances task-related information in the current state matrix, while the extended attention module captures the importance of state matrices over different time frames. Additionally, a convolutional neural network layer is used to capture spatial information. Finally, the ECA module integrates the frequency information learned by the model in each of the four frequency bands, mapping these by learning their complementary frequency information into the final attention representation. Evaluations conducted on a dataset specifically constructed for this study revealed that the model surpassed representative models in the emotion recognition field, with recognition rate improvements of 1.47% and 3.83% for two different music states. Analysis of the attention matrix indicates that the left frontal lobe and occipital lobe are the most critical brain regions in distinguishing between \u2018recall and creation\u2019 states, while FP1, FPZ, O1, OZ, and O2 are the electrodes most related to this state. In our study of the correlations and significances between these areas and other electrodes, we found that individuals with musical training exhibit more extensive functional connectivity across multiple brain regions. This discovery not only deepens our understanding of how musical training can enhance the brain\u2019s ability to work in coordination but also provides crucial guidance for the advancement of brain\u2013computer music generation technologies, particularly in the selection of key brain areas and electrode configurations. We hope our research can guide the work of EEG-based music generation to create better and more personalized music.<\/jats:p>","DOI":"10.3390\/brainsci14030216","type":"journal-article","created":{"date-parts":[[2024,2,26]],"date-time":"2024-02-26T11:31:21Z","timestamp":1708947081000},"page":"216","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Exploring Brain Dynamics via EEG and Steady-State Activation Map Networks in Music Composition"],"prefix":"10.3390","volume":"14","author":[{"given":"Xiaohu","family":"Gu","sequence":"first","affiliation":[{"name":"Laboratory of Image Processing and Pattern Recognition, School of Information Engineering, Nanchang Hangkong University, Nanchang 330038, China"},{"name":"School of Information Engineering, Nanchang Hangkong University, Nanchang 330038, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Leqi","family":"Jiang","sequence":"additional","affiliation":[{"name":"Laboratory of Image Processing and Pattern Recognition, School of Information Engineering, Nanchang Hangkong University, Nanchang 330038, China"},{"name":"School of Information Engineering, Nanchang Hangkong University, Nanchang 330038, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4542-8804","authenticated-orcid":false,"given":"Hao","family":"Chen","sequence":"additional","affiliation":[{"name":"Laboratory of Image Processing and Pattern Recognition, School of Information Engineering, Nanchang Hangkong University, Nanchang 330038, China"},{"name":"School of Information Engineering, Nanchang Hangkong University, Nanchang 330038, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ming","family":"Li","sequence":"additional","affiliation":[{"name":"Laboratory of Image Processing and Pattern Recognition, School of Information Engineering, Nanchang Hangkong University, Nanchang 330038, China"},{"name":"School of Information Engineering, Nanchang Hangkong University, Nanchang 330038, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chang","family":"Liu","sequence":"additional","affiliation":[{"name":"Laboratory of Image Processing and Pattern Recognition, School of Information Engineering, Nanchang Hangkong University, Nanchang 330038, China"},{"name":"School of Information Engineering, Nanchang Hangkong University, Nanchang 330038, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,2,26]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1038\/s41583-022-00578-5","article-title":"Music in the Brain","volume":"23","author":"Vuust","year":"2022","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_2","unstructured":"Critchley, M., and Henson, R.A. (2014). Music and the Brain: Studies in the Neurology of Music, Butterworth-Heinemann."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"934266","DOI":"10.3389\/fnsys.2022.934266","article-title":"Simultaneous Electroencephalography-Functional Magnetic Resonance Imaging for Assessment of Human Brain Function","volume":"16","author":"Ebrahimzadeh","year":"2022","journal-title":"Front. Syst. Neurosci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1109\/TAFFC.2017.2714671","article-title":"Emotions Recognition Using EEG Signals: A Survey","volume":"10","author":"Alarcao","year":"2017","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Roman-Caballero, R., Arnedo, M., Trivino, M., and Lupianez, J. (2018). Musical Practice as an Enhancer of Cognitive Function in Healthy Aging-A Systematic Review and Meta-Analysis. PLoS ONE, 13.","DOI":"10.1371\/journal.pone.0207957"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"12606","DOI":"10.1038\/s41598-019-49099-9","article-title":"The Effects of Playing Music on Mental Health Outcomes","volume":"9","author":"Wesseldijk","year":"2019","journal-title":"Sci. Rep."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"997282","DOI":"10.3389\/fninf.2022.997282","article-title":"A Review: Music-Emotion Recognition and Analysis Based on EEG Signals","volume":"16","author":"Cui","year":"2022","journal-title":"Front. Neuroinform."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1631\/jzus.C1400199","article-title":"Scale-Free Brain Ensemble Modulated by Phase Synchronization","volume":"15","author":"Wu","year":"2014","journal-title":"J. Zhejiang Univ. Sci. C"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1162\/0024094054762133","article-title":"Interfacing the Brain Directly with Musical Systems: On Developing Systems for Making Music with Brain Signals","volume":"38","author":"Miranda","year":"2005","journal-title":"Leonardo"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1515\/IJDHD.2006.5.2.119","article-title":"Brain-Computer Music Interface for Composition and Performance","volume":"5","author":"Miranda","year":"2006","journal-title":"Int. J. Disabil. Hum. Dev."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"213","DOI":"10.3389\/fnhum.2017.00213","article-title":"The Encephalophone: A Novel Musical Biofeedback Device Using Conscious Control of Electroencephalogram (EEG)","volume":"11","author":"Deuel","year":"2017","journal-title":"Front. Hum. Neurosci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3685","DOI":"10.1121\/10.0011549","article-title":"A Method to Convert Neural Signals into Sound Sequences","volume":"151","author":"Destexhe","year":"2022","journal-title":"J. Acoust. Soc. Am."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"12277","DOI":"10.1038\/srep12277","article-title":"The Brain Functional State of Music Creation: An fMRI Study of Composers","volume":"5","author":"Lu","year":"2015","journal-title":"Sci. Rep."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Lu, J., Wu, D., Yang, H., Luo, C., Li, C., and Yao, D. (2012). Scale-Free Brain-Wave Music from Simultaneously EEG and fMRI Recordings. PLoS ONE, 7.","DOI":"10.1371\/journal.pone.0049773"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"28463","DOI":"10.1007\/s11042-021-11049-x","article-title":"Pitch Contours Curve Frequency Domain Fitting with Vocabulary Matching Based Music Generation","volume":"80","author":"Lang","year":"2021","journal-title":"Multimed. Tools Appl."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1080\/2326263X.2018.1550710","article-title":"A Comparison of a Broad Range of EEG Acquisition Devices\u2013Is There Any Difference for SSVEP BCIs?","volume":"5","author":"Zerafa","year":"2018","journal-title":"Brain-Comput. Interfaces"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Miyamoto, K., Tanaka, H., and Nakamura, S. (2020, January 25\u201329). Music Generation and Emotion Estimation from Eeg Signals for Inducing Affective States. Proceedings of the Companion Publication of the 2020 International Conference on Multimodal Interaction, Virtual Event.","DOI":"10.1145\/3395035.3425225"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Pinegger, A., Hiebel, H., Wriessnegger, S.C., and M\u00fcller-Putz, G.R. (2017). Composing Only by Thought: Novel Application of the P300 Brain-Computer Interface. PLoS ONE, 12.","DOI":"10.1371\/journal.pone.0181584"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"118530","DOI":"10.1109\/ACCESS.2019.2936817","article-title":"A Hierarchical Bidirectional GRU Model with Attention for EEG-Based Emotion Classification","volume":"7","author":"Chen","year":"2019","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"715","DOI":"10.1109\/LSP.2019.2906824","article-title":"A Convolutional Recurrent Attention Model for Subject-Independent EEG Signal Analysis","volume":"26","author":"Zhang","year":"2019","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Qiu, J.-L., Li, X.-Y., and Hu, K. (2018, January 3\u20136). Correlated Attention Networks for Multimodal Emotion Recognition. Proceedings of the 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Madrid, Spain.","DOI":"10.1109\/BIBM.2018.8621129"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"108740","DOI":"10.1016\/j.asoc.2022.108740","article-title":"Spatial-Frequency Convolutional Self-Attention Network for EEG Emotion Recognition","volume":"122","author":"Li","year":"2022","journal-title":"Appl. Soft Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"102006","DOI":"10.1016\/j.inffus.2023.102006","article-title":"Finger pinching and imagination classification: A fusion of CNN architectures for IoMT-enabled BCI applications","volume":"101","author":"Varone","year":"2024","journal-title":"Inf. Fusion"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1093\/cercor\/9.7.697","article-title":"When That Tune Runs through Your Head: A PET Investigation of Auditory Imagery for Familiar Melodies","volume":"9","author":"Halpern","year":"1999","journal-title":"Cereb. Cortex"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"746","DOI":"10.1038\/s41583-019-0223-4","article-title":"Oscillating Circuitries in the Sleeping Brain","volume":"20","author":"Adamantidis","year":"2019","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_26","first-page":"14","article-title":"Emotions and Brain Waves","volume":"3","year":"2016","journal-title":"Int. J. Indian Psychol."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Duan, R.-N., Zhu, J.-Y., and Lu, B.-L. (2013, January 6\u20138). Differential Entropy Feature for EEG-Based Emotion Classification. Proceedings of the 2013 6th International IEEE\/EMBS Conference on Neural Engineering (NER), San Diego, CA, USA.","DOI":"10.1109\/NER.2013.6695876"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"504","DOI":"10.1097\/WNP.0000000000000510","article-title":"Relationship between EEG Electrode and Functional Cortex in the International 10 to 20 System","volume":"35","author":"Butler","year":"2018","journal-title":"J. Clin. Neurophysiol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1109\/TAFFC.2020.3025777","article-title":"EEG-Based Emotion Recognition via Channel-Wise Attention and Self Attention","volume":"14","author":"Tao","year":"2020","journal-title":"IEEE Trans. Affect. Comput."},{"key":"ref_30","first-page":"972","article-title":"Self-Normalizing Neural Networks","volume":"30","author":"Klambauer","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_31","unstructured":"Liu, Y., and Sourina, O. (2014). Transactions on Computational Science XXIII, Springer."},{"key":"ref_32","unstructured":"Liu, W., Zheng, W.-L., and Lu, B.-L. (2016, January 16\u201321). Emotion Recognition Using Multimodal Deep Learning. Proceedings of the Neural Information Processing: 23rd International Conference, ICONIP 2016, Kyoto, Japan. Proceedings, Part II 23."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Alazrai, R., Homoud, R., Alwanni, H., and Daoud, M.I. (2018). EEG-Based Emotion Recognition Using Quadratic Time-Frequency Distribution. Sensors, 18.","DOI":"10.3390\/s18082739"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.cmpb.2016.12.005","article-title":"Recognition of Emotions Using Multimodal Physiological Signals and an Ensemble Deep Learning Model","volume":"140","author":"Yin","year":"2017","journal-title":"Comput. Methods Programs Biomed."},{"key":"ref_35","unstructured":"Tang, H., Liu, W., Zheng, W.-L., and Lu, B.-L. (2017, January 14\u201318). Multimodal Emotion Recognition Using Deep Neural Networks. Proceedings of the Neural Information Processing: 24th International Conference, ICONIP 2017, Guangzhou, China. Proceedings, Part IV 24."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"07006","DOI":"10.1051\/itmconf\/20171107006","article-title":"Channel Division Based Multiple Classifiers Fusion for Emotion Recognition Using EEG Signals","volume":"Volume 11","author":"Li","year":"2017","journal-title":"ITM Web of Conferences"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Liu, N., Fang, Y., Li, L., Hou, L., Yang, F., and Guo, Y. (2018, January 15\u201320). Multiple Feature Fusion for Automatic Emotion Recognition Using EEG Signals. Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Calgary, AB, Canada.","DOI":"10.1109\/ICASSP.2018.8462518"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Yang, Y., Wu, Q., Qiu, M., Wang, Y., and Chen, X. (2018, January 8\u201313). Emotion Recognition from Multi-Channel EEG through Parallel Convolutional Recurrent Neural Network. Proceedings of the 2018 International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, Brazil.","DOI":"10.1109\/IJCNN.2018.8489331"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1016\/j.comcom.2020.02.051","article-title":"Emotion Recognition from Spatiotemporal EEG Representations with Hybrid Convolutional Recurrent Neural Networks via Wearable Multi-Channel Headset","volume":"154","author":"Chen","year":"2020","journal-title":"Comput. Commun."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Ouyang, D., Yuan, Y., Li, G., and Guo, Z. (2022). The Effect of Time Window Length on EEG-Based Emotion Recognition. Sensors, 22.","DOI":"10.3390\/s22134939"},{"key":"ref_41","first-page":"1","article-title":"EEG-Based Emotion Recognition Using a Temporal-Difference Minimizing Neural Network","volume":"31","author":"Ju","year":"2023","journal-title":"Cogn. Neurodyn."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Li, Q., Liu, Y., Liu, Q., Zhang, Q., Yan, F., Ma, Y., and Zhang, X. (2022). Multidimensional Feature in Emotion Recognition Based on Multi-Channel EEG Signals. Entropy, 24.","DOI":"10.3390\/e24121830"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"624","DOI":"10.1038\/s41598-022-27361-x","article-title":"Neural Decoding of Music from the EEG","volume":"13","author":"Daly","year":"2023","journal-title":"Sci. Rep."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Luo, G., Chen, H., Li, Z., and Wang, M. (2022, January 4\u20136). Music Generation Based on Emotional EEG. Proceedings of the 2022 the 6th International Conference on Innovation in Artificial Intelligence (ICIAI), Guangzhou, China.","DOI":"10.1145\/3529466.3529492"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1050","DOI":"10.1587\/transinf.2021EDP7171","article-title":"Online EEG-Based Emotion Prediction and Music Generation for Inducing Affective States","volume":"105","author":"Miyamoto","year":"2022","journal-title":"IEICE Trans. Inf. Syst."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Pereira, C.S., Teixeira, J., Figueiredo, P., Xavier, J., Castro, S.L., and Brattico, E. (2011). Music and emotions in the brain: Familiarity matters. PLoS ONE, 6.","DOI":"10.1371\/journal.pone.0027241"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1539","DOI":"10.1097\/j.pain.0000000000002151","article-title":"Predicting Pain: Differential Pain Thresholds during Self-Induced, Externally Induced, and Imagined Self-Induced Pressure Pain","volume":"162","author":"Lalouni","year":"2021","journal-title":"Pain"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1109\/TAMD.2015.2431497","article-title":"Investigating critical frequency bands and channels for EEG-based emotion recognition with deep neural networks","volume":"7","author":"Zheng","year":"2015","journal-title":"IEEE Trans. Auton. Ment."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"985709","DOI":"10.3389\/fnins.2022.985709","article-title":"Deep Learning-Based Self-Induced Emotion Recognition Using EEG","volume":"16","author":"Ji","year":"2022","journal-title":"Front. Neurosci."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1670","DOI":"10.1037\/emo0001192","article-title":"The Representation of Emotional Experience from Imagined Scenarios","volume":"23","author":"Faul","year":"2023","journal-title":"Emotion"}],"container-title":["Brain Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3425\/14\/3\/216\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:05:18Z","timestamp":1760105118000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3425\/14\/3\/216"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,26]]},"references-count":50,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2024,3]]}},"alternative-id":["brainsci14030216"],"URL":"https:\/\/doi.org\/10.3390\/brainsci14030216","relation":{},"ISSN":["2076-3425"],"issn-type":[{"value":"2076-3425","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,26]]}}}