{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,29]],"date-time":"2026-06-29T19:41:47Z","timestamp":1782762107958,"version":"3.54.5"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2023,10,13]],"date-time":"2023-10-13T00:00:00Z","timestamp":1697155200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,10,13]],"date-time":"2023-10-13T00:00:00Z","timestamp":1697155200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Ministerio de Ciencia e Innovaci\u00f3n\/AEI\/FEDER UE","award":["PID2021-123207NB-I00"],"award-info":[{"award-number":["PID2021-123207NB-I00"]}]},{"name":"Ministerio de Ciencia e Innovaci\u00f3n\/AEI\/FEDER UE","award":["10.13039 \/ 501100011033"],"award-info":[{"award-number":["10.13039 \/ 501100011033"]}]},{"name":"Junta de Andaluc\u00eda. Proyectos de I+D+i","award":["PY20_00237"],"award-info":[{"award-number":["PY20_00237"]}]},{"name":"Universidad de M\u00e1laga. Campus de Excelencia Internacional Andalucia Tech"},{"name":"Funding for open access charge: Universidad de M\u00e1laga\/CBUA"},{"DOI":"10.13039\/100009473","name":"Universidad de M\u00e1laga","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100009473","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Neural Comput &amp; Applic"],"published-print":{"date-parts":[[2024,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The human brain receives stimuli in multiple ways; among them, audio constitutes an important source of relevant stimuli for the brain regarding communication, amusement, warning, etc. In this context, the aim of this manuscript is to advance in the classification of brain responses to music of diverse genres and to sounds of different nature: speech and music. For this purpose, two different experiments have been designed to acquire EEG signals from subjects listening to songs of different musical genres and sentences in various languages. With this, a novel scheme is proposed to characterize brain signals for their classification; this scheme is based on the construction of a feature matrix built on relations between energy measured at the different EEG channels and the usage of a bi-LSTM neural network. With the data obtained, evaluations regarding EEG-based classification between speech and music, different musical genres, and whether the subject likes the song listened to or not are carried out. The experiments unveil satisfactory performance to the proposed scheme. The results obtained for binary audio type classification attain 98.66% of success. In multi-class classification between 4 musical genres, the accuracy attained is 61.59%, and results for binary classification of musical taste rise to 96.96%.<\/jats:p>","DOI":"10.1007\/s00521-023-09061-3","type":"journal-article","created":{"date-parts":[[2023,10,13]],"date-time":"2023-10-13T18:02:43Z","timestamp":1697220163000},"page":"791-802","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Energy-based features and bi-LSTM neural network for EEG-based music and voice classification"],"prefix":"10.1007","volume":"36","author":[{"given":"Isaac","family":"Ariza","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ana M.","family":"Barbancho","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5441-225X","authenticated-orcid":false,"given":"Lorenzo J.","family":"Tard\u00f3n","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Isabel","family":"Barbancho","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,10,13]]},"reference":[{"key":"9061_CR1","volume-title":"EEG signal processing","author":"S Sanei","year":"2008","unstructured":"Sanei S, Chambers JA (2008) EEG signal processing. Wiley, West Sussex"},{"key":"9061_CR2","doi-asserted-by":"publisher","unstructured":"Yu Y, Beuret S, Zeng D, Oyama K (2018) Deep learning of human perception in audio event classification. In: 2018 IEEE international symposium on multimedia (ISM), pp 188\u2013189. https:\/\/doi.org\/10.1109\/ISM.2018.00-11","DOI":"10.1109\/ISM.2018.00-11"},{"key":"9061_CR3","doi-asserted-by":"publisher","unstructured":"Darmawan FF, Arifianto D, Huda MA, Taruno WP (2017) Human brain auditory activity observation using electrical capacitance volume tomography. In: 2017 IEEE SENSORS, pp 1\u20133. https:\/\/doi.org\/10.1109\/ICSENS.2017.8234433","DOI":"10.1109\/ICSENS.2017.8234433"},{"key":"9061_CR4","doi-asserted-by":"publisher","unstructured":"Aggarwal S, Sharon R, Murthy HA (2020) P300 based stereo localization of single frequency audio stimulus. In: 2020 National conference on communications (NCC), pp 1\u20135. https:\/\/doi.org\/10.1109\/NCC48643.2020.9056052","DOI":"10.1109\/NCC48643.2020.9056052"},{"key":"9061_CR5","doi-asserted-by":"publisher","unstructured":"Kumar SD, Subha D (2019) Prediction of depression from EEG signal using long short term memory (LSTM). In: 2019 3rd international conference on trends in electronics and informatics (ICOEI), pp 1248\u20131253. https:\/\/doi.org\/10.1109\/ICOEI.2019.8862560","DOI":"10.1109\/ICOEI.2019.8862560"},{"key":"9061_CR6","doi-asserted-by":"publisher","unstructured":"Alturki FA, AlSharabi K, Aljalal M, Abdurraqeeb AM (2019) A DWT-band power-SVM based architecture for neurological brain disorders diagnosis using EEG signals. In: 2019 2nd international conference on computer applications information security (ICCAIS), pp 1\u20134. https:\/\/doi.org\/10.1109\/CAIS.2019.8769492","DOI":"10.1109\/CAIS.2019.8769492"},{"key":"9061_CR7","doi-asserted-by":"publisher","unstructured":"Kim K, Carlson T, Lee S (2013) Design of a robotic wheelchair with a motor imagery based brain\u2013computer interface. In: 2013 International winter workshop on brain\u2013computer interface (BCI), pp 46\u201348. https:\/\/doi.org\/10.1109\/IWW-BCI.2013.6506625","DOI":"10.1109\/IWW-BCI.2013.6506625"},{"key":"9061_CR8","doi-asserted-by":"publisher","unstructured":"Moschona DS (2020) An affective service based on multi-modal emotion recognition, using EEG enabled emotion tracking and speech emotion recognition. In: 2020 IEEE international conference on consumer electronics\u2014Asia (ICCE-Asia), pp 1\u20133. https:\/\/doi.org\/10.1109\/ICCE-Asia49877.2020.9277291","DOI":"10.1109\/ICCE-Asia49877.2020.9277291"},{"key":"9061_CR9","doi-asserted-by":"publisher","unstructured":"Kee Y, Lee M, Williamson J, Lee S (2017) A hierarchical classification strategy for robust detection of passive\/active mental state using user-voluntary pitch imagery task. In: 2017 4th IAPR Asian conference on pattern recognition (ACPR), pp 906\u2013910. https:\/\/doi.org\/10.1109\/ACPR.2017.133","DOI":"10.1109\/ACPR.2017.133"},{"issue":"2","key":"9061_CR10","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1109\/TNSRE.2012.2236576","volume":"21","author":"Q Wang","year":"2013","unstructured":"Wang Q, Sourina O (2013) Real-time mental arithmetic task recognition from EEG signals. IEEE Trans Neural Syst Rehabil Eng 21(2):225\u2013232. https:\/\/doi.org\/10.1109\/TNSRE.2012.2236576","journal-title":"IEEE Trans Neural Syst Rehabil Eng"},{"key":"9061_CR11","doi-asserted-by":"publisher","first-page":"204","DOI":"10.1109\/RBME.2020.2969915","volume":"14","author":"M-P Hosseini","year":"2021","unstructured":"Hosseini M-P, Hosseini A, Ahi K (2021) A review on machine learning for EEG signal processing in bioengineering. IEEE Rev Biomed Eng 14:204\u2013218. https:\/\/doi.org\/10.1109\/RBME.2020.2969915","journal-title":"IEEE Rev Biomed Eng"},{"issue":"1","key":"9061_CR12","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1109\/TNSRE.2018.2884641","volume":"27","author":"P Zhang","year":"2019","unstructured":"Zhang P, Wang X, Zhang W, Chen J (2019) Learning spatial\u2013spectral\u2013temporal EEG features with recurrent 3D convolutional neural networks for cross-task mental workload assessment. IEEE Trans Neural Syst Rehabil Eng 27(1):31\u201342. https:\/\/doi.org\/10.1109\/TNSRE.2018.2884641","journal-title":"IEEE Trans Neural Syst Rehabil Eng"},{"key":"9061_CR13","doi-asserted-by":"publisher","unstructured":"Patel P, Satija U (2021) Performance analysis of convolutional neural network based EEG epileptic seizure classification in presence of ocular artifacts. In: 2021 national conference on communications (NCC), pp 1\u20135. https:\/\/doi.org\/10.1109\/NCC52529.2021.9530053","DOI":"10.1109\/NCC52529.2021.9530053"},{"key":"9061_CR14","doi-asserted-by":"publisher","unstructured":"Pratiwi M, Wibawa AD, Purnomo MH (2021) EEG-based happy and sad emotions classification using LSTM and bidirectional LSTM. In: 2021 3rd international conference on electronics representation and algorithm (ICERA), pp 89\u201394. https:\/\/doi.org\/10.1109\/ICERA53111.2021.9538698","DOI":"10.1109\/ICERA53111.2021.9538698"},{"key":"9061_CR15","doi-asserted-by":"publisher","first-page":"163269","DOI":"10.1109\/ACCESS.2020.3021051","volume":"8","author":"W Lu","year":"2020","unstructured":"Lu W, Wei Y, Yuan J, Deng Y, Song A (2020) Tractor assistant driving control method based on EEG combined with RNN-TL deep learning algorithm. IEEE Access 8:163269\u2013163279. https:\/\/doi.org\/10.1109\/ACCESS.2020.3021051","journal-title":"IEEE Access"},{"key":"9061_CR16","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2015.11.046","author":"Y Liu","year":"2015","unstructured":"Liu Y, Liu W, Obaid M, Abbas I (2015) Exponential stability of Markovian jumping Cohen\u2013Grossberg neural networks with mixed mode-dependent time-delays. Neurocomputing. https:\/\/doi.org\/10.1016\/j.neucom.2015.11.046","journal-title":"Neurocomputing"},{"issue":"2","key":"9061_CR17","doi-asserted-by":"publisher","first-page":"448","DOI":"10.1016\/j.jfranklin.2015.11.013","volume":"353","author":"B Du","year":"2016","unstructured":"Du B, Liu Y, Atiatallah Abbas I (2016) Existence and asymptotic behavior results of periodic solution for discrete-time neutral-type neural networks. J Frankl Inst 353(2):448\u2013461. https:\/\/doi.org\/10.1016\/j.jfranklin.2015.11.013","journal-title":"J Frankl Inst"},{"key":"9061_CR18","doi-asserted-by":"publisher","DOI":"10.3390\/electronics8020164","author":"Y-S Seo","year":"2019","unstructured":"Seo Y-S, Huh J-H (2019) Automatic emotion-based music classification for supporting intelligent IoT applications. Electronics. https:\/\/doi.org\/10.3390\/electronics8020164","journal-title":"Electronics"},{"key":"9061_CR19","doi-asserted-by":"crossref","unstructured":"Lin Y-P, Wang C-H, Wu T-L, Jeng S-K, Chen J-H (2009) EEG-based emotion recognition in music listening: a comparison of schemes for multiclass support vector machine. In: 2009 IEEE international conference on acoustics, speech and signal processing, pp 489\u2013492. IEEE","DOI":"10.1109\/ICASSP.2009.4959627"},{"key":"9061_CR20","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroscience.2015.10.061","author":"H Poikonen","year":"2015","unstructured":"Poikonen H, Alluri V, Brattico E, Lartillot O, Tervaniemi M, Huotilainen M (2015) Event-related brain responses while listening to entire pieces of music. Neuroscience. https:\/\/doi.org\/10.1016\/j.neuroscience.2015.10.061","journal-title":"Neuroscience"},{"key":"9061_CR21","doi-asserted-by":"publisher","unstructured":"Shi S-J, Lu B-L (2009) EEG signal classification during listening to native and foreign languages songs. In: 2009 4th international IEEE\/EMBS conference on neural engineering, pp 440\u2013443. https:\/\/doi.org\/10.1109\/NER.2009.5109327","DOI":"10.1109\/NER.2009.5109327"},{"key":"9061_CR22","unstructured":"BrainVision (2021) actiCHamp Plus. BrainVision, accessed 27 July. https:\/\/brainvision.com\/"},{"key":"9061_CR23","unstructured":"Psychology Software Tools (2022) E-Prime, accessed 8 March. https:\/\/pstnet.com\/products\/e-prime\/"},{"key":"9061_CR24","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4471-6584-2","volume-title":"Guide to brain\u2013computer music interfacing","author":"ER Miranda","year":"2014","unstructured":"Miranda ER, Castet J (2014) Guide to brain\u2013computer music interfacing. Springer, London"},{"key":"9061_CR25","doi-asserted-by":"publisher","first-page":"496","DOI":"10.1137\/060658242","volume":"46","author":"U Oberst","year":"2007","unstructured":"Oberst U (2007) The fast Fourier transform. SIAM J Control Optim 46:496\u2013540. https:\/\/doi.org\/10.1137\/060658242","journal-title":"SIAM J Control Optim"},{"key":"9061_CR26","volume-title":"C\u00e1lculo I. Teor\u00eda y problemas de an\u00e1lisis matem\u00e1tico en una variable","author":"A Garc\u00eda","year":"2007","unstructured":"Garc\u00eda A, Garc\u00eda F, L\u00f3pez A, Rodr\u00edguez G, de la Villa A (2007) C\u00e1lculo I. Teor\u00eda y problemas de an\u00e1lisis matem\u00e1tico en una variable, 3rd edn. Editorial Clagsa, Madrid","edition":"3"},{"issue":"8","key":"9061_CR27","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735\u20131780","journal-title":"Neural Comput"},{"key":"9061_CR28","doi-asserted-by":"publisher","unstructured":"Hasib MM, Nayak T, Huang Y (2018) A hierarchical LSTM model with attention for modeling EEG non-stationarity for human decision prediction. In: 2018 IEEE EMBS international conference on biomedical health informatics (BHI), pp 104\u2013107. https:\/\/doi.org\/10.1109\/BHI.2018.8333380","DOI":"10.1109\/BHI.2018.8333380"},{"issue":"15","key":"9061_CR29","doi-asserted-by":"publisher","first-page":"12527","DOI":"10.1007\/s00521-022-07292-4","volume":"34","author":"EH Houssein","year":"2022","unstructured":"Houssein EH, Hammad A, Ali AA (2022) Human emotion recognition from EEG-based brain\u2013computer interface using machine learning: a comprehensive review. Neural Comput Appl 34(15):12527\u201312557","journal-title":"Neural Comput Appl"},{"key":"9061_CR30","doi-asserted-by":"publisher","first-page":"103885","DOI":"10.1016\/j.bspc.2022.103885","volume":"78","author":"I Ariza","year":"2022","unstructured":"Ariza I, Tard\u00f3n LJ, Barbancho AM, De-Torres I, Barbancho I (2022) Bi-LSTM neural network for EEG-based error detection in musicians\u2019 performance. Biomed Signal Process Control 78:103885. https:\/\/doi.org\/10.1016\/j.bspc.2022.103885","journal-title":"Biomed Signal Process Control"},{"key":"9061_CR31","doi-asserted-by":"publisher","DOI":"10.1023\/A:1017181826899","author":"F Provost","year":"1998","unstructured":"Provost F, Kohavi R (1998) Glossary of terms. Mach Learn. https:\/\/doi.org\/10.1023\/A:1017181826899","journal-title":"Mach Learn"},{"key":"9061_CR32","unstructured":"Powers D (2008) Evaluation: from precision, recall and F-factor to ROC, informedness, markedness and correlation. Mach Learn Technol 2"},{"key":"9061_CR33","unstructured":"Tzanetakis G, Essl G, Cook P (2001) Automatic musical genre classification of audio signals. In: Proceedings of the 2nd international symposium on music information retrieval, Indiana, vol 144. http:\/\/ismir2001.ismir.net\/pdf\/tzanetakis.pdf"}],"container-title":["Neural Computing and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-023-09061-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00521-023-09061-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-023-09061-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,5]],"date-time":"2024-01-05T07:14:04Z","timestamp":1704438844000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00521-023-09061-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,13]]},"references-count":33,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,1]]}},"alternative-id":["9061"],"URL":"https:\/\/doi.org\/10.1007\/s00521-023-09061-3","relation":{},"ISSN":["0941-0643","1433-3058"],"issn-type":[{"value":"0941-0643","type":"print"},{"value":"1433-3058","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,13]]},"assertion":[{"value":"15 February 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 September 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 October 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflict or competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Data acquisition methodology was conducted according to the guidelines of Declaration of Helsinki and approved by <i>Comit\u00e9 de \u00c9tica de la Investigaci\u00f3n Provincial de M\u00e1laga<\/i> on December 19, 2019, approval number: 2176-N-19.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"All the participating subjects gave their written consent.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"Data will be made available upon reasonable request and nondisclosure agreement.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Availability of data and materials"}},{"value":"Code will be made available upon reasonable request.","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Code availability"}}]}}