{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T14:00:53Z","timestamp":1781877653542,"version":"3.54.5"},"reference-count":66,"publisher":"World Scientific Pub Co Pte Ltd","issue":"05","funder":[{"name":"the Italian Ministry of Defence within the PNRM 2020 Program","award":["PNRM a2020.231"],"award-info":[{"award-number":["PNRM a2020.231"]}]},{"name":"\u201cA Brain\u2013Computer Interface (BCI)-based System for Transferring Human Emotions inside Unmanned Aerial Vehicles (UAVs)\u201d Sapienza University Research Projects","award":["RM1221816C1CF63B"],"award-info":[{"award-number":["RM1221816C1CF63B"]}]},{"name":"the Italian Ministry of Defence","award":["2066\/16.12.2019"],"award-info":[{"award-number":["2066\/16.12.2019"]}]},{"name":"the Italian Ministry of Universities and Research (MUR) within the PRIN 2022 Program","award":["2022AL45R2"],"award-info":[{"award-number":["2022AL45R2"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Neur. Syst."],"published-print":{"date-parts":[[2024,5]]},"abstract":"<jats:p> Emotion recognition plays an essential role in human\u2013human interaction since it is a key to understanding the emotional states and reactions of human beings when they are subject to events and engagements in everyday life. Moving towards human\u2013computer interaction, the study of emotions becomes fundamental because it is at the basis of the design of advanced systems to support a broad spectrum of application areas, including forensic, rehabilitative, educational, and many others. An effective method for discriminating emotions is based on ElectroEncephaloGraphy (EEG) data analysis, which is used as input for classification systems. Collecting brain signals on several channels and for a wide range of emotions produces cumbersome datasets that are hard to manage, transmit, and use in varied applications. In this context, the paper introduces the Emp\u00e1theia system, which explores a different EEG representation by encoding EEG signals into images prior to their classification. In particular, the proposed system extracts spatio-temporal image encodings, or atlases, from EEG data through the Processing and transfeR of Interaction States and Mappings through Image-based eNcoding (PRISMIN) framework, thus obtaining a compact representation of the input signals. The atlases are then classified through the Emp\u00e1theia architecture, which comprises branches based on convolutional, recurrent, and transformer models designed and tuned to capture the spatial and temporal aspects of emotions. Extensive experiments were conducted on the Shanghai Jiao Tong University (SJTU) Emotion EEG Dataset (SEED) public dataset, where the proposed system significantly reduced its size while retaining high performance. The results obtained highlight the effectiveness of the proposed approach and suggest new avenues for data representation in emotion recognition from EEG signals. <\/jats:p>","DOI":"10.1142\/s0129065724500242","type":"journal-article","created":{"date-parts":[[2024,2,18]],"date-time":"2024-02-18T04:44:20Z","timestamp":1708231460000},"source":"Crossref","is-referenced-by-count":16,"title":["Spatio-Temporal Image-Based Encoded Atlases for EEG Emotion Recognition"],"prefix":"10.1142","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9437-6217","authenticated-orcid":false,"given":"Danilo","family":"Avola","sequence":"first","affiliation":[{"name":"Department of Computer Science, Sapienza University of Rome, Via Salaria 113, Rome 00198, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9149-2175","authenticated-orcid":false,"given":"Luigi","family":"Cinque","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Sapienza University of Rome, Via Salaria 113, Rome 00198, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9834-3519","authenticated-orcid":false,"given":"Angelo Di","family":"Mambro","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Sapienza University of Rome, Via Salaria 113, Rome 00198, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8111-9120","authenticated-orcid":false,"given":"Alessio","family":"Fagioli","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Sapienza University of Rome, Via Salaria 113, Rome 00198, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2540-2570","authenticated-orcid":false,"given":"Marco Raoul","family":"Marini","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Sapienza University of Rome, Via Salaria 113, Rome 00198, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6446-6473","authenticated-orcid":false,"given":"Daniele","family":"Pannone","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Sapienza University of Rome, Via Salaria 113, Rome 00198, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4058-877X","authenticated-orcid":false,"given":"Bruno","family":"Fanini","sequence":"additional","affiliation":[{"name":"Institute of Heritage Science, National Research Council, Area della Ricerca Roma 1, SP35d, 9, Montelibretti 00010, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8425-6892","authenticated-orcid":false,"given":"Gian Luca","family":"Foresti","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Mathematics and Physics, University of Udine, Via delle Scienze 206, Udine 33100, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"219","published-online":{"date-parts":[[2024,3,27]]},"reference":[{"key":"S0129065724500242BIB001","doi-asserted-by":"publisher","DOI":"10.1007\/s00429-021-02331-7"},{"key":"S0129065724500242BIB002","doi-asserted-by":"publisher","DOI":"10.1177\/1529100619832930"},{"key":"S0129065724500242BIB003","doi-asserted-by":"publisher","DOI":"10.1016\/j.brat.2019.103436"},{"key":"S0129065724500242BIB004","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2021.107780"},{"key":"S0129065724500242BIB005","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1016\/j.bbr.2015.10.036","volume":"298","author":"Yuvaraj R.","year":"2015","journal-title":"Behav. Brain Res."},{"key":"S0129065724500242BIB006","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2020.08.014"},{"key":"S0129065724500242BIB007","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065720500689"},{"key":"S0129065724500242BIB008","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065722500290"},{"key":"S0129065724500242BIB009","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2020.3003816"},{"key":"S0129065724500242BIB010","doi-asserted-by":"publisher","DOI":"10.1142\/S012906572250040X"},{"key":"S0129065724500242BIB011","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065722500241"},{"key":"S0129065724500242BIB012","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065722500496"},{"key":"S0129065724500242BIB013","doi-asserted-by":"publisher","DOI":"10.1515\/revneuro-2017-0035"},{"key":"S0129065724500242BIB014","doi-asserted-by":"publisher","DOI":"10.1515\/revneuro-2013-0032"},{"key":"S0129065724500242BIB015","doi-asserted-by":"publisher","DOI":"10.1145\/3524499"},{"key":"S0129065724500242BIB016","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065722500216"},{"key":"S0129065724500242BIB017","doi-asserted-by":"publisher","DOI":"10.1016\/j.cogsys.2023.101152"},{"key":"S0129065724500242BIB018","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8760(96)00053-0"},{"key":"S0129065724500242BIB019","doi-asserted-by":"publisher","DOI":"10.1016\/S0165-0173(98)00056-3"},{"key":"S0129065724500242BIB020","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8760(97)00773-3"},{"key":"S0129065724500242BIB021","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2010.02.015"},{"key":"S0129065724500242BIB022","doi-asserted-by":"publisher","DOI":"10.1038\/17126"},{"key":"S0129065724500242BIB023","doi-asserted-by":"publisher","DOI":"10.1109\/TAMD.2015.2431497"},{"key":"S0129065724500242BIB024","doi-asserted-by":"publisher","DOI":"10.1109\/TCBB.2021.3052811"},{"key":"S0129065724500242BIB025","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2023.3321067"},{"key":"S0129065724500242BIB026","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2023.3312172"},{"key":"S0129065724500242BIB027","doi-asserted-by":"publisher","DOI":"10.1145\/3297713"},{"key":"S0129065724500242BIB028","doi-asserted-by":"publisher","DOI":"10.3390\/app10062026"},{"key":"S0129065724500242BIB029","doi-asserted-by":"publisher","DOI":"10.1109\/NER.2013.6695876"},{"key":"S0129065724500242BIB030","doi-asserted-by":"publisher","DOI":"10.1016\/j.bbe.2020.02.002"},{"key":"S0129065724500242BIB031","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2005.851521"},{"key":"S0129065724500242BIB032","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2014.2339834"},{"key":"S0129065724500242BIB033","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2010.2048568"},{"key":"S0129065724500242BIB034","doi-asserted-by":"publisher","DOI":"10.1023\/A:1015075101937"},{"key":"S0129065724500242BIB035","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-022-07292-4"},{"key":"S0129065724500242BIB036","doi-asserted-by":"publisher","DOI":"10.3389\/fnsys.2020.00043"},{"key":"S0129065724500242BIB037","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2023.110372"},{"key":"S0129065724500242BIB038","first-page":"1","author":"Li D.","year":"2023","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"S0129065724500242BIB039","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2022.104141"},{"key":"S0129065724500242BIB040","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2021.08.018"},{"key":"S0129065724500242BIB041","doi-asserted-by":"publisher","DOI":"10.1109\/TCDS.2020.2999337"},{"key":"S0129065724500242BIB042","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2017.2788081"},{"key":"S0129065724500242BIB043","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2023.104998"},{"key":"S0129065724500242BIB044","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2018.8489331"},{"key":"S0129065724500242BIB045","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2020.3013711"},{"key":"S0129065724500242BIB046","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2023.104799"},{"key":"S0129065724500242BIB047","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2020.2994159"},{"key":"S0129065724500242BIB048","doi-asserted-by":"publisher","DOI":"10.1109\/TAFFC.2018.2817622"},{"key":"S0129065724500242BIB049","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2023.126262"},{"key":"S0129065724500242BIB050","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2020.106954"},{"key":"S0129065724500242BIB051","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2013.52"},{"key":"S0129065724500242BIB052","doi-asserted-by":"publisher","DOI":"10.1007\/s10055-019-00405-w"},{"key":"S0129065724500242BIB053","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2005.06.042"},{"key":"S0129065724500242BIB055","first-page":"6000","volume-title":"Advances in Neural Information Processing Systems","volume":"30","author":"Vaswani A.","year":"2017"},{"key":"S0129065724500242BIB056","doi-asserted-by":"publisher","DOI":"10.1016\/j.bspc.2019.101756"},{"key":"S0129065724500242BIB057","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-06427-2_28"},{"key":"S0129065724500242BIB058","doi-asserted-by":"publisher","DOI":"10.1145\/3505244"},{"key":"S0129065724500242BIB059","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2021.02.048"},{"key":"S0129065724500242BIB060","doi-asserted-by":"publisher","DOI":"10.1109\/TNSE.2021.3059881"},{"key":"S0129065724500242BIB061","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-022-11880-8"},{"key":"S0129065724500242BIB062","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2017.2682102"},{"key":"S0129065724500242BIB063","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-019-04359-7"},{"key":"S0129065724500242BIB064","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-019-04146-4"},{"key":"S0129065724500242BIB065","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065722500058"},{"key":"S0129065724500242BIB066","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065722500265"},{"key":"S0129065724500242BIB067","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2022.3190448"}],"container-title":["International Journal of Neural Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0129065724500242","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,27]],"date-time":"2024-03-27T08:49:17Z","timestamp":1711529357000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0129065724500242"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,27]]},"references-count":66,"journal-issue":{"issue":"05","published-print":{"date-parts":[[2024,5]]}},"alternative-id":["10.1142\/S0129065724500242"],"URL":"https:\/\/doi.org\/10.1142\/s0129065724500242","relation":{},"ISSN":["0129-0657","1793-6462"],"issn-type":[{"value":"0129-0657","type":"print"},{"value":"1793-6462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,27]]},"article-number":"2450024"}}