{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T17:05:26Z","timestamp":1769015126989,"version":"3.49.0"},"reference-count":54,"publisher":"World Scientific Pub Co Pte Ltd","issue":"04","funder":[{"name":"the STI 2030 \u2014 Major Projects","award":["2022ZD0208900"],"award-info":[{"award-number":["2022ZD0208900"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["82072006"],"award-info":[{"award-number":["82072006"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["82372085"],"award-info":[{"award-number":["82372085"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62333003"],"award-info":[{"award-number":["62333003"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62276051"],"award-info":[{"award-number":["62276051"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100018542","name":"Natural Science Foundation of Sichuan Province","doi-asserted-by":"crossref","award":["2023NSFSC0644"],"award-info":[{"award-number":["2023NSFSC0644"]}],"id":[{"id":"10.13039\/501100018542","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Neur. Syst."],"published-print":{"date-parts":[[2024,4]]},"abstract":"<jats:p> Constructing computational decoding models to account for the cortical representation of semantic information plays a crucial role in understanding visual perception. The human visual system processes interactive relationships among different objects when perceiving the semantic contents of natural visions. However, the existing semantic decoding models commonly regard categories as completely separate and independent visually and semantically and rarely consider the relationships from prior information. In this work, a novel semantic graph learning model was proposed to decode multiple semantic categories of perceived natural images from brain activity. The proposed model was validated on the functional magnetic resonance imaging data collected from five normal subjects while viewing 2750 natural images comprising 52 semantic categories. The results showed that the Graph Neural Network-based decoding model achieved higher accuracies than other deep neural network models. Moreover, the co-occurrence probability among semantic categories showed a significant correlation with the decoding accuracy. Additionally, the results suggested that semantic content organized in a hierarchical way with higher visual areas was more closely related to the internal visual experience. Together, this study provides a superior computational framework for multi-semantic decoding that supports the visual integration mechanism of semantic processing. <\/jats:p>","DOI":"10.1142\/s0129065724500163","type":"journal-article","created":{"date-parts":[[2024,1,12]],"date-time":"2024-01-12T14:53:42Z","timestamp":1705071222000},"source":"Crossref","is-referenced-by-count":8,"title":["Multi-Semantic Decoding of Visual Perception with Graph Neural Networks"],"prefix":"10.1142","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7266-0241","authenticated-orcid":false,"given":"Rong","family":"Li","sequence":"first","affiliation":[{"name":"The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People\u2019s Hospital, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"},{"name":"School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"},{"name":"MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-1540-1118","authenticated-orcid":false,"given":"Jiyi","family":"Li","sequence":"additional","affiliation":[{"name":"School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"},{"name":"MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-3217-1149","authenticated-orcid":false,"given":"Chong","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"},{"name":"MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-3374-5314","authenticated-orcid":false,"given":"Haoxiang","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"},{"name":"MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-9152-4866","authenticated-orcid":false,"given":"Tao","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"},{"name":"MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6942-7289","authenticated-orcid":false,"given":"Xuyang","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"},{"name":"MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1747-1426","authenticated-orcid":false,"given":"Ting","family":"Zou","sequence":"additional","affiliation":[{"name":"School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"},{"name":"MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7854-4006","authenticated-orcid":false,"given":"Wei","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"},{"name":"MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9629-1396","authenticated-orcid":false,"given":"Hongmei","family":"Yan","sequence":"additional","affiliation":[{"name":"School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"},{"name":"MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4062-4753","authenticated-orcid":false,"given":"Huafu","family":"Chen","sequence":"additional","affiliation":[{"name":"The Center of Psychosomatic Medicine, Sichuan Provincial Center for Mental Health, Sichuan Provincial People\u2019s Hospital, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"},{"name":"School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"},{"name":"MOE Key Lab for Neuroinformation, High-Field Magnetic Resonance Brain Imaging, Key Laboratory of Sichuan Province, University of Electronic Science and Technology of China, Chengdu 611731, P.\u00a0R.\u00a0China"}]}],"member":"219","published-online":{"date-parts":[[2024,2,17]]},"reference":[{"key":"S0129065724500163BIB001","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2011.05.020"},{"key":"S0129065724500163BIB002","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2015.10.072"},{"key":"S0129065724500163BIB003","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1315275111"},{"key":"S0129065724500163BIB004","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2012.10.014"},{"key":"S0129065724500163BIB005","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2017.08.017"},{"key":"S0129065724500163BIB006","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2018.8545855"},{"key":"S0129065724500163BIB007","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2013.06.034"},{"key":"S0129065724500163BIB008","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9280.00392"},{"key":"S0129065724500163BIB009","doi-asserted-by":"publisher","DOI":"10.1167\/8.13.11"},{"key":"S0129065724500163BIB010","doi-asserted-by":"publisher","DOI":"10.1126\/science.177.4043.77"},{"key":"S0129065724500163BIB011","doi-asserted-by":"publisher","DOI":"10.1016\/j.visres.2007.09.013"},{"key":"S0129065724500163BIB012","doi-asserted-by":"publisher","DOI":"10.1016\/j.pneurobio.2007.09.001"},{"key":"S0129065724500163BIB013","doi-asserted-by":"publisher","DOI":"10.1038\/nn.2903"},{"key":"S0129065724500163BIB014","doi-asserted-by":"publisher","DOI":"10.1177\/1550059413480504"},{"key":"S0129065724500163BIB015","doi-asserted-by":"publisher","DOI":"10.1177\/1073858417702621"},{"key":"S0129065724500163BIB016","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065722500332"},{"key":"S0129065724500163BIB017","doi-asserted-by":"publisher","DOI":"10.1111\/mice.12944"},{"key":"S0129065724500163BIB018","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46448-0_8"},{"key":"S0129065724500163BIB021","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065723500557"},{"key":"S0129065724500163BIB022","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065723500466"},{"key":"S0129065724500163BIB023","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2021.117847"},{"key":"S0129065724500163BIB024","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2007.09.034"},{"key":"S0129065724500163BIB025","doi-asserted-by":"publisher","DOI":"10.1002\/hbm.25136"},{"key":"S0129065724500163BIB026","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"S0129065724500163BIB027","doi-asserted-by":"publisher","DOI":"10.1007\/s10439-020-02502-3"},{"key":"S0129065724500163BIB028","doi-asserted-by":"publisher","DOI":"10.1002\/mrm.24719"},{"key":"S0129065724500163BIB029","doi-asserted-by":"publisher","DOI":"10.1002\/mrm.22361"},{"key":"S0129065724500163BIB030","doi-asserted-by":"publisher","DOI":"10.1038\/nature06713"},{"key":"S0129065724500163BIB031","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2011.08.031"},{"key":"S0129065724500163BIB032","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2008.10.065"},{"key":"S0129065724500163BIB033","first-page":"1532","volume-title":"Proc. 2014 Conf. Empirical Methods in Natural Language Processing (EMNLP)","author":"Pennington J."},{"key":"S0129065724500163BIB034","doi-asserted-by":"publisher","DOI":"10.1002\/hbm.23692"},{"key":"S0129065724500163BIB035","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-018-03068-4"},{"key":"S0129065724500163BIB036","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.743"},{"key":"S0129065724500163BIB038","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.00241"},{"key":"S0129065724500163BIB039","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"S0129065724500163BIB041","volume-title":"Adv. Neural Inf. Process. Systems","volume":"30","author":"Vaswani A.","year":"2017"},{"key":"S0129065724500163BIB043","doi-asserted-by":"publisher","DOI":"10.1038\/nn1444"},{"key":"S0129065724500163BIB044","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/abb691"},{"key":"S0129065724500163BIB045","doi-asserted-by":"publisher","DOI":"10.1016\/S0165-0173(01)00085-6"},{"key":"S0129065724500163BIB046","doi-asserted-by":"publisher","DOI":"10.3389\/fnsys.2016.00081"},{"key":"S0129065724500163BIB047","doi-asserted-by":"publisher","DOI":"10.3758\/BF03197524"},{"key":"S0129065724500163BIB048","first-page":"3233","volume-title":"Proc. IEEE Conf. Computer Vision and Pattern Recognition","author":"Teney D."},{"key":"S0129065724500163BIB049","first-page":"11487","volume-title":"Proc. IEEE\/CVF Conf. Computer Vision and Pattern Recognition","author":"Kampffmeyer M."},{"key":"S0129065724500163BIB050","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.3577-09.2009"},{"key":"S0129065724500163BIB051","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.neuro.27.070203.144220"},{"key":"S0129065724500163BIB052","doi-asserted-by":"publisher","DOI":"10.1142\/S012906572350034X"},{"key":"S0129065724500163BIB053","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhx268"},{"key":"S0129065724500163BIB054","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2019.05.039"},{"key":"S0129065724500163BIB055","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2011.08.026"},{"key":"S0129065724500163BIB056","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2023.3243698"},{"key":"S0129065724500163BIB057","doi-asserted-by":"publisher","DOI":"10.1142\/S012906572350048X"},{"key":"S0129065724500163BIB058","first-page":"1","author":"Rafiei M. H.","year":"2023","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"S0129065724500163BIB059","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-019-04359-7"}],"container-title":["International Journal of Neural Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0129065724500163","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,28]],"date-time":"2024-02-28T08:37:13Z","timestamp":1709109433000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0129065724500163"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,17]]},"references-count":54,"journal-issue":{"issue":"04","published-print":{"date-parts":[[2024,4]]}},"alternative-id":["10.1142\/S0129065724500163"],"URL":"https:\/\/doi.org\/10.1142\/s0129065724500163","relation":{},"ISSN":["0129-0657","1793-6462"],"issn-type":[{"value":"0129-0657","type":"print"},{"value":"1793-6462","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,17]]},"article-number":"2450016"}}