{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,2]],"date-time":"2026-01-02T03:44:31Z","timestamp":1767325471390,"version":"3.48.0"},"reference-count":63,"publisher":"World Scientific Pub Co Pte Ltd","issue":"02","funder":[{"DOI":"10.13039\/501100012166","name":"National Key R\u00a0D Program of China","doi-asserted-by":"crossref","award":["2024YFC2510203"],"award-info":[{"award-number":["2024YFC2510203"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"name":"STI","award":["2022ZD0208900"],"award-info":[{"award-number":["2022ZD0208900"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62406058"],"award-info":[{"award-number":["62406058"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62333003"],"award-info":[{"award-number":["62333003"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["62036003"],"award-info":[{"award-number":["62036003"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["82121003"],"award-info":[{"award-number":["82121003"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Sichuan Science and Technology Program","award":["2025ZNSFSC1480"],"award-info":[{"award-number":["2025ZNSFSC1480"]}]},{"DOI":"10.13039\/501100002858","name":"China Postdoctoral Science Foundation","doi-asserted-by":"crossref","award":["2024M750360"],"award-info":[{"award-number":["2024M750360"]}],"id":[{"id":"10.13039\/501100002858","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"crossref","award":["ZYGX2024XJ051"],"award-info":[{"award-number":["ZYGX2024XJ051"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100005408","name":"University of Electronic Science and Technology of China","doi-asserted-by":"crossref","award":["ZYGX2021YGLH201"],"award-info":[{"award-number":["ZYGX2021YGLH201"]}],"id":[{"id":"10.13039\/501100005408","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Chongqing First-class Discipline Foreign Language and Literature","award":["SISUWYJY202305"],"award-info":[{"award-number":["SISUWYJY202305"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Neur. Syst."],"published-print":{"date-parts":[[2026,2]]},"abstract":"<jats:p>Visual neural decoding not only aids in elucidating the neural mechanisms underlying the processing of visual information but also facilitates the advancement of brain\u2013computer interface technologies. However, most current decoding studies focus on developing separate decoding models for individual subjects and specific tasks, an approach that escalates training costs and consumes a substantial amount of computational resources. This paper introduces a Prompt-Guided Generative Visual Language Decoding Model (PG-GVLDM), which uses prompt text that includes information about subjects and tasks to decode both primary categories and detailed textual descriptions from the visual response activities of multiple individuals. In addition to visual response activities, this study also incorporates a multi-head cross-attention module and feeds the model with whole-brain response activities to capture global semantic information in the brain. Experiments on the Natural Scenes Dataset (NSD) demonstrate that PG-GVLDM attains an average category decoding accuracy of 66.6% across four subjects, reflecting strong cross-subject generalization, and achieves text decoding scores of 0.342 (METEOR), 0.450 (Sentence-Transformer), 0.283 (ROUGE-1), and 0.262 (ROUGE-L), establishing state-of-the-art performance in text decoding. Furthermore, incorporating whole-brain response activities significantly enhances decoding performance by enabling the integration of distributed neural signals into coherent global semantic representations, underscoring its methodological importance for unified neural decoding. This research not only represents a breakthrough in visual neural decoding methodologies but also provides theoretical and technical support for the development of generalized brain\u2013computer interfaces.<\/jats:p>","DOI":"10.1142\/s0129065725500686","type":"journal-article","created":{"date-parts":[[2025,9,6]],"date-time":"2025-09-06T04:15:47Z","timestamp":1757132147000},"source":"Crossref","is-referenced-by-count":0,"title":["A Prompt-Guided Generative Language Model for Unifying Visual Neural Decoding Across Multiple Subjects and Tasks"],"prefix":"10.1142","volume":"36","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7854-4006","authenticated-orcid":false,"given":"Wei","family":"Huang","sequence":"first","affiliation":[{"name":"The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Brain\u2013Computer Interface & Brain-Inspired Intelligence, Key Laboratory of Sichuan Province, Chengdu, P. R. China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-7944-8990","authenticated-orcid":false,"given":"Hengjiang","family":"Li","sequence":"additional","affiliation":[{"name":"The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Brain\u2013Computer Interface & Brain-Inspired Intelligence, Key Laboratory of Sichuan Province, Chengdu, P. R. China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-7379-197X","authenticated-orcid":false,"given":"Fan","family":"Qin","sequence":"additional","affiliation":[{"name":"The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Brain\u2013Computer Interface & Brain-Inspired Intelligence, Key Laboratory of Sichuan Province, Chengdu, P. R. China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-4004-111X","authenticated-orcid":false,"given":"Diwei","family":"Wu","sequence":"additional","affiliation":[{"name":"The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Brain\u2013Computer Interface & Brain-Inspired Intelligence, Key Laboratory of Sichuan Province, Chengdu, P. R. China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1160-1296","authenticated-orcid":false,"given":"Kaiwen","family":"Cheng","sequence":"additional","affiliation":[{"name":"College of Language Intelligence, Sichuan International Studies University, Chongqing 400031, P. R. China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4062-4753","authenticated-orcid":false,"given":"Huafu","family":"Chen","sequence":"additional","affiliation":[{"name":"The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Brain\u2013Computer Interface & Brain-Inspired Intelligence, Key Laboratory of Sichuan Province, Chengdu 611731, P. R. China"}]}],"member":"219","published-online":{"date-parts":[[2025,9,26]]},"reference":[{"key":"S0129065725500686BIB001","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms15037"},{"key":"S0129065725500686BIB002","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-019-0640-4"},{"key":"S0129065725500686BIB003","doi-asserted-by":"publisher","DOI":"10.1016\/j.jpsychires.2025.05.052"},{"key":"S0129065725500686BIB004","doi-asserted-by":"publisher","DOI":"10.1155\/mij\/6631226"},{"key":"S0129065725500686BIB005","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2025.1620700"},{"key":"S0129065725500686BIB006","doi-asserted-by":"publisher","DOI":"10.1002\/hbm.25136"},{"key":"S0129065725500686BIB007","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2012.10.014"},{"key":"S0129065725500686BIB008","doi-asserted-by":"publisher","DOI":"10.1109\/ICIP40778.2020.9191262"},{"key":"S0129065725500686BIB009","doi-asserted-by":"publisher","DOI":"10.1002\/hbm.25603"},{"key":"S0129065725500686BIB010","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2021.08.006"},{"key":"S0129065725500686BIB011","doi-asserted-by":"publisher","DOI":"10.1007\/s12264-020-00613-4"},{"key":"S0129065725500686BIB012","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2020.3028167"},{"key":"S0129065725500686BIB013","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2019.05.039"},{"key":"S0129065725500686BIB014","unstructured":"Y. Liu, Y. Ma, W. Zhou, G. Zhu and N. Zheng, BrainCLIP: Bridging brain and visual-linguistic representation via CLIP for generic natural visual stimulus decoding, preprint (2023), arXiv:2302.12971."},{"key":"S0129065725500686BIB015","doi-asserted-by":"publisher","DOI":"10.1142\/S012906572450031X"},{"key":"S0129065725500686BIB016","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065723500673"},{"key":"S0129065725500686BIB017","unstructured":"T. B. Brown, Language models are few-shot learners, preprint (2020), arXiv:2005.14165."},{"key":"S0129065725500686BIB018","doi-asserted-by":"crossref","unstructured":"Z. Du, Y. Qian, X. Liu, M. Ding, J. Qiu, Z. Yang and J. Tang, GLM: General language model pretraining with autoregressive blank infilling, preprint (2021), arXiv:2103.10360.","DOI":"10.18653\/v1\/2022.acl-long.26"},{"key":"S0129065725500686BIB019","unstructured":"H. Touvron\n                      et al.\n                      , LLaMA: Open and efficient foundation language models, preprint (2023), arXiv:2302. 13971."},{"key":"S0129065725500686BIB020","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065725500091"},{"key":"S0129065725500686BIB021","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2021.106586"},{"key":"S0129065725500686BIB022","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065724500163"},{"key":"S0129065725500686BIB023","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-021-00962-x"},{"key":"S0129065725500686BIB024","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2011.04.015"},{"key":"S0129065725500686BIB025","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2020.3027595"},{"key":"S0129065725500686BIB026","doi-asserted-by":"publisher","DOI":"10.23919\/MVA.2019.8757985"},{"key":"S0129065725500686BIB027","doi-asserted-by":"publisher","DOI":"10.1016\/j.plrev.2014.03.005"},{"key":"S0129065725500686BIB028","doi-asserted-by":"publisher","DOI":"10.1038\/nature17637"},{"key":"S0129065725500686BIB029","doi-asserted-by":"publisher","DOI":"10.1142\/S012906572550008X"},{"key":"S0129065725500686BIB030","unstructured":"M. Ferrante, F. Ozcelik, T. Boccato, R. VanRullen and N. Toschi, Brain captioning: Decoding human brain activity into images and text, preprint (2023), arXiv:2305.11560."},{"key":"S0129065725500686BIB031","unstructured":"A. Radford, K. Narasimhan, T. Salimans and I. Sutskever, Improving language understanding by generative pre-training,\n                      OpenAI blog\n                      (2018), 3."},{"key":"S0129065725500686BIB032","unstructured":"R. Pascanu, On the difficulty of training recurrent neural networks, preprint (2013), arXiv:1211.5063."},{"key":"S0129065725500686BIB033","volume-title":"Advances in Neural Information Processing Systems","volume":"30","author":"Vaswani A.","year":"2017"},{"issue":"8","key":"S0129065725500686BIB034","first-page":"9","volume":"1","author":"Radford A.","year":"2019","journal-title":"OpenAI Blog"},{"key":"S0129065725500686BIB035","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065723500260"},{"key":"S0129065725500686BIB036","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065724500576"},{"key":"S0129065725500686BIB037","doi-asserted-by":"publisher","DOI":"10.1038\/nature21056"},{"key":"S0129065725500686BIB038","unstructured":"S. Chatterjee and D. Samanta, Dreamcatcher: Revealing the language of the brain with fMRI using GPT embedding, preprint (2023), arXiv:2306.10082."},{"key":"S0129065725500686BIB039","unstructured":"B. Mann\n                      et al.\n                      , Language models are few-shot learners, preprint (2020), arXiv:2005.14165."},{"key":"S0129065725500686BIB040","unstructured":"J. Devlin, BERT: Pre-training of deep bidirectional transformers for language understanding, preprint (2018), arXiv:1810.04805."},{"key":"S0129065725500686BIB041","unstructured":"M. Chen\n                      et al.\n                      , Evaluating large language models trained on code, preprint (2021), arXiv:2107.03374."},{"key":"S0129065725500686BIB042","doi-asserted-by":"publisher","DOI":"10.3115\/1072228.1072378"},{"key":"S0129065725500686BIB043","unstructured":"T. Gao, A. Fisch and D. Chen, Making pre-trained language models better few-shot learners, preprint (2020), arXiv:2012.15723."},{"key":"S0129065725500686BIB044","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2011.08.026"},{"key":"S0129065725500686BIB045","unstructured":"W. Mai and Z. Zhang, UniBrain: Unify image reconstruction and captioning all in one diffusion model from human brain activity, preprint (2023), arXiv: 2308.07428."},{"key":"S0129065725500686BIB046","unstructured":"M. Ferrante, T. Boccato, F. Ozcelik, R. VanRullen and N. Toschi, Towards generalized brain decoding of visual stimuli: Cross-subject and dataset perspectives with a simple alignment techniquein, in\n                      Proc. Hum.Centric Represent. Learn.\n                      Workshop AAAI (2024)."},{"key":"S0129065725500686BIB047","first-page":"8748","volume-title":"Int. Conf. Machine Learning","author":"Radford A.","year":"2021"},{"key":"S0129065725500686BIB048","unstructured":"J. Chung, C. Gulcehre, K. Cho and Y. Bengio, Empirical evaluation of gated recurrent neural networks on sequence modeling, preprint (2014), arXiv: 1412.3555."},{"key":"S0129065725500686BIB049","doi-asserted-by":"publisher","DOI":"10.1038\/nature18933"},{"key":"S0129065725500686BIB050","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP49357.2023.10094655"},{"key":"S0129065725500686BIB051","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065725500066"},{"key":"S0129065725500686BIB052","series-title":"JMLR Workshop and Conference Proceedings","first-page":"315","volume-title":"Proc. 14th Int. Conf. Artificial Intelligence and Statistics","author":"Glorot X.","year":"2011"},{"key":"S0129065725500686BIB053","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2024.102573"},{"key":"S0129065725500686BIB054","first-page":"1","author":"Ma Y.","year":"2025","journal-title":"IEEE Trans. Med. Imaging"},{"key":"S0129065725500686BIB055","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"S0129065725500686BIB056","first-page":"311","volume-title":"Proc. 40th Annual Meeting of the Association for Computational Linguistics","author":"Papineni K.","year":"2002"},{"key":"S0129065725500686BIB057","first-page":"74","volume-title":"Text Summarization Branches Out","author":"Lin C.-Y.","year":"2004"},{"key":"S0129065725500686BIB058","first-page":"65","volume-title":"Proc. ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and\/or Summarization","author":"Banerjee S.","year":"2005"},{"key":"S0129065725500686BIB059","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2017.2682102"},{"key":"S0129065725500686BIB060","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-019-04146-4"},{"key":"S0129065725500686BIB061","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065725500078"},{"key":"S0129065725500686BIB062","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-019-04359-7"},{"key":"S0129065725500686BIB063","doi-asserted-by":"publisher","DOI":"10.1142\/S0129065724500096"}],"container-title":["International Journal of Neural Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S0129065725500686","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,2]],"date-time":"2026-01-02T03:40:33Z","timestamp":1767325233000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S0129065725500686"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,26]]},"references-count":63,"journal-issue":{"issue":"02","published-print":{"date-parts":[[2026,2]]}},"alternative-id":["10.1142\/S0129065725500686"],"URL":"https:\/\/doi.org\/10.1142\/s0129065725500686","relation":{},"ISSN":["0129-0657","1793-6462"],"issn-type":[{"type":"print","value":"0129-0657"},{"type":"electronic","value":"1793-6462"}],"subject":[],"published":{"date-parts":[[2025,9,26]]},"article-number":"2550068"}}