{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,22]],"date-time":"2026-10-22T13:26:51Z","timestamp":1792675611563,"version":"4.5.0"},"reference-count":59,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2025,5,19]],"date-time":"2025-05-19T00:00:00Z","timestamp":1747612800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Intell. Syst. Technol."],"published-print":{"date-parts":[[2025,6,30]]},"abstract":"<jats:p>Multimodal brain graph transformers have become one of the foundational architectures of graph foundation models for brain science, relying on multimodal brain network fusion. However, most current multimodal brain network fusion methods primarily focus on modality-specific information fusion. The interplays within structural-functional brain networks are often ignored. Therefore, they fail to acquire essential coupling information, which is crucial for obtaining robust joint brain network representations. This oversight inevitably limits the effectiveness and generalization of these representations in various downstream tasks. To this end, we propose a novel joint structural-functional brain graph transformer model (namely sfBGT). Technically, we design a cross-network assortativity quantification mechanism to enable structural-functional brain network coupling, thus capturing the interplays of brain structure and function. We then employ a multimodal graph transformer to effectively learn joint representations of structural-functional brain networks along with their coupling relation representations. Experimental results on three real-world datasets demonstrate the superiority of sfBGT over state-of-the-art baselines.<\/jats:p>","DOI":"10.1145\/3729243","type":"journal-article","created":{"date-parts":[[2025,4,12]],"date-time":"2025-04-12T20:37:35Z","timestamp":1744490255000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":2,"title":["Joint Structural-Functional Brain Graph Transformer"],"prefix":"10.1145","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3580-5402","authenticated-orcid":false,"given":"Ciyuan","family":"Peng","sequence":"first","affiliation":[{"name":"Institute of Innovation, Science and Sustainability, Federation University Australia, Ballarat, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7916-1645","authenticated-orcid":false,"given":"Huafei","family":"Huang","sequence":"additional","affiliation":[{"name":"STEM, University of South Australia, Adelaide, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-0378-1324","authenticated-orcid":false,"given":"Tianqi","family":"Guo","sequence":"additional","affiliation":[{"name":"Sussex Artificial Intelligence Institute, Zhejiang Gongshang University, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-5063-2167","authenticated-orcid":false,"given":"Chengxuan","family":"Meng","sequence":"additional","affiliation":[{"name":"School of Information and Electronic Engineering, Zhejiang Gongshang University, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3373-6164","authenticated-orcid":false,"given":"Jingjing","family":"Zhou","sequence":"additional","affiliation":[{"name":"School of Information and Electronic Engineering, Zhejiang Gongshang University, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3740-4829","authenticated-orcid":false,"given":"Wenhong","family":"Zhao","sequence":"additional","affiliation":[{"name":"Ultraprecision Machining Center, Zhejiang University of Technology, Hangzhou, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8909-5728","authenticated-orcid":false,"given":"Ruwan","family":"Tennakoon","sequence":"additional","affiliation":[{"name":"School of Computing Technologies, RMIT University, Melbourne, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8324-1859","authenticated-orcid":false,"given":"Feng","family":"Xia","sequence":"additional","affiliation":[{"name":"School of Computing Technologies, RMIT University, Melbourne, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,5,19]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12031-007-0029-0"},{"issue":"2","key":"e_1_3_2_3_2","first-page":"456","article-title":"Graph transformer geometric learning of brain networks using multimodal MR images for brain age estimation","volume":"42","author":"Cai Hongjie","year":"2022","unstructured":"Hongjie Cai, Yue Gao, and Manhua Liu. 2022. Graph transformer geometric learning of brain networks using multimodal MR images for brain age estimation. IEEE Transactions on Medical Imaging 42, 2 (2022), 456\u2013466.","journal-title":"IEEE Transactions on Medical Imaging"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3626772.3657971"},{"key":"e_1_3_2_5_2","first-page":"13260","article-title":"Principal neighbourhood aggregation for graph nets","volume":"33","author":"Corso Gabriele","year":"2020","unstructured":"Gabriele Corso, Luca Cavalleri, Dominique Beaini, Pietro Li\u00f2, and Petar Veli\u010dkovi\u0107. 2020. Principal neighbourhood aggregation for graph nets. In Advances in Neural Information Processing Systems, Vol. 33, 13260\u201313271.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2022.3218745"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neurobiolaging.2018.11.005"},{"key":"e_1_3_2_8_2","first-page":"1798","volume-title":"Companion Proceedings of the ACM on Web Conference","author":"Damianou Andreas","year":"2024","unstructured":"Andreas Damianou, Francesco Fabbri, Paul Gigioli, Marco De Nadai, Alice Wang, Enrico Palumbo, and Mounia Lalmas. 2024. Towards graph foundation models for personalization. In Companion Proceedings of the ACM on Web Conference, 1798\u20131802."},{"key":"e_1_3_2_9_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Deng Chenhui","year":"2024","unstructured":"Chenhui Deng, Zichao Yue, and Zhiru Zhang. 2024. Polynormer: Polynomial-expressive graph transformer in linear time. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_10_2","unstructured":"Vijay Prakash Dwivedi and Xavier Bresson. 2020. A generalization of transformer networks to graphs. arXiv:2012.09699. Retrieved from https:\/\/arxiv.org\/abs\/2012.09699"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2022.3217767"},{"issue":"4","key":"e_1_3_2_12_2","doi-asserted-by":"crossref","first-page":"4974","DOI":"10.1109\/TNNLS.2022.3202535","article-title":"A stepwise multivariate granger causality method for constructing hierarchical directed brain functional network","volume":"35","author":"Gao Qing","year":"2024","unstructured":"Qing Gao, Ning Luo, Minfeng Liang, Weiqi Zhou, Yan Li, Rong Li, Xiaofei Hu, Ting Zou, Xuyang Wang, Jiali Yu, et al. 2024. A stepwise multivariate granger causality method for constructing hierarchical directed brain functional network. IEEE Transactions on Neural Networks and Learning Systems 35, 4 (2024), 4974\u20134984.","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"e_1_3_2_13_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Guo Xiaojun","year":"2023","unstructured":"Xiaojun Guo, Yifei Wang, Tianqi Du, and Yisen Wang. 2023. ContraNorm: A contrastive learning perspective on oversmoothing and beyond. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_14_2","first-page":"1024","article-title":"Inductive representation learning on large graphs","author":"Hamilton William L.","year":"2017","unstructured":"William L. Hamilton, Zhitao Ying, and Jure Leskovec. 2017. Inductive representation learning on large graphs. In Advances in Neural Information Processing Systems, 1024\u20131034.","journal-title":"Advances in Neural Information Processing Systems"},{"issue":"2","key":"e_1_3_2_15_2","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1038\/nrn730","article-title":"What does fMRI tell us about neuronal activity?","volume":"3","author":"Heeger David J.","year":"2002","unstructured":"David J. Heeger and David Ress. 2002. What does fMRI tell us about neuronal activity? Nature Reviews Neuroscience 3, 2 (2002), 142\u2013151.","journal-title":"Nature Reviews Neuroscience"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1002\/jmri.21049"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2021.3106299"},{"key":"e_1_3_2_18_2","first-page":"25586","article-title":"Brain network transformer","volume":"35","author":"Kan Xuan","year":"2022","unstructured":"Xuan Kan, Wei Dai, Hejie Cui, Zilong Zhang, Ying Guo, and Carl Yang. 2022. Brain network transformer. In Advances in Neural Information Processing Systems, Vol. 35, 25586\u201325599.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_19_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Kingma Diederik P.","year":"2015","unstructured":"Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_20_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Kipf Thomas N.","year":"2017","unstructured":"Thomas N. Kipf and Max Welling. 2017. Semi-supervised classification with graph convolutional networks. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_21_2","first-page":"21618","article-title":"Rethinking graph transformers with spectral attention","volume":"34","author":"Kreuzer Devin","year":"2021","unstructured":"Devin Kreuzer, Dominique Beaini, Will Hamilton, Vincent L\u00e9tourneau, and Prudencio Tossou. 2021. Rethinking graph transformers with spectral attention. In Advances in Neural Information Processing Systems, Vol. 34, 21618\u201321629.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3539618.3591723"},{"key":"e_1_3_2_23_2","first-page":"1223","volume-title":"Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining","author":"Li Gaotang","year":"2023","unstructured":"Gaotang Li, Marlena Duda, Xiang Zhang, Danai Koutra, and Yujun Yan. 2023. Interpretable sparsification of brain graphs: Better practices and effective designs for graph neural networks. In Proceedings of the ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 1223\u20131234."},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2021.102233"},{"key":"e_1_3_2_25_2","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence","author":"Luo Renqiang","year":"2025","unstructured":"Renqiang Luo, Huafei Huang, Ivan Lee, Chengpei Xu, Jianzhong Qi, and Feng Xia. 2025. FairGP: A scalable and fair graph transformer using graph partitioning. In Proceedings of the AAAI Conference on Artificial Intelligence."},{"key":"e_1_3_2_26_2","volume-title":"Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI \u201924)","author":"Luo Renqiang","year":"2024","unstructured":"Renqiang Luo, Huafei Huang, Shuo Yu, Xiuzhen Zhang, and Feng Xia. 2024. FairGT: A fairness-aware graph transformer. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI \u201924)."},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1038\/s42254-019-0040-8"},{"issue":"12","key":"e_1_3_2_28_2","doi-asserted-by":"crossref","first-page":"1460","DOI":"10.1002\/acn3.644","article-title":"The Parkinson\u2019s progression markers initiative (PPMI)\u2013establishing a PD biomarker cohort","volume":"5","author":"Marek Kenneth","year":"2018","unstructured":"Kenneth Marek, Sohini Chowdhury, Andrew Siderowf, Shirley Lasch, Christopher S. Coffey, Chelsea Caspell-Garcia, Tanya Simuni, Danna Jennings, Caroline M. Tanner, John Q. Trojanowski, et al. 2018. The Parkinson\u2019s progression markers initiative (PPMI)\u2013establishing a PD biomarker cohort. Annals of Clinical and Translational Neurology 5, 12 (2018), 1460\u20131477.","journal-title":"Annals of Clinical and Translational Neurology"},{"key":"e_1_3_2_29_2","article-title":"mBGT: Encoding brain signals with multimodal brain graph transformer","author":"Peng Ciyuan","year":"2024","unstructured":"Ciyuan Peng, Tianqi Guo, Chengyao Xie, Xiaomei Bai, Jingjing Zhou, Xiaohui Zhao, Estrid He, and Feng Xia. 2024. mBGT: Encoding brain signals with multimodal brain graph transformer. IEEE Transactions on Consumer Electronics.","journal-title":"IEEE Transactions on Consumer Electronics"},{"key":"e_1_3_2_30_2","unstructured":"Ciyuan Peng Jiayuan He and Feng Xia. 2024. Learning on multimodal graphs: A survey. arXiv:2402.05322. Retrieved from https:\/\/arxiv.org\/abs\/2402.05322"},{"key":"e_1_3_2_31_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Peng Ciyuan","year":"2025","unstructured":"Ciyuan Peng, Yuelong Huang, Qichao Dong, Shuo Yu, Feng Xia, Chengqi Zhang, and Yaochu Jin. 2025. Biologically plausible brain graph transformer. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_32_2","article-title":"Adaptive brain network augmentation based on group-aware graph learning","author":"Peng Ciyuan","year":"2024","unstructured":"Ciyuan Peng, Mujie Liu, Chenxuan Meng, Shuo Yu, and Feng Xia. 2024. Adaptive brain network augmentation based on group-aware graph learning. In The 2nd Tiny Papers Track at ICLR.","journal-title":"The 2nd Tiny Papers Track at ICLR"},{"issue":"9","key":"e_1_3_2_33_2","doi-asserted-by":"crossref","first-page":"3161","DOI":"10.1109\/TMI.2024.3386937","article-title":"3D multimodal fusion network with disease-induced joint learning for early alzheimer\u2019s disease diagnosis","volume":"43","author":"Qiu Zifeng","year":"2024","unstructured":"Zifeng Qiu, Peng Yang, Chunlun Xiao, Shuqiang Wang, Xiaohua Xiao, Jing Qin, Chuan-Ming Liu, Tianfu Wang, and Baiying Lei. 2024. 3D multimodal fusion network with disease-induced joint learning for early alzheimer\u2019s disease diagnosis. IEEE Transactions on Medical Imaging 43, 9 (2024), 3161\u20133175.","journal-title":"IEEE Transactions on Medical Imaging"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2019.116189"},{"key":"e_1_3_2_35_2","first-page":"12559","article-title":"Self-supervised graph transformer on large-scale molecular data","volume":"33","author":"Rong Yu","year":"2020","unstructured":"Yu Rong, Yatao Bian, Tingyang Xu, Weiyang Xie, Ying Wei, Wenbing Huang, and Junzhou Huang. 2020. Self-supervised graph transformer on large-scale molecular data. In Advances in Neural Information Processing Systems, Vol. 33, 12559\u201312571.","journal-title":"Advances in Neural Information Processing Systems"},{"issue":"9","key":"e_1_3_2_36_2","doi-asserted-by":"crossref","first-page":"557","DOI":"10.1038\/s41583-023-00718-5","article-title":"Brain network communication: concepts, models and applications","volume":"24","author":"Seguin Caio","year":"2023","unstructured":"Caio Seguin, Olaf Sporns, and Andrew Zalesky. 2023. Brain network communication: concepts, models and applications. Nature Reviews Neuroscience 24, 9 (2023), 557\u2013574.","journal-title":"Nature Reviews Neuroscience"},{"key":"e_1_3_2_37_2","unstructured":"Ahsan Shehzad Feng Xia Shagufta Abid Ciyuan Peng Shuo Yu Dongyu Zhang and Karin Verspoor. 2024. Graph transformers: A survey. arXiv:2407.09777. Retrieved from https:\/\/arxiv.org\/abs\/2407.09777"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2022.3187141"},{"key":"e_1_3_2_39_2","article-title":"From EEG data to brain networks: Graph learning based brain disease diagnosis","author":"Sun Ke","year":"2024","unstructured":"Ke Sun, Ciyuan Peng, Shuo Yu, Zhuoyang Han, and Feng Xia. 2024. From EEG data to brain networks: Graph learning based brain disease diagnosis. IEEE Intelligent Systems.","journal-title":"IEEE Intelligent Systems"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2022.3220220"},{"key":"e_1_3_2_41_2","first-page":"3157","volume-title":"IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)","author":"Valenchon Juliette","year":"2019","unstructured":"Juliette Valenchon and Mark Coates. 2019. Multiple-graph recurrent graph convolutional neural network architectures for predicting disease outcomes. In IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 3157\u20133161."},{"key":"e_1_3_2_42_2","article-title":"Attention is all you need","volume":"30","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Advances in Neural Information Processing Systems, Vol. 30.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_43_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Velickovic Petar","year":"2018","unstructured":"Petar Velickovic, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Li\u00f2, and Yoshua Bengio. 2018. Graph attention networks. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1109\/JBHI.2023.3274531"},{"issue":"1","key":"e_1_3_2_45_2","doi-asserted-by":"crossref","first-page":"2604","DOI":"10.1038\/s41467-024-46796-6","article-title":"The genetic architecture of multimodal human brain age","volume":"15","author":"Wen Junhao","year":"2024","unstructured":"Junhao Wen, Bingxin Zhao, Zhijian Yang, Guray Erus, Ioanna Skampardoni, Elizabeth Mamourian, Yuhan Cui, Gyujoon Hwang, Jingxuan Bao, Aleix Boquet-Pujadas, et al. 2024. The genetic architecture of multimodal human brain age. Nature Communications 15, 1 (2024), 2604.","journal-title":"Nature Communications"},{"key":"e_1_3_2_46_2","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Xing Yujie","year":"2024","unstructured":"Yujie Xing, Xiao Wang, Yibo Li, Hai Huang, and Chuan Shi. 2024. Less is more: On the over-globalizing problem in graph transformers. In Proceedings of the International Conference on Machine Learning."},{"key":"e_1_3_2_47_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Xu Keyulu","year":"2019","unstructured":"Keyulu Xu, Weihua Hu, Jure Leskovec, and Stefanie Jegelka. 2019. How powerful are graph neural networks?. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2022.106518"},{"key":"e_1_3_2_49_2","article-title":"RH-BrainFS: Regional heterogeneous multimodal brain networks fusion strategy","author":"Ye Hongting","year":"2023","unstructured":"Hongting Ye, Yalu Zheng, Yueying Li, Ke Zhang, Youyong Kong, and Yonggui Yuan. 2023. RH-BrainFS: Regional heterogeneous multimodal brain networks fusion strategy. In Advances in Neural Information Processing Systems.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_50_2","first-page":"28877","article-title":"Do transformers really perform badly for graph representation?","volume":"34","author":"Ying Chengxuan","year":"2021","unstructured":"Chengxuan Ying, Tianle Cai, Shengjie Luo, Shuxin Zheng, Guolin Ke, Di He, Yanming Shen, and Tie-Yan Liu. 2021. Do transformers really perform badly for graph representation? In Advances in Neural Information Processing Systems, Vol. 34, 28877\u201328888.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_51_2","article-title":"Long-range brain graph transformer","author":"Yu Shuo","year":"2024","unstructured":"Shuo Yu, Shan Jin, Ming Li, Tabinda Sarwar, and Feng Xia. 2024. Long-range brain graph transformer. In Advances in Neural Information Processing Systems.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_52_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2022.05.026"},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2024.102345"},{"key":"e_1_3_2_54_2","doi-asserted-by":"crossref","first-page":"kkad033","DOI":"10.1093\/psyrad\/kkad033","article-title":"Exploring Alzheimer\u2019s disease: A comprehensive brain connectome-based survey","volume":"4","author":"Zhang Lu","year":"2024","unstructured":"Lu Zhang, Junqi Qu, Haotian Ma, Tong Chen, Tianming Liu, and Dajiang Zhu. 2024. Exploring Alzheimer\u2019s disease: A comprehensive brain connectome-based survey. Psychoradiology 4 (2024), kkad033.","journal-title":"Psychoradiology"},{"issue":"6","key":"e_1_3_2_55_2","doi-asserted-by":"crossref","first-page":"7339","DOI":"10.1109\/TNNLS.2022.3214225","article-title":"An explainable and generalizable recurrent neural network approach for differentiating human brain states on EEG dataset","volume":"35","author":"Zhang Shu","year":"2024","unstructured":"Shu Zhang, Lin Wu, Sigang Yu, Enze Shi, Ning Qiang, Huan Gao, Jingyi Zhao, and Shijie Zhao. 2024. An explainable and generalizable recurrent neural network approach for differentiating human brain states on EEG dataset. IEEE Transactions on Neural Networks and Learning Systems 35, 6 (2024), 7339\u20137350.","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"e_1_3_2_56_2","doi-asserted-by":"crossref","unstructured":"Yutong Zhang Yi Pan Tianyang Zhong Peixin Dong Kangni Xie Yuxiao Liu Hanqi Jiang Zhengliang Liu Shijie Zhao Tuo Zhang et al. 2024. Potential of multimodal large language models for data mining of medical images and free-text reports. arXiv:2407.05758. Retrieved from https:\/\/arxiv.org\/abs\/2407.05758","DOI":"10.1016\/j.metrad.2024.100103"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2020.07.006"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2022.06.035"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2022.3159264"},{"issue":"12","key":"e_1_3_2_60_2","doi-asserted-by":"crossref","first-page":"3884","DOI":"10.1109\/TMI.2022.3199032","article-title":"Multimodal triplet attention network for brain disease diagnosis","volume":"41","author":"Zhu Qi","year":"2022","unstructured":"Qi Zhu, Heyang Wang, Bingliang Xu, Zhiqiang Zhang, Wei Shao, and Daoqiang Zhang. 2022. Multimodal triplet attention network for brain disease diagnosis. IEEE Transactions on Medical Imaging 41, 12 (2022), 3884\u20133894.","journal-title":"IEEE Transactions on Medical Imaging"}],"container-title":["ACM Transactions on Intelligent Systems and Technology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3729243","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3729243","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T01:56:57Z","timestamp":1750298217000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3729243"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,19]]},"references-count":59,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,6,30]]}},"alternative-id":["10.1145\/3729243"],"URL":"https:\/\/doi.org\/10.1145\/3729243","relation":{},"ISSN":["2157-6904","2157-6912"],"issn-type":[{"value":"2157-6904","type":"print"},{"value":"2157-6912","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,19]]},"assertion":[{"value":"2024-11-05","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-03-30","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-05-19","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}