{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,28]],"date-time":"2026-07-28T10:44:31Z","timestamp":1785235471419,"version":"3.55.0"},"reference-count":38,"publisher":"Public Library of Science (PLoS)","issue":"12","license":[{"start":{"date-parts":[[2024,12,23]],"date-time":"2024-12-23T00:00:00Z","timestamp":1734912000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of Education","award":["2023RIS-007"],"award-info":[{"award-number":["2023RIS-007"]}]}],"content-domain":{"domain":["www.plosone.org"],"crossmark-restriction":false},"short-container-title":["PLoS ONE"],"abstract":"<jats:p>Alzheimer\u2019s disease (AD), the most prevalent degenerative brain disease associated with dementia, requires early diagnosis to alleviate worsening of symptoms through appropriate management and treatment. Recent studies on AD stage classification are increasingly using multimodal data. However, few studies have applied graph neural networks to multimodal data comprising F-18 florbetaben (FBB) amyloid brain positron emission tomography (PET) images and clinical indicators. The objective of this study was to demonstrate the effectiveness of graph convolutional network (GCN) for AD stage classification using multimodal data, specifically FBB PET images and clinical indicators, collected from Dong-A University Hospital (DAUH) and Alzheimer\u2019s Disease Neuroimaging Initiative (ADNI). The effectiveness of GCN was demonstrated through comparisons with the support vector machine, random forest, and multilayer perceptron across four classification tasks (normal control (NC) vs. AD, NC vs. mild cognitive impairment (MCI), MCI vs. AD, and NC vs. MCI vs. AD). As input, all models received the same combined feature vectors, created by concatenating the PET imaging feature vectors extracted by the 3D dense convolutional network and non-imaging feature vectors consisting of clinical indicators using multimodal feature fusion method. An adjacency matrix for the population graph was constructed using cosine similarity or the Euclidean distance between subjects\u2019 PET imaging feature vectors and\/or non-imaging feature vectors. The usage ratio of these different modal data and edge assignment threshold were tuned by setting them as hyperparameters. In this study, GCN-CS-com and GCN-ED-com were the GCN models that received the adjacency matrix constructed using cosine similarity (CS) and the Euclidean distance (ED) between the subjects\u2019 PET imaging feature vectors and non-imaging feature vectors, respectively. In modified nested cross validation, GCN-CS-com and GCN-ED-com respectively achieved average test accuracies of 98.40%, 94.58%, 94.01%, 82.63% and 99.68%, 93.82%, 93.88%, 90.43% for the four aforementioned classification tasks using DAUH dataset, outperforming the other models. Furthermore, GCN-CS-com and GCN-ED-com respectively achieved average test accuracies of 76.16% and 90.11% for NC vs. MCI vs. AD classification using ADNI dataset, outperforming the other models. These results demonstrate that GCN could be an effective model for AD stage classification using multimodal data.<\/jats:p>","DOI":"10.1371\/journal.pone.0315809","type":"journal-article","created":{"date-parts":[[2024,12,23]],"date-time":"2024-12-23T18:23:32Z","timestamp":1734978212000},"page":"e0315809","update-policy":"https:\/\/doi.org\/10.1371\/journal.pone.corrections_policy","source":"Crossref","is-referenced-by-count":8,"title":["Multimodal feature fusion-based graph convolutional networks for Alzheimer\u2019s disease stage classification using F-18 florbetaben brain PET images and clinical indicators"],"prefix":"10.1371","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-2470-6029","authenticated-orcid":true,"given":"Gyu-Bin","family":"Lee","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Young-Jin","family":"Jeong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1688-0818","authenticated-orcid":true,"given":"Do-Young","family":"Kang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hyun-Jin","family":"Yun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Min","family":"Yoon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2024,12,23]]},"reference":[{"issue":"1","key":"pone.0315809.ref001","first-page":"32","article-title":"Neuropathology of Alzheimer\u2019s disease","volume":"77","author":"DP Perl","year":"2010","journal-title":"Mount Sinai Journal of Medicine: A Journal of Translational and Personalized Medicine: A Journal of Translational and Personalized Medicine"},{"issue":"1","key":"pone.0315809.ref002","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1111\/ene.13439","article-title":"Alzheimer\u2019s disease","volume":"25","author":"CA Lane","year":"2018","journal-title":"European journal of neurology"},{"issue":"1","key":"pone.0315809.ref003","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1186\/s13024-019-0333-5","article-title":"The neuropathological diagnosis of Alzheimer\u2019s disease","volume":"14","author":"MA DeTure","year":"2019","journal-title":"Mol Neurodegener"},{"key":"pone.0315809.ref004","doi-asserted-by":"crossref","first-page":"12","DOI":"10.4306\/jknpa.2018.57.1.12","article-title":"Current knowledge and clinical application of brain imaging in Alzheimer\u2019s disease","author":"DW KANG","year":"2018","journal-title":"Journal of Korean Neuropsychiatric Association"},{"issue":"10","key":"pone.0315809.ref005","doi-asserted-by":"crossref","first-page":"e0258214","DOI":"10.1371\/journal.pone.0258214","article-title":"Performance evaluation in [18F]Florbetaben brain PET images classification using 3D Convolutional Neural Network","volume":"16","author":"SY Lee","year":"2021","journal-title":"PLoS One"},{"issue":"4","key":"pone.0315809.ref006","doi-asserted-by":"crossref","first-page":"753","DOI":"10.1016\/j.cger.2013.07.003","article-title":"Classification and epidemiology of MCI","volume":"29","author":"R Roberts","year":"2013","journal-title":"Clin Geriatr Med"},{"issue":"2","key":"pone.0315809.ref007","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1109\/TPAMI.2018.2798607","article-title":"Multimodal machine learning: A survey and taxonomy","volume":"41","author":"T Baltru\u0161aitis","year":"2018","journal-title":"IEEE transactions on pattern analysis and machine intelligence"},{"issue":"2","key":"pone.0315809.ref008","doi-asserted-by":"crossref","first-page":"bbab569","DOI":"10.1093\/bib\/bbab569","article-title":"Multimodal deep learning for biomedical data fusion: a review","volume":"23","author":"SR Stahlschmidt","year":"2022","journal-title":"Briefings in Bioinformatics"},{"issue":"1","key":"pone.0315809.ref009","doi-asserted-by":"crossref","first-page":"3254","DOI":"10.1038\/s41598-020-74399-w","article-title":"Multimodal deep learning models for early detection of Alzheimer\u2019s disease stage","volume":"11","author":"J Venugopalan","year":"2021","journal-title":"Sci Rep"},{"issue":"1","key":"pone.0315809.ref010","doi-asserted-by":"crossref","first-page":"3404","DOI":"10.1038\/s41467-022-31037-5","article-title":"Multimodal deep learning for Alzheimer\u2019s disease dementia assessment","volume":"13","author":"S Qiu","year":"2022","journal-title":"Nat Commun"},{"issue":"12","key":"pone.0315809.ref011","doi-asserted-by":"crossref","first-page":"e0225759","DOI":"10.1371\/journal.pone.0225759","article-title":"Neuroimaging modality fusion in Alzheimer\u2019s classification using convolutional neural networks","volume":"14","author":"A Punjabi","year":"2019","journal-title":"PloS one"},{"key":"pone.0315809.ref012","doi-asserted-by":"crossref","first-page":"105901","DOI":"10.1016\/j.compbiomed.2022.105901","article-title":"Alzheimer\u2019s disease diagnosis via multimodal feature fusion","volume":"148","author":"Y Tu","year":"2022","journal-title":"Comput Biol Med"},{"issue":"12","key":"pone.0315809.ref013","doi-asserted-by":"crossref","first-page":"2014","DOI":"10.1093\/jamia\/ocac168","article-title":"Multimodal attention-based deep learning for Alzheimer\u2019s disease diagnosis","volume":"29","author":"M Golovanevsky","year":"2022","journal-title":"Journal of the American Medical Informatics Association"},{"issue":"4","key":"pone.0315809.ref014","article-title":"A Convolutional Neural Network and Graph Convolutional Network Based Framework for AD Classification","volume":"23","author":"L Lin","year":"2023","journal-title":"Sensors (Basel)"},{"key":"pone.0315809.ref015","doi-asserted-by":"crossref","first-page":"107328","DOI":"10.1016\/j.compbiomed.2023.107328","article-title":"Multi-modal graph neural network for early diagnosis of Alzheimer\u2019s disease from sMRI and PET scans","volume":"164","author":"Y Zhang","year":"2023","journal-title":"Comput Biol Med"},{"issue":"4","key":"pone.0315809.ref016","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1007\/s13244-018-0639-9","article-title":"Convolutional neural networks: an overview and application in radiology","volume":"9","author":"R Yamashita","year":"2018","journal-title":"Insights Imaging"},{"key":"pone.0315809.ref017","doi-asserted-by":"crossref","unstructured":"Wang S, Wang H, Shen Y, Wang X. Automatic Recognition of Mild Cognitive Impairment and Alzheimers Disease Using Ensemble based 3D Densely Connected Convolutional Networks. In: 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA); 2018. p. 517\u2013523. Available from: https:\/\/ieeexplore.ieee.org\/document\/8614108\/.","DOI":"10.1109\/ICMLA.2018.00083"},{"issue":"1","key":"pone.0315809.ref018","doi-asserted-by":"crossref","first-page":"3463","DOI":"10.1038\/s41598-024-53733-6","article-title":"A novel CNN architecture for accurate early detection and classification of Alzheimer\u2019s disease using MRI data","volume":"14","author":"A El-Assy","year":"2024","journal-title":"Scientific Reports"},{"key":"pone.0315809.ref019","doi-asserted-by":"crossref","first-page":"16376","DOI":"10.1109\/ACCESS.2023.3244952","article-title":"AlzheimerNet: An effective deep learning based proposition for alzheimer\u2019s disease stages classification from functional brain changes in magnetic resonance images","volume":"11","author":"FJM Shamrat","year":"2023","journal-title":"IEEE Access"},{"issue":"1","key":"pone.0315809.ref020","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s12559-023-10192-x","article-title":"Explainable artificial intelligence in Alzheimer\u2019s disease classification: A systematic review","volume":"16","author":"V Viswan","year":"2024","journal-title":"Cognitive Computation"},{"issue":"6","key":"pone.0315809.ref021","doi-asserted-by":"crossref","first-page":"3453","DOI":"10.3390\/app13063453","article-title":"Vision transformer approach for classification of alzheimer\u2019s disease using 18f-florbetaben brain images","volume":"13","author":"H Shin","year":"2023","journal-title":"Applied Sciences"},{"key":"pone.0315809.ref022","doi-asserted-by":"crossref","unstructured":"Huang G, Liu Z, Van Der Maaten L, Weinberger KQ. Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition; 2017. p. 4700\u20134708.","DOI":"10.1109\/CVPR.2017.243"},{"key":"pone.0315809.ref023","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.aiopen.2021.01.001","article-title":"Graph neural networks: A review of methods and applications","volume":"1","author":"J Zhou","year":"2020","journal-title":"AI open"},{"key":"pone.0315809.ref024","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-031-01588-5","volume-title":"Graph representation learning","author":"WL Hamilton","year":"2020"},{"issue":"1","key":"pone.0315809.ref025","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/TNNLS.2020.2978386","article-title":"A comprehensive survey on graph neural networks","volume":"32","author":"Z Wu","year":"2020","journal-title":"IEEE transactions on neural networks and learning systems"},{"key":"pone.0315809.ref026","unstructured":"Kipf TN, Welling M. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:160902907. 2016;."},{"key":"pone.0315809.ref027","doi-asserted-by":"crossref","unstructured":"Song TA, Chowdhury SR, Yang F, Jacobs H, Fakhri GE, Li Q, et al. Graph Convolutional Neural Networks For Alzheimer\u2019s Disease Classification. In: 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019); 2019. p. 414\u2013417. Available from: https:\/\/ieeexplore.ieee.org\/document\/8759531\/.","DOI":"10.1109\/ISBI.2019.8759531"},{"key":"pone.0315809.ref028","doi-asserted-by":"crossref","first-page":"886365","DOI":"10.3389\/fninf.2022.886365","article-title":"Regional brain fusion: Graph convolutional network for alzheimer\u2019s disease prediction and analysis","volume":"16","author":"W Li","year":"2022","journal-title":"Frontiers in neuroinformatics"},{"issue":"1","key":"pone.0315809.ref029","article-title":"Early prediction of dementia using fMRI data with a graph convolutional network approach","volume":"21","author":"SN Han","year":"2024","journal-title":"Journal of Neural Engineering"},{"key":"pone.0315809.ref030","doi-asserted-by":"crossref","first-page":"104096","DOI":"10.1016\/j.compbiomed.2020.104096","article-title":"Hi-GCN: A hierarchical graph convolution network for graph embedding learning of brain network and brain disorders prediction","volume":"127","author":"H Jiang","year":"2020","journal-title":"Computers in Biology and Medicine"},{"key":"pone.0315809.ref031","doi-asserted-by":"crossref","unstructured":"Kazi A, Shekarforoush S, Kortuem K, Albarqouni S, Navab N. Self-attention equipped graph convolutions for disease prediction. In: 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019). IEEE; 2019. p. 1896\u20131899.","DOI":"10.1109\/ISBI.2019.8759274"},{"key":"pone.0315809.ref032","doi-asserted-by":"crossref","unstructured":"Parisot S, Ktena SI, Ferrante E, Lee M, Moreno RG, Glocker B, et al. Spectral graph convolutions for population-based disease prediction. In: Medical Image Computing and Computer Assisted Intervention- MICCAI 2017: 20th International Conference, Quebec City, QC, Canada, September 11-13, 2017, Proceedings, Part III 20. Springer; 2017. p. 177\u2013185.","DOI":"10.1007\/978-3-319-66179-7_21"},{"issue":"15","key":"pone.0315809.ref033","doi-asserted-by":"crossref","first-page":"7355","DOI":"10.3390\/app12157355","article-title":"Classification of Alzheimer\u2019s Disease Using Dual-Phase 18F-Florbetaben Image with Rank-Based Feature Selection and Machine Learning","volume":"12","author":"HJ Shin","year":"2022","journal-title":"Applied Sciences"},{"issue":"2","key":"pone.0315809.ref034","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1007\/s13139-022-00767-1","article-title":"Alzheimer\u2019s Disease prediction using attention mechanism with dual-phase 18F-Florbetaben images","volume":"57","author":"H Kang","year":"2023","journal-title":"Nuclear Medicine and Molecular Imaging"},{"issue":"4","key":"pone.0315809.ref035","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1002\/hbm.10123","article-title":"Three-dimensional maximum probability atlas of the human brain, with particular reference to the temporal lobe","volume":"19","author":"A Hammers","year":"2003","journal-title":"Hum Brain Mapp"},{"key":"pone.0315809.ref036","doi-asserted-by":"crossref","unstructured":"Steck H, Ekanadham C, Kallus N. Is cosine-similarity of embeddings really about similarity? In: Companion Proceedings of the ACM on Web Conference 2024; 2024. p. 887\u2013890.","DOI":"10.1145\/3589335.3651526"},{"key":"pone.0315809.ref037","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1016\/j.media.2018.06.001","article-title":"Disease prediction using graph convolutional networks: Application to Autism Spectrum Disorder and Alzheimer\u2019s disease","volume":"48","author":"S Parisot","year":"2018","journal-title":"Med Image Anal"},{"issue":"2","key":"pone.0315809.ref038","doi-asserted-by":"crossref","first-page":"e31112","DOI":"10.1371\/journal.pone.0031112","article-title":"Improved classification of Alzheimer\u2019s disease data via removal of nuisance variability","volume":"7","author":"J Koikkalainen","year":"2012","journal-title":"PloS one"}],"container-title":["PLOS ONE"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0315809","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,23]],"date-time":"2024-12-23T18:23:50Z","timestamp":1734978230000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pone.0315809"}},"subtitle":[],"editor":[{"given":"Zhan-Heng","family":"Chen","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2024,12,23]]},"references-count":38,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2024,12,23]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pone.0315809","relation":{},"ISSN":["1932-6203"],"issn-type":[{"value":"1932-6203","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,23]]}}}