{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T02:37:48Z","timestamp":1781663868789,"version":"3.54.5"},"reference-count":29,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,7,29]],"date-time":"2024-07-29T00:00:00Z","timestamp":1722211200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neuroinform."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>Brain diseases, particularly the classification of gliomas and brain metastases and the prediction of HT in strokes, pose significant challenges in healthcare. Existing methods, relying predominantly on clinical data or imaging-based techniques such as radiomics, often fall short in achieving satisfactory classification accuracy. These methods fail to adequately capture the nuanced features crucial for accurate diagnosis, often hindered by noise and the inability to integrate information across various scales.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>We propose a novel approach that mask attention mechanisms with multi-scale feature fusion for Multimodal brain disease classification tasks, termed <jats:italic>M<\/jats:italic><jats:sup>3<\/jats:sup>, which aims to extract features highly relevant to the disease. The extracted features are then dimensionally reduced using Principal Component Analysis (PCA), followed by classification with a Support Vector Machine (SVM) to obtain the predictive results.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Our methodology underwent rigorous testing on multi-parametric MRI datasets for both brain tumors and strokes. The results demonstrate a significant improvement in addressing critical clinical challenges, including the classification of gliomas, brain metastases, and the prediction of hemorrhagic stroke transformations. Ablation studies further validate the effectiveness of our attention mechanism and feature fusion modules.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>These findings underscore the potential of our approach to meet and exceed current clinical diagnostic demands, offering promising prospects for enhancing healthcare outcomes in the diagnosis and treatment of brain diseases.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fninf.2024.1403732","type":"journal-article","created":{"date-parts":[[2024,7,29]],"date-time":"2024-07-29T04:30:24Z","timestamp":1722227424000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["M3: using mask-attention and multi-scale for multi-modal brain MRI classification"],"prefix":"10.3389","volume":"18","author":[{"given":"Guanqing","family":"Kong","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chuanfu","family":"Wu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zongqiu","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chuansheng","family":"Yin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dawei","family":"Qin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,7,29]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"4006","DOI":"10.1038\/ncomms5006","article-title":"Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach","volume":"5","author":"Aerts","year":"2014","journal-title":"Nat. Commun"},{"key":"B2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/1961189.1961199","article-title":"LIBSVM: a library for support vector machines","volume":"2","author":"Chang","year":"2011","journal-title":"ACM Transact. Intell. Syst. Technol"},{"key":"B3","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1016\/j.acra.2020.02.021","article-title":"Clinical-radiomics nomogram for risk estimation of early hematoma expansion after acute intracerebral hemorrhage","volume":"28","author":"Chen","year":"2021","journal-title":"Acad. Radiol"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1904.00625","article-title":"Med3D: Transfer learning for 3D medical image analysis","author":"Chen","year":"2019","journal-title":"arXiv"},{"key":"B5","doi-asserted-by":"publisher","first-page":"103345","DOI":"10.1016\/j.compbiomed.2019.103345","article-title":"Brain tumor classification using deep cnn features via transfer learning","volume":"111","author":"Deepak","year":"2019","journal-title":"Comput. Biol. Med"},{"key":"B6","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1109\/CVPR.2009.5206848","article-title":"\u201cImageNet: a large-scale hierarchical image database,\u201d","volume-title":"2009 IEEE Conference on Computer Vision and Pattern Recognition","author":"Deng","year":"2009"},{"key":"B7","doi-asserted-by":"publisher","first-page":"774","DOI":"10.1016\/j.neuroimage.2012.01.021","article-title":"Freesurfer","volume":"62","author":"Fischl","year":"2012","journal-title":"Neuroimage"},{"key":"B8","doi-asserted-by":"publisher","first-page":"245034","DOI":"10.1088\/1361-6560\/ab79c3","article-title":"Self-channel-and-spatial-attention neural network for automated multi-organ segmentation on head and neck ct images","volume":"65","author":"Gou","year":"2020","journal-title":"Phys. Med. Biol"},{"key":"B9","first-page":"770","article-title":"\u201cDeep residual learning for image recognition,\u201d","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"He","year":"2016"},{"key":"B10","doi-asserted-by":"publisher","first-page":"e13023","DOI":"10.1111\/bpa.13023","article-title":"A deep learning-based model for prediction of hemorrhagic transformation after stroke","volume":"33","author":"Jiang","year":"2023","journal-title":"Brain Pathol"},{"key":"B11","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"B12","first-page":"2117","article-title":"\u201cFeature pyramid networks for object detection,\u201d","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition","author":"Lin","year":"2017"},{"key":"B13","doi-asserted-by":"publisher","first-page":"803","DOI":"10.1007\/s00401-016-1545-1","article-title":"The 2016 world health organization classification of tumors of the central nervous system: a summary","volume":"131","author":"Louis","year":"2016","journal-title":"Acta Neuropathol"},{"key":"B14","doi-asserted-by":"publisher","first-page":"1524","DOI":"10.1161\/STROKEAHA.111.644815","article-title":"Predicting the risk of symptomatic intracerebral hemorrhage in ischemic stroke treated with intravenous alteplase: safe implementation of treatments in stroke (sits) symptomatic intracerebral hemorrhage risk score","volume":"43","author":"Mazya","year":"2012","journal-title":"Stroke"},{"key":"B15","doi-asserted-by":"publisher","first-page":"1394","DOI":"10.1161\/STROKEAHA.117.019740","article-title":"Prediction of tissue outcome and assessment of treatment effect in acute ischemic stroke using deep learning","volume":"49","author":"Nielsen","year":"2018","journal-title":"Stroke"},{"key":"B16","doi-asserted-by":"publisher","first-page":"e010133","DOI":"10.1161\/JAHA.118.010133","article-title":"Hemorrhagic transformation in patients with acute ischemic stroke and atrial fibrillation: time to initiation of oral anticoagulant therapy and outcomes","volume":"7","author":"Paciaroni","year":"2018","journal-title":"J. Am. Heart Assoc"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1912.01703","article-title":"Pytorch: an imperative style, high-performance deep learning library","author":"Paszke","year":"2019","journal-title":"Adv. Neural Inf. Process. Syst"},{"key":"B18","doi-asserted-by":"publisher","first-page":"1457","DOI":"10.13005\/bpj\/1511","article-title":"Brain tumor classification using convolutional neural networks","volume":"11","author":"Seetha","year":"2018","journal-title":"Biomed. Pharmacol. J"},{"key":"B19","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1109\/JBHI.2020.2986926","article-title":"Multi-scale self-guided attention for medical image segmentation","volume":"25","author":"Sinha","year":"2020","journal-title":"IEEE J. Biomed. Health Inf"},{"key":"B20","doi-asserted-by":"publisher","first-page":"S208","DOI":"10.1016\/j.neuroimage.2004.07.051","article-title":"Advances in functional and structural MR image analysis and implementation as FSL","volume":"23","author":"Smith","year":"2004","journal-title":"Neuroimage"},{"key":"B21","doi-asserted-by":"publisher","first-page":"752","DOI":"10.1161\/STROKEAHA.113.003806","article-title":"Symptomatic intracranial hemorrhage after stroke thrombolysis: comparison of prediction scores","volume":"45","author":"Strbian","year":"2014","journal-title":"Stroke"},{"key":"B22","doi-asserted-by":"publisher","first-page":"111","DOI":"10.3390\/cancers11010111","article-title":"A review on a deep learning perspective in brain cancer classification","volume":"11","author":"Tandel","year":"2019","journal-title":"Cancers"},{"key":"B23","doi-asserted-by":"publisher","first-page":"1310","DOI":"10.1109\/TMI.2010.2046908","article-title":"N4ITK: improved N3 bias correction","volume":"29","author":"Tustison","year":"2010","journal-title":"IEEE Trans. Med. Imaging"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1706.03762","article-title":"Attention is all you need","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst"},{"key":"B25","doi-asserted-by":"publisher","first-page":"108","DOI":"10.3810\/hp.2013.04.1060","article-title":"Management of acute ischemic stroke","volume":"41","author":"Vidal","year":"2013","journal-title":"Hosp. Pract"},{"key":"B26","doi-asserted-by":"publisher","first-page":"e254","DOI":"10.1161\/CIR.0000000000000950","article-title":"Heart disease and stroke statistics-2021 update: a report from the american heart association","volume":"143","author":"Virani","year":"2021","journal-title":"Circulation"},{"key":"B27","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1016\/0169-7439(87)80084-9","article-title":"Principal component analysis","volume":"2","author":"Wold","year":"1987","journal-title":"Chemometr. Intell. Lab. Syst"},{"key":"B28","doi-asserted-by":"publisher","first-page":"290","DOI":"10.1007\/s10278-017-0037-8","article-title":"Simpleitk image-analysis notebooks: a collaborative environment for education and reproducible research","volume":"31","author":"Yaniv","year":"2018","journal-title":"J. Digit. Imaging"},{"key":"B29","doi-asserted-by":"publisher","first-page":"7052","DOI":"10.1002\/mp.15287","article-title":"Weaving attention U-net: a novel hybrid CNN and attention-based method for organs-at-risk segmentation in head and neck CT images","volume":"48","author":"Zhang","year":"2021","journal-title":"Med. Phys"}],"container-title":["Frontiers in Neuroinformatics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fninf.2024.1403732\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,29]],"date-time":"2024-07-29T04:30:33Z","timestamp":1722227433000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fninf.2024.1403732\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,29]]},"references-count":29,"alternative-id":["10.3389\/fninf.2024.1403732"],"URL":"https:\/\/doi.org\/10.3389\/fninf.2024.1403732","relation":{},"ISSN":["1662-5196"],"issn-type":[{"value":"1662-5196","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,29]]},"article-number":"1403732"}}