{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,28]],"date-time":"2026-01-28T12:59:16Z","timestamp":1769605156571,"version":"3.49.0"},"reference-count":31,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2024,12,8]],"date-time":"2024-12-08T00:00:00Z","timestamp":1733616000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Intelligent Decision Technologies"],"published-print":{"date-parts":[[2025,3]]},"abstract":"<jats:p>Multimodal medical information fusion has emerged as a revolutionary method in intelligent healthcare, allowing complete consideration of patient well-being and tailored treatment strategies. On the other hand, the current approach produces erroneous findings and has problems with the early phases of brain tumour prediction in MRI images. In healthcare, accurate and reliable brain classification of images is essential for diagnosis and strategic decision-making. Currently, semantic gaps are the main problem with brain tumour image classification. To fill the research gap, traditional ML models for classification use handcrafted features, which are low-level yet relatively high-level, and they use intensive approaches for feature extraction and classification. In recent years, substantial improvements have been made in deep learning for automated image classification. Recurrent Neural Networks (RNNs), or deep Convolutional Neural Networks (CNN), have been particularly effective in this multimodal image classification. Hence, this paper presents the Multimodal Fusion Model-assisted Convolutional Neural Network and Recurrent Neural Networks (MFM-CNN-RNN) for automatic image classification in smart healthcare. This study aims to determine if a fusion of CT and MRI brain scans is normal or abnormal. To enhance the accuracy of brain tumour image classification, this method uses the multimodality information within CNNs and RNNs by extracting and fusing unique and complimentary features from different modalities. Within this framework, features have been retrieved using CNN features, while dependencies and classification have been determined using RNN attributes. Because of its design, LSTM excels in time series analysis, which involves processing data in sequential order.<\/jats:p>","DOI":"10.1177\/18724981241299605","type":"journal-article","created":{"date-parts":[[2025,5,20]],"date-time":"2025-05-20T09:51:32Z","timestamp":1747734692000},"page":"928-942","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":2,"title":["Application of multimodal fusion in automatic image classification: Combining CNN and RNN model"],"prefix":"10.1177","volume":"19","author":[{"given":"Xiao","family":"Wang","sequence":"first","affiliation":[{"name":"Information Engineering College, Xi'an FanYi University, Xi\u2019an 710105, Shaanxi, China"}]}],"member":"179","published-online":{"date-parts":[[2024,12,8]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.3390\/diagnostics10080565"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.36548\/jeea.2021.3.005"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/JSTSP.2020.2987728"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2022.105253"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.sigpro.2021.108036"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.32604\/cmc.2022.025977"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.33969\/AIS.2021.31005"},{"key":"e_1_3_2_9_2","first-page":"1","article-title":"A decision support system for multimodal brain tumor classification using deep learning","volume":"8","author":"Sharif MI","year":"2021","unstructured":"Sharif MI, Khan MA, Alhussein M, et al. A decision support system for multimodal brain tumor classification using deep learning. Complex & Intelligent Systems 2021; 8: 1\u201314.","journal-title":"Complex & Intelligent Systems"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2022.109631"},{"key":"e_1_3_2_11_2","doi-asserted-by":"publisher","DOI":"10.1002\/ima.22831"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.3390\/medicina58081090"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.3389\/fonc.2022.819673"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/LSP.2022.3198594"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3052514"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.3390\/sym15081586"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2020.10.031"},{"key":"e_1_3_2_18_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00521-020-05332-5"},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compeleceng.2022.107960"},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.3233\/JIFS-224439"},{"key":"e_1_3_2_21_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3450519","article-title":"Multimodal brain tumor segmentation based on an intelligent UNET-LSTM algorithm in smart hospitals","volume":"21","author":"Hu HX","year":"2021","unstructured":"Hu HX, Mao WJ, Lin ZZ, et al. Multimodal brain tumor segmentation based on an intelligent UNET-LSTM algorithm in smart hospitals. ACM Transactions on Internet Technology 2021; 21: 1\u201314.","journal-title":"ACM Transactions on Internet Technology"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2023.01.022"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.phycom.2020.101119"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1111\/exsy.12764"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2022.3168887"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2021.07.024"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00530-020-00706-0"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.micpro.2021.103958"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40747-020-00216-6"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3097614"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.3390\/s22030807"},{"key":"e_1_3_2_32_2","unstructured":"https:\/\/www.kaggle.com\/datasets\/chenghanpu\/brain-tumor-mri-and-ct-scan"}],"container-title":["Intelligent Decision Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/18724981241299605","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/18724981241299605","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/18724981241299605","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T22:58:52Z","timestamp":1769554732000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/18724981241299605"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,8]]},"references-count":31,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,3]]}},"alternative-id":["10.1177\/18724981241299605"],"URL":"https:\/\/doi.org\/10.1177\/18724981241299605","relation":{},"ISSN":["1872-4981","1875-8843"],"issn-type":[{"value":"1872-4981","type":"print"},{"value":"1875-8843","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,8]]}}}