{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,20]],"date-time":"2025-12-20T09:14:29Z","timestamp":1766222069089,"version":"3.48.0"},"reference-count":36,"publisher":"Walter de Gruyter GmbH","issue":"1","license":[{"start":{"date-parts":[[2025,1,1]],"date-time":"2025-01-01T00:00:00Z","timestamp":1735689600000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,10,8]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Multimodal neural network approaches mirror clinical decision-making processes for therapy optimization. Multiple data sources, including images, electronic health records, and the Internet of medical things, can be challenging for precise diagnoses. In this research, reinforcement learning, specifically deep Q-learning (DQL), utilizing multimodal data, has been employed to determine the most suitable treatment plans, particularly for patients undergoing lung decortication surgery. The model performance has been evaluated using rewards, epsilon decay, and\n                    <jats:italic>Q<\/jats:italic>\n                    -values across three different actions. The model\u2019s performance has also been compared with machine learning models, such as Na\u00efve Bayes, K-nearest neighbor, random forest, logistic regression, and support vector machine, regarding several performance metrics, including accuracy, precision, recall, and the area under the curve. Our findings demonstrate that the DQL model effectively learns optimal actions, significantly enhancing therapy optimization.\n                  <\/jats:p>","DOI":"10.1515\/jisys-2024-0417","type":"journal-article","created":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T11:58:01Z","timestamp":1760011081000},"source":"Crossref","is-referenced-by-count":0,"title":["Multimodal data analysis for post-decortication therapy optimization using IoMT and reinforcement learning"],"prefix":"10.1515","volume":"34","author":[{"given":"Fahad","family":"Masood","sequence":"first","affiliation":[{"name":"Department of Computing, Abasyn University , Peshawar , 25000 , Pakistan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jawad","family":"Ahmad","sequence":"additional","affiliation":[{"name":"Cybersecurity Center, Prince Mohammad Bin Fahd University , Alkhobar , 31952 , Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nada","family":"Alasbali","sequence":"additional","affiliation":[{"name":"Department of Informatics and Computer Systems, College of Computer Science, King Khalid University , Abha 61421 , Saudi Arbia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ibtehal","family":"Nafea","sequence":"additional","affiliation":[{"name":"College of Computer Science and Engineering, Taibah University , Medina 41477 , Saudi Arabia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Faisal","family":"Saeed","sequence":"additional","affiliation":[{"name":"College of Computing, Birmingham City University , Birmingham B4 7XG , United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rahmat","family":"Ullah","sequence":"additional","affiliation":[{"name":"School of Computer Science and Electronic Engineering, University of Essex , Colchester CO4 3SQ , United Kingdom"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"374","published-online":{"date-parts":[[2025,10,8]]},"reference":[{"key":"2025122009032186765_j_jisys-2024-0417_ref_001","doi-asserted-by":"crossref","unstructured":"Rappaport JM, Siddiqui HU, Tang A, Thuita LW, Raja S, Bribriesco A, et al. Pleural space management after lung transplant: Early and late outcomes of pleural decortication. J Heart Lung Transplant. 2021;40(7):623\u201330. https:\/\/doi.org\/10.1016\/j.healun.2021.03.021.","DOI":"10.1016\/j.healun.2021.03.021"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_002","doi-asserted-by":"crossref","unstructured":"Bolourani S, Wang P, Patel VM, Manetta F, Lee PC. Predicting respiratory failure after pulmonary lobectomy using machine learning techniques. Surgery. 2020;168(4):743\u201352. https:\/\/doi.org\/10.1016\/j.surg.2020.05.032.","DOI":"10.1016\/j.surg.2020.05.032"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_003","doi-asserted-by":"crossref","unstructured":"Zorbas KA, Abbas AES, Song KJ, Zorbas IA, Lois W, Burack JH. A simple prediction score for postoperative mortality after decortication. J Thoracic Disease. 2023;15(12):6483. https:\/\/doi.org\/10.21037\/jtd-23-121.","DOI":"10.21037\/jtd-23-121"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_004","doi-asserted-by":"crossref","unstructured":"Liu X, Wang X, Sheng J, Jiang Y, Li L, Dai X. Open decortication for patients presenting with stage III tuberculous empyema with low density lines on CT imaging. Sci Rep. 2023;13(1):9658. https:\/\/doi.org\/10.1038\/s41598-023-36420-w.","DOI":"10.1038\/s41598-023-36420-w"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_005","doi-asserted-by":"crossref","unstructured":"Shaik T, Tao X, Li L, Xie H, Vel\u00e1squez JD. A survey of multimodal information fusion for smart healthcare: Mapping the journey from data to wisdom. Inform Fusion. 2024;102:102040. https:\/\/doi.org\/10.1016\/j.inffus.2023.102040.","DOI":"10.1016\/j.inffus.2023.102040"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_006","doi-asserted-by":"crossref","unstructured":"Cremonesi F, Planat V, Kalokyri V, Kondylakis H, Sanavia T, Resinas VMM. The need for multimodal health data modeling: A practical approach for a federated-learning healthcare platform. J Biomed Inform. 2023;141:104338. https:\/\/doi.org\/10.1016\/j.jbi.2023.104338.","DOI":"10.1016\/j.jbi.2023.104338"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_007","doi-asserted-by":"crossref","unstructured":"Yildirim N, Richardson H, Wetscherek MT, Bajwa J, Jacob J, Pinnock MA, et al. Multimodal healthcare AI: identifying and designing clinically relevant vision-language applications for radiology. In: Proceedings of the CHI Conference on Human Factors in Computing Systems. 2024. p. 1\u201322. https:\/\/doi.org\/10.1145\/3613904.3642013.","DOI":"10.1145\/3613904.3642013"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_008","doi-asserted-by":"crossref","unstructured":"Ahmed SF, Alam MSB, Afrin S, Rafa SJ, Rafa N, Gandomi AH. Insights into Internet of Medical Things (IoMT): Data fusion, security issues and potential solutions. Inform Fusion. 2024;102:102060. https:\/\/doi.org\/10.1016\/j.inffus.2023.102060.","DOI":"10.1016\/j.inffus.2023.102060"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_009","doi-asserted-by":"crossref","unstructured":"Ding X, Zhang Y, Li J, Mao B, Guo Y, Li G. A feasibility study of multi-mode intelligent fusion medical data transmission technology of industrial Internet of Things combined with medical Internet of Things. Internet of Things. 2023;21:100689. https:\/\/doi.org\/10.1016\/j.iot.2023.100689.","DOI":"10.1016\/j.iot.2023.100689"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_010","doi-asserted-by":"crossref","unstructured":"Wornow M, Xu Y, Thapa R, Patel B, Steinberg E, Fleming S, et al. The shaky foundations of large language models and foundation models for electronic health records. npj Digital Med. 2023;6(1):135. https:\/\/doi.org\/10.1038\/s41746-023-00879-8.","DOI":"10.1038\/s41746-023-00879-8"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_011","doi-asserted-by":"crossref","unstructured":"Placido D, Yuan B, Hjaltelin JX, Zheng C, Haue AD, Chmura PJ, et al. A deep learning algorithm to predict risk of pancreatic cancer from disease trajectories. Nature Med. 2023;29(5):1113\u201322. https:\/\/doi.org\/10.1038\/s41591-023-02332-5.","DOI":"10.1038\/s41591-023-02332-5"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_012","doi-asserted-by":"crossref","unstructured":"Sangeetha SKB, Mathivanan SK, Karthikeyan P, Rajadurai H, Shivahare BD, Mallik S et al. An enhanced multimodal fusion deep learning neural network for lung cancer classification. Syst Soft Comput. 2024;6:200068. https:\/\/doi.org\/10.1016\/j.sasc.2023.200068.","DOI":"10.1016\/j.sasc.2023.200068"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_013","unstructured":"Huang SC, Huo Z, Steinberg E, Chiang CC, Langlotz C, Lungren M, et al. INSPECT: a multimodal dataset for patient outcome prediction of pulmonary embolisms. Adv Neural Inform Proces Syst. 2023;36:17742\u201372."},{"key":"2025122009032186765_j_jisys-2024-0417_ref_014","doi-asserted-by":"crossref","unstructured":"Heiliger L, Sekuboyina A, Menze B, Egger J, Kleesiek J. Beyond medical imaging-a review of multimodal deep learning in radiology. TechRxiv, 2022;19103432. https:\/\/doi.org\/10.5167\/uzh-219067.","DOI":"10.36227\/techrxiv.19103432"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_015","doi-asserted-by":"crossref","unstructured":"Steyaert S, Pizurica M, Nagaraj D, Khandelwal P, Hernandez-Boussard T, Gentles AJ, et al. Multimodal data fusion for cancer biomarker discovery with deep learning. Nature Machine Intel. 2023;5(4):351\u201362. https:\/\/doi.org\/10.1038\/s42256-023-00633-5.","DOI":"10.1038\/s42256-023-00633-5"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_016","doi-asserted-by":"crossref","unstructured":"Yap J, Yolland W, Tschandl P. Multimodal skin lesion classification using deep learning. Exper Dermatol. 2018;27(11):1261\u20137. https:\/\/doi.org\/10.1111\/exd.13777.","DOI":"10.1111\/exd.13777"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_017","doi-asserted-by":"crossref","unstructured":"Hernandez L, Kim R, Tokcan N, Derksen H, Biesterveld BE, Croteau A, et al. Multimodal tensor-based method for integrative and continuous patient monitoring during postoperative cardiac care. Artif Intel Med. 2021;113:102032. https:\/\/doi.org\/10.1016\/j.artmed.2021.102032.","DOI":"10.1016\/j.artmed.2021.102032"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_018","doi-asserted-by":"crossref","unstructured":"Masood F, Khan WU, Ullah K, Khan A, Alghamedy FH, Aljuaid H. A hybrid CNN-LSTM random forest model for dysgraphia classification from hand-written characters with uniform\/normal distribution. Appl Sci. 2023;13(7):4275. https:\/\/doi.org\/10.3390\/app13074275.","DOI":"10.3390\/app13074275"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_019","doi-asserted-by":"crossref","unstructured":"Aftab N, Masood F, Ahmad S, Rahim SS, Sanami S, Shaker B, et al. An optimized deep learning approach for blood-brain barrier permeability prediction with ODE integration. Inform Med Unlocked. 2024;48:101526. https:\/\/doi.org\/10.1016\/j.imu.2024.101526.","DOI":"10.1016\/j.imu.2024.101526"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_020","doi-asserted-by":"crossref","unstructured":"Bi XA, Hu X, Xie Y, Wu H. A novel CERNNE approach for predicting Parkinson\u2019s Disease-associated genes and brain regions based on multimodal imaging genetics data. Med Image Anal. 2021;67:101830. https:\/\/doi.org\/10.1016\/j.media.2020.101830.","DOI":"10.1016\/j.media.2020.101830"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_021","doi-asserted-by":"crossref","unstructured":"Yang L, Wang X, Guo Q, Gladstein S, Wooten D, Li T. and Alzheimeras disease neuroimaging initiative. Deep learning based multimodal progression modeling for Alzheimeras disease. Stat Biopharm Res. 2021;13(3):337\u201343. https:\/\/doi.org\/10.1080\/19466315.2021.1884129.","DOI":"10.1080\/19466315.2021.1884129"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_022","doi-asserted-by":"crossref","unstructured":"Lin W, Gao Q, Yuan J, Chen Z, Feng C, Chen W, et al. Predicting Alzheimeras disease conversion from mild cognitive impairment using an extreme learning machine-based grading method with multimodal data. Front Aging Neurosci. 2020;12:77. https:\/\/doi.org\/10.3389\/fnagi.2020.00077.","DOI":"10.3389\/fnagi.2020.00077"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_023","doi-asserted-by":"crossref","unstructured":"El-Sappagh S, Abuhmed T, Islam SR, Kwak KS. Multimodal multitask deep learning model for Alzheimeras disease progression detection based on time series data. Neurocomputing. 2020;412:197\u2013215. https:\/\/doi.org\/10.1016\/j.neucom.2020.05.087.","DOI":"10.1016\/j.neucom.2020.05.087"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_024","doi-asserted-by":"crossref","unstructured":"Venugopalan J, Tong L, Hassanzadeh HR, Wang MD. Multimodal deep learning models for early detection of Alzheimeras disease stage. Sci Reports. 2021;11(1):3254. https:\/\/doi.org\/10.1038\/s41598-020-74399-w.","DOI":"10.1038\/s41598-020-74399-w"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_025","doi-asserted-by":"crossref","unstructured":"Kalmady SV, Paul AK, Narayanaswamy JC, Agrawal R, Shivakumar V, Greenshaw AJ, et al. Prediction of obsessive-compulsive disorder: importance of neurobiology-aided feature design and cross-diagnosis transfer learning. Biol Psychiat Cognitive Neurosci Neuroimag. 2022;7(7):735\u2013746. https:\/\/doi.org\/10.1016\/j.bpsc.2021.12.003.","DOI":"10.1016\/j.bpsc.2021.12.003"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_026","doi-asserted-by":"crossref","unstructured":"Hilbert K, Lueken U, Muehlhan M, Beesdo-Baum K. Separating generalized anxiety disorder from major depression using clinical, hormonal, and structural MRI data: A multimodal machine learning study. Brain Behav. 2017;7(3):e00633. 10.1002\/brb3.633.","DOI":"10.1002\/brb3.633"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_027","doi-asserted-by":"crossref","unstructured":"Kinreich S, Meyers JL, Maron-Katz A, Kamarajan C, Pandey AK, Chorlian DB, et al. Predicting risk for Alcohol Use Disorder using longitudinal data with multimodal biomarkers and family history: a machine learning study. Molecular Psych. 2021;26(4):1133\u20131141. https:\/\/doi.org\/10.1038\/s41380-019-0534-x.","DOI":"10.1038\/s41380-019-0534-x"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_028","doi-asserted-by":"crossref","unstructured":"Ceccarelli F, Mahmoud M. Multimodal temporal machine learning for bipolar disorder and depression recognition. Pattern Anal Appl. 2022;25(3):493\u2013504. https:\/\/doi.org\/10.1007\/s10044-021-01001-y.","DOI":"10.1007\/s10044-021-01001-y"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_029","doi-asserted-by":"crossref","unstructured":"Jayachitra VP, Nivetha S, Nivetha R, Harini R. A cognitive IoT-based framework for effective diagnosis of COVID-19 using multimodal data. Biomed Signal Proces Control. 2021;70:102960. https:\/\/doi.org\/10.1016\/j.bspc.2021.102960.","DOI":"10.1016\/j.bspc.2021.102960"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_030","doi-asserted-by":"crossref","unstructured":"Umair M, Khan MS, Ahmed F, Baothman F, Alqahtani F, Alian M, et al. Detection of COVID-19 using transfer learning and Grad-CAM visualization on indigenously collected X-ray dataset. Sensors. 2021;21:5813. https:\/\/doi.org\/10.3390\/s21175813.","DOI":"10.3390\/s21175813"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_031","doi-asserted-by":"crossref","unstructured":"Zeng W, Gautam A, Huson DH. On the application of advanced machine learning methods to analyze enhanced, multimodal data from persons infected with COVID-19. Computation. 2021;9(1):4. https:\/\/doi.org\/10.3390\/computation9010004.","DOI":"10.3390\/computation9010004"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_032","doi-asserted-by":"crossref","unstructured":"Sun D, Wang M, Li A. A multimodal deep neural network for human breast cancer prognosis prediction by integrating multi-dimensional data. IEEE\/ACM Trans Comput Biol Bioinform. 2018;16(3):841\u201350. https:\/\/doi.org\/10.1109\/TCBB.2018.2806438.","DOI":"10.1109\/TCBB.2018.2806438"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_033","doi-asserted-by":"crossref","unstructured":"Yan R, Ren F, Rao X, Shi B, Xiang T, Zhang L, et al. Integration of multimodal data for breast cancer classification using a hybrid deep learning method. In: Intelligent Computing Theories and Application: 15th International Conference, ICIC 2019, Nanchang, China, August 3\u20136, 2019, Proceedings, Part I 15. 2019. p. 460\u20139. Springer International Publishing. https:\/\/doi.org\/10.1007\/978-3-030-26763-6_44.","DOI":"10.1007\/978-3-030-26763-6_44"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_034","doi-asserted-by":"crossref","unstructured":"Tang X, Xu X, Han Z, Bai G, Wang H, Liu Y, et al. Elaboration of a multimodal MRI-based radiomics signature for the preoperative prediction of the histological subtype in patients with non-small-cell lung cancer. Biomed Eng Online. 2020;19:1\u201317. https:\/\/doi.org\/10.1186\/s12938-019-0744-0.","DOI":"10.1186\/s12938-019-0744-0"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_035","doi-asserted-by":"crossref","unstructured":"Vale-Silva LA, Rohr K. Long-term cancer survival prediction using multimodal deep learning. Sci Rep. 2021;11(1):13505. https:\/\/doi.org\/10.1038\/s41598-021-92799-4.","DOI":"10.1038\/s41598-021-92799-4"},{"key":"2025122009032186765_j_jisys-2024-0417_ref_036","doi-asserted-by":"crossref","unstructured":"Schulz S, Woerl AC, Jungmann F, Glasner C, Stenzel P, Strobl S, et al. Multimodal deep learning for prognosis prediction in renal cancer. Front Oncol. 2021;11:788740. https:\/\/doi.org\/10.3389\/fonc.2021.788740.","DOI":"10.3389\/fonc.2021.788740"}],"container-title":["Journal of Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.degruyterbrill.com\/document\/doi\/10.1515\/jisys-2024-0417\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyterbrill.com\/document\/doi\/10.1515\/jisys-2024-0417\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,20]],"date-time":"2025-12-20T09:10:18Z","timestamp":1766221818000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.degruyterbrill.com\/document\/doi\/10.1515\/jisys-2024-0417\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,1]]},"references-count":36,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,3,7]]},"published-print":{"date-parts":[[2025,3,7]]}},"alternative-id":["10.1515\/jisys-2024-0417"],"URL":"https:\/\/doi.org\/10.1515\/jisys-2024-0417","relation":{},"ISSN":["2191-026X"],"issn-type":[{"type":"electronic","value":"2191-026X"}],"subject":[],"published":{"date-parts":[[2025,1,1]]},"article-number":"20240417"}}