{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:36:42Z","timestamp":1760146602882,"version":"build-2065373602"},"reference-count":28,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2024,11,25]],"date-time":"2024-11-25T00:00:00Z","timestamp":1732492800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology (MOST), Taiwan","doi-asserted-by":"publisher","award":["MOST 111-2221-E-194-057"],"award-info":[{"award-number":["MOST 111-2221-E-194-057"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Ministry of Education (MOE) in Taiwan","award":["MOST 111-2221-E-194-057"],"award-info":[{"award-number":["MOST 111-2221-E-194-057"]}]},{"name":"Advanced Institute of Manufacturing with High-Tech Innovations (AIM-HI)","award":["MOST 111-2221-E-194-057"],"award-info":[{"award-number":["MOST 111-2221-E-194-057"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>This study tackles the challenges in computer-aided prognosis for glioblastoma multiforme, a highly aggressive brain cancer, using only whole slide images (WSIs) as input. Unlike traditional methods that rely on random selection or region-of-interest (ROI) extraction to choose meaningful subsets of patches representing the whole slide, we propose a multiple instance bagging approach. This method utilizes all patches extracted from the whole slide, employing different subsets in each training epoch, thereby leveraging information from the entire slide while keeping the training computationally feasible. Additionally, we developed a two-stage framework based on the ResNet-CBAM model which estimates not just the usual survival risk, but also predicts the actual survival time. Using risk scores of patches estimated from the risk estimation stage, a risk histogram can be constructed and used as input to train a survival time prediction model. A censor hinge loss based on root mean square error was also developed to handle censored data when training the regression model. Tests using the Cancer Genome Atlas Program\u2019s glioblastoma public database yielded a concordance index of 73.16\u00b12.15%, surpassing existing models. Log-rank testing on predicted high- and low-risk groups using the Kaplan\u2013Meier method revealed a p-value of 3.88\u00d710\u22129, well below the usual threshold of 0.005, indicating the model\u2019s ability to significantly differentiate between the two groups. We also implemented a heatmap visualization method that provides interpretable risk assessments at the patch level, potentially aiding clinicians in identifying high-risk regions within WSIs. Notably, these results were achieved using 98% fewer parameters compared to state-of-the-art models.<\/jats:p>","DOI":"10.3390\/info15120750","type":"journal-article","created":{"date-parts":[[2024,11,25]],"date-time":"2024-11-25T11:25:33Z","timestamp":1732533933000},"page":"750","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Multiple Instance Bagging and Risk Histogram for Survival Time Analysis Based on Whole Slide Images of Brain Cancer Patients"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7643-4233","authenticated-orcid":false,"given":"Yu Ping","family":"Chang","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, National Chung Cheng University, Chiayi County 621301, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ya-Chun","family":"Yang","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Chung Cheng University, Chiayi County 621301, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7540-7233","authenticated-orcid":false,"given":"Sung-Nien","family":"Yu","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Chung Cheng University, Chiayi County 621301, Taiwan"},{"name":"Advanced Institute of Manufacturing with High-Tech Innovations (AIM-HI), National Chung Cheng University, Chiayi County 621301, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,11,25]]},"reference":[{"key":"ref_1","first-page":"3","article-title":"Glioblastoma Multiforme: A Review of Its Epidemiology and Pathogenesis through Clinical Presentation and Treatment","volume":"18","author":"Hanif","year":"2017","journal-title":"Asian Pac. J. Cancer Prev."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"12474","DOI":"10.1038\/ncomms12474","article-title":"Predicting Non-Small Cell Lung Cancer Prognosis by Fully Automated Microscopic Pathology Image Features","volume":"7","author":"Yu","year":"2016","journal-title":"Nat. Commun."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1002\/(SICI)1097-0258(19970228)16:4<385::AID-SIM380>3.0.CO;2-3","article-title":"THE LASSO METHOD FOR VARIABLE SELECTION IN THE COX MODEL","volume":"16","author":"Tibshirani","year":"1997","journal-title":"Stat. Med."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Zhu, X., Yao, J., and Huang, J. (2016, January 15\u201318). Deep Convolutional Neural Network for Survival Analysis with Pathological Images. Proceedings of the 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Shenzhen, China.","DOI":"10.1109\/BIBM.2016.7822579"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Zhu, X., Yao, J., Zhu, F., and Huang, J. (2017, January 22\u201325). WSISA: Making Survival Prediction from Whole Slide Histopathological Images. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.725"},{"key":"ref_6","first-page":"174","article-title":"Graph CNN for Survival Analysis on Whole Slide Pathological Images","volume":"Volume 11071","author":"Frangi","year":"2018","journal-title":"Medical Image Computing and Computer Assisted Intervention\u2014MICCAI 2018"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"26022","DOI":"10.1109\/ACCESS.2019.2901049","article-title":"CapSurv: Capsule Network for Survival Analysis With Whole Slide Pathological Images","volume":"7","author":"Tang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_8","first-page":"428","article-title":"Ranking-Based Survival Prediction on Histopathological Whole-Slide Images","volume":"Volume 12265","author":"Martel","year":"2020","journal-title":"Medical Image Computing and Computer Assisted Intervention\u2014MICCAI 2020"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1401","DOI":"10.1109\/TMI.2022.3228275","article-title":"Cancer Survival Prediction From Whole Slide Images With Self-Supervised Learning and Slide Consistency","volume":"42","author":"Fan","year":"2023","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Li, L., Liang, Y., Shao, M., Lu, S., Liao, S., and Ouyang, D. (2023). Self-Supervised Learning-Based Multi-Scale Feature Fusion Network for Survival Analysis from Whole Slide Images. Comput. Biol. Med., 153.","DOI":"10.1016\/j.compbiomed.2022.106482"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1016\/j.mpdhp.2016.06.005","article-title":"Survival Analysis","volume":"22","author":"Kartsonaki","year":"2016","journal-title":"Diagn. Histopathol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1038\/sj.bjc.6601118","article-title":"Survival Analysis Part I: Basic Concepts and First Analyses","volume":"89","author":"Clark","year":"2003","journal-title":"Br. J. Cancer"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"274","DOI":"10.4103\/0974-7788.76794","article-title":"Understanding Survival Analysis: Kaplan-Meier Estimate","volume":"1","author":"Goel","year":"2010","journal-title":"Int. J. Ayurveda Res."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1111\/j.2517-6161.1972.tb00899.x","article-title":"Regression Models and Life-Tables","volume":"34","author":"Cox","year":"1972","journal-title":"J. R. Stat. Soc. Ser. (Methodol.)"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Hosmer, D.W., Lemeshow, S., and May, S. (2008). Applied Survival Analysis: Regression Modeling of Time-to-Event Data, Wiley-Interscience. [2nd ed.].","DOI":"10.1002\/9780470258019"},{"key":"ref_16","unstructured":"Gonzalez, R.C., Woods, R.E., and Eddins, S.L. (2004). Digital Image Processing Using MATLAB, Pearson\/Prentice Hall."},{"key":"ref_17","unstructured":"(2024, February 01). OpenCV: Laplace Operator. Available online: https:\/\/docs.opencv.org\/3.4\/d5\/db5\/tutorial_laplace_operator.html."},{"key":"ref_18","unstructured":"(2024, September 01). OpenCV: Color Conversions. Available online: https:\/\/docs.opencv.org\/3.4\/de\/d25\/imgproc_color_conversions.html#color_convert_rgb_gray."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/978-3-030-01234-2_1","article-title":"CBAM: Convolutional Block Attention Module","volume":"Volume 11211","author":"Ferrari","year":"2018","journal-title":"Computer Vision\u2014ECCV 2018"},{"key":"ref_20","unstructured":"Scarpace, L., Mikkelsen, T., Cha, S., Rao, S., Tekchandani, S., Gutman, D., Saltz, J.H., Erickson, B.J., Pedano, N., and Flanders, A.E. (2022, September 01). The Cancer Genome Atlas Glioblastoma Multiforme Collection (TCGA-GBM) (Version 5) [Data set]. Available online: https:\/\/www.cancerimagingarchive.net\/collection\/tcga-gbm\/."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"27","DOI":"10.4103\/2153-3539.119005","article-title":"OpenSlide: A Vendor-Neutral Software Foundation for Digital Pathology","volume":"4","author":"Goode","year":"2013","journal-title":"J. Pathol. Informatics"},{"key":"ref_22","unstructured":"Sksurv.Metrics (2024, February 01). Concordance_index_censored\u2014Scikit-Survival 0.22.2. Available online: https:\/\/scikit-survival.readthedocs.io\/en\/stable\/api\/generated\/sksurv.metrics.concordance_index_censored.html."},{"key":"ref_23","first-page":"163","article-title":"Evaluation of Survival Data and Two New Rank Order Statistics Arising in Its Consideration","volume":"50","author":"Mantel","year":"1966","journal-title":"Cancer Chemother. Rep."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1073","DOI":"10.1136\/bmj.328.7447.1073","article-title":"The Logrank Test","volume":"328","author":"Bland","year":"2004","journal-title":"BMJ Br. Med. J."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1186\/cc2955","article-title":"Statistics Review 12: Survival Analysis","volume":"8","author":"Bewick","year":"2004","journal-title":"Crit. Care"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1317","DOI":"10.21105\/joss.01317","article-title":"Lifelines: Survival Analysis in Python","volume":"4","year":"2019","journal-title":"J. Open Source Softw."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2246657","DOI":"10.1080\/23723556.2023.2246657","article-title":"The Identification of Key Genes and Pathways in Glioblastoma by Bioinformatics Analysis","volume":"10","author":"Farsi","year":"2023","journal-title":"Mol. Cell. Oncol."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhu, X., Pan, S., Li, R., Chen, Z., Xie, X., Han, D., Lv, S., and Huang, Y. (2021). Novel Biomarker Genes for Prognosis of Survival and Treatment of Glioma. Front. Oncol., 11.","DOI":"10.3389\/fonc.2021.667884"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/15\/12\/750\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:38:48Z","timestamp":1760114328000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/15\/12\/750"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,25]]},"references-count":28,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["info15120750"],"URL":"https:\/\/doi.org\/10.3390\/info15120750","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2024,11,25]]}}}