{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,7]],"date-time":"2026-09-07T16:11:58Z","timestamp":1788797518392,"version":"build-2803163510"},"reference-count":37,"publisher":"IOP Publishing","issue":"17","license":[{"start":{"date-parts":[[2026,9,7]],"date-time":"2026-09-07T00:00:00Z","timestamp":1788739200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/publishingsupport.iopscience.iop.org\/iop-standard\/v1"},{"start":{"date-parts":[[2026,9,7]],"date-time":"2026-09-07T00:00:00Z","timestamp":1788739200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"},{"start":{"date-parts":[[2026,9,7]],"date-time":"2026-09-07T00:00:00Z","timestamp":1788739200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/publishingsupport.iopscience.iop.org\/questions\/alternative-author-rights-policies\/"},{"start":{"date-parts":[[2026,9,7]],"date-time":"2026-09-07T00:00:00Z","timestamp":1788739200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/publishingsupport.iopscience.iop.org\/questions\/alternative-author-rights-policies\/"}],"funder":[{"name":"Guangdong Provincial Key Laboratory of Medical Image Processing","award":["2020B1212060039"],"award-info":[{"award-number":["2020B1212060039"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["82472056"],"award-info":[{"award-number":["82472056"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100021171","name":"Basic and Applied Basic Research Foundation of Guangdong Province","doi-asserted-by":"crossref","award":["2024A1515012004"],"award-info":[{"award-number":["2024A1515012004"]}],"id":[{"id":"10.13039\/501100021171","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Phys. Med. Biol."],"published-print":{"date-parts":[[2026,9,14]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    <jats:italic>Objective.<\/jats:italic>\n                    To propose a deep multimodal synergistic survival analysis framework (Deep Multimodal Synergistic Survival Network, DMSSN) to achieve accurate prognostic analysis for clear cell renal cell carcinoma (ccRCC).\n                    <jats:italic>Methods.<\/jats:italic>\n                    This study (DMSSN) utilized matched multimodal data from the Cancer Genome Atlas-KIRC database, including CT imaging data, whole slide images, copy number variation (CNV) features, and clinical data. Deep Canonical Correlation Analysis was employed to map heterogeneous modalities into a shared latent space. Contrastive learning was introduced to enhance semantic consistency across multimodal features, and a gating network was utilized for the adaptive fusion of multimodal information to achieve precise survival risk prediction for patients.\n                    <jats:italic>Results.<\/jats:italic>\n                    Experimental results demonstrated that DMSSN achieved a Concordance Index (C-index) of 0.8153 \u00b1 0.0994, with a Log-rank test\n                    <jats:italic>p<\/jats:italic>\n                    -value of 1.6553\u00d710\n                    <jats:sup>\u221211<\/jats:sup>\n                    . DMSSN exhibited significant performance advantages over traditional statistical methods like Log-rank-Cox (0.7055 \u00b1 0.0670) and machine learning methods such as Random Survival Forest (RSF) (0.6836 \u00b1 0.1048). Furthermore, in comparison with similar deep learning approaches, DMSSN outperformed late fusion strategies (0.7493 \u00b1 0.1211) and discrete-time survival models such as DeepHit (0.7655 \u00b1 0.1041) and Nnet-surv (0.7694 \u00b1 0.0635). Notably, DMSSN still achieved the best predictive performance when compared to the classic deep survival model DeepSurv (0.7919 \u00b1 0.0978) and advanced state-of-the-art multimodal fusion frameworks like Context-Aware Transformer (0.7735 \u00b1 0.0818) and Multimodal Co-Attention Transformer (0.8102 \u00b1 0.0972). Ablation studies showed that removing any single modality led to a decline in performance, with the largest numerical decrease occurring after removing CT imaging features (C-index decreased to 0.7327), validating the complementarity of multimodal data and the pivotal role of radiomic features in prognostic assessment. Module ablation experiments further confirmed the effectiveness of the core components.\n                    <jats:italic>Conclusion:<\/jats:italic>\n                    By effectively integrating imaging, pathology, genomic, and clinical features, the DMSSN framework demonstrates superior performance and robustness in the survival prediction of ccRCC.\n                  <\/jats:p>","DOI":"10.1088\/1361-6560\/ae9e80","type":"journal-article","created":{"date-parts":[[2026,8,25]],"date-time":"2026-08-25T22:53:28Z","timestamp":1787698408000},"page":"175024","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Survival prediction for clear cell renal cell carcinoma based on deep multimodal synergistic survival network"],"prefix":"10.1088","volume":"71","author":[{"given":"Liang","family":"Liang","sequence":"first","affiliation":[{"name":"School of Biomedical Engineering, Southern Medical University"},{"name":"Southern Medical University"},{"name":"Southern Medical University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jianing","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Biomedical Engineering, Southern Medical University"},{"name":"Southern Medical University"},{"name":"Southern Medical University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8456-7335","authenticated-orcid":true,"given":"Yu","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Biomedical Engineering, Southern Medical University"},{"name":"Southern Medical University"},{"name":"Southern Medical University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"266","published-online":{"date-parts":[[2026,9,7]]},"reference":[{"key":"pmbae9e80bib1","first-page":"1247","type":"conference-proceedings","article-title":"Deep canonical correlation analysis","volume":"vol 28","author":"Andrew","year":"2013"},{"key":"pmbae9e80bib2","doi-asserted-by":"publisher","first-page":"772","DOI":"10.13201\/j.issn.1001-1420.2023.10.009","type":"journal-article","article-title":"Construction and analysis of prognostic risk model of immune-related genes in clear cell renal cell carcinoma","volume":"38","author":"Chen","year":"2023","journal-title":"J. Clin. Urol."},{"key":"pmbae9e80bib3","doi-asserted-by":"publisher","first-page":"757","DOI":"10.1109\/TMI.2020.3021387","type":"journal-article","article-title":"Pathomic fusion: an integrated framework for fusing histopathology and genomic features for cancer diagnosis and prognosis","volume":"41","author":"Chen","year":"2022a","journal-title":"IEEE Trans. Med. Imaging"},{"key":"pmbae9e80bib4","doi-asserted-by":"publisher","first-page":"865","DOI":"10.1016\/j.ccell.2022.07.004","type":"journal-article","article-title":"Pan-cancer integrative histology-genomic analysis via multimodal deep learning","volume":"40","author":"Chen","year":"2022b","journal-title":"Cancer Cell."},{"key":"pmbae9e80bib5","first-page":"4015","type":"conference-proceedings","article-title":"Multimodal co-attention transformer for survival prediction in gigapixel whole slide images","author":"Chen","year":"2021"},{"key":"pmbae9e80bib6","first-page":"1191597","type":"conference-proceedings","article-title":"A simple framework for contrastive learning of visual representations","author":"Chen","year":"2020"},{"key":"pmbae9e80bib7","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1111\/j.2517-6161.1972.tb00899.x","type":"journal-article","article-title":"Regression models and life-tables","volume":"34","author":"Cox","year":"1972","journal-title":"J. R. Stat. Soc. B"},{"key":"pmbae9e80bib8","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1038\/nature12222","type":"journal-article","article-title":"Comprehensive molecular characterization of clear cell renal cell carcinoma","volume":"499","author":"Creighton","year":"2013","journal-title":"Nature"},{"key":"pmbae9e80bib9","doi-asserted-by":"publisher","first-page":"699","DOI":"10.1109\/TCBB.2021.3083566","type":"journal-article","article-title":"Predicting the survival of cancer patients with multimodal graph neural network","volume":"19","author":"Gao","year":"2022","journal-title":"IEEE\/ACM Trans. Comput. Biol. Bioinform."},{"key":"pmbae9e80bib10","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1186\/s13045-021-01167-2","type":"journal-article","article-title":"Deep learning for differential diagnosis of malignant hepatic tumors based on multi-phase contrast-enhanced CT and clinical data","volume":"14","author":"Gao","year":"2021","journal-title":"J. Hematol. Oncol."},{"key":"pmbae9e80bib11","doi-asserted-by":"publisher","first-page":"e6257","DOI":"10.7717\/peerj.6257","type":"journal-article","article-title":"A scalable discrete-time survival model for neural networks","volume":"7","author":"Gensheimer","year":"2019","journal-title":"Peer J."},{"key":"pmbae9e80bib12","doi-asserted-by":"publisher","first-page":"2543","DOI":"10.1001\/jama.1982.03320430047030","type":"journal-article","article-title":"Evaluating the yield of medical tests","volume":"247","author":"Harrell","year":"1982","journal-title":"JAMA"},{"key":"pmbae9e80bib13","first-page":"770","type":"conference-proceedings","article-title":"Deep residual learning for image recognition","author":"He","year":"2016"},{"key":"pmbae9e80bib14","first-page":"7132","type":"conference-proceedings","article-title":"Squeeze-and-excitation networks","author":"Hu","year":"2018"},{"key":"pmbae9e80bib15","doi-asserted-by":"publisher","first-page":"2302","DOI":"10.18632\/aging.102746","type":"journal-article","article-title":"Identification of an immune-related risk signature for predicting prognosis in clear cell renal cell carcinoma","volume":"12","author":"Hua","year":"2020","journal-title":"Aging"},{"key":"pmbae9e80bib16","doi-asserted-by":"publisher","first-page":"2127","DOI":"10.48550\/arXiv.1802.04712","type":"conference-proceedings","article-title":"Attention-based deep multiple instance learning","volume":"vol 80","author":"Ilse","year":"2018"},{"key":"pmbae9e80bib17","doi-asserted-by":"publisher","first-page":"841","DOI":"10.1214\/08-AOAS169","type":"journal-article","article-title":"Random survival forests","volume":"2","author":"Ishwaran","year":"2008","journal-title":"Ann. Appl. Stat."},{"key":"pmbae9e80bib18","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1080\/01621459.1958.10501452","type":"journal-article","article-title":"Nonparametric estimation from incomplete observations","volume":"53","author":"Kaplan","year":"1958","journal-title":"J. Am. Stat. Assoc."},{"key":"pmbae9e80bib19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12874-018-0482-1","type":"journal-article","article-title":"DeepSurv: personalized treatment recommender system using a Cox proportional hazards deep neural network","volume":"18","author":"Katzman","year":"2018","journal-title":"BMC Med. Res. Methodol."},{"key":"pmbae9e80bib20","doi-asserted-by":"publisher","first-page":"5128","DOI":"10.1158\/1078-0432.CCR-05-0073","type":"journal-article","article-title":"Clear cell renal cell carcinoma: gene expression analyses identify a potential signature for tumor aggressiveness","volume":"11","author":"Kosari","year":"2005","journal-title":"Clin. Cancer Res."},{"key":"pmbae9e80bib21","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1109\/TBME.2019.2909027","type":"journal-article","article-title":"Dynamic-deephit: a deep learning approach for dynamic survival analysis with competing risks based on longitudinal data","volume":"67","author":"Lee","year":"2019","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"pmbae9e80bib22","doi-asserted-by":"publisher","first-page":"2314","DOI":"10.1609\/aaai.v32i1.11842","type":"conference-proceedings","article-title":"DeepHit: a deep learning approach to survival analysis with competing risks","author":"Lee","year":"2018"},{"key":"pmbae9e80bib23","doi-asserted-by":"publisher","first-page":"1234","DOI":"10.1093\/bioinformatics\/btz682","type":"journal-article","article-title":"BioBERT: a pre-trained biomedical language representation model for biomedical text mining","volume":"36","author":"Lee","year":"2020","journal-title":"Bioinformatics"},{"key":"pmbae9e80bib24","doi-asserted-by":"publisher","first-page":"1663","DOI":"10.1002\/cncr.11234","type":"journal-article","article-title":"Prediction of progression after radical nephrectomy for patients with clear cell renal cell carcinoma","volume":"97","author":"Leibovich","year":"2003","journal-title":"Cancer"},{"key":"pmbae9e80bib25","doi-asserted-by":"publisher","first-page":"btae316","DOI":"10.1093\/bioinformatics\/btae316","type":"journal-article","article-title":"Pathformer: a biological pathway informed transformer integrating multi-omics data for disease diagnosis and prognosis","volume":"40","author":"Liu","year":"2024","journal-title":"Bioinformatics"},{"key":"pmbae9e80bib26","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1038\/s41586-021-03512-4","type":"journal-article","article-title":"AI-based pathology predicts origins for cancers of unknown primary","volume":"594","author":"Lu","year":"2021a","journal-title":"Nature"},{"key":"pmbae9e80bib27","doi-asserted-by":"publisher","first-page":"555","DOI":"10.1038\/s41551-020-00682-w","type":"journal-article","article-title":"Data-efficient and weakly supervised computational pathology on whole-slide images","volume":"5","author":"Lu","year":"2021b","journal-title":"Nat. Biomed. Eng."},{"key":"pmbae9e80bib28","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1038\/s41698-025-00917-6","type":"journal-article","article-title":"A machine learning approach for multimodal data fusion for survival prediction in cancer patients npj","volume":"9","author":"Nikolaou","year":"2025","journal-title":"Precis. Oncol."},{"key":"pmbae9e80bib29","doi-asserted-by":"publisher","first-page":"185","DOI":"10.2307\/2344317","type":"journal-article","article-title":"Asymptotically efficient rank invariant test procedures","volume":"135","author":"Peto","year":"1972","journal-title":"J. R. Stat. Soc. A"},{"key":"pmbae9e80bib30","doi-asserted-by":"publisher","first-page":"1292","DOI":"10.1093\/jamia\/ocac058","type":"journal-article","article-title":"Use of unstructured text in prognostic clinical prediction models: a systematic review","volume":"29","author":"Seinen","year":"2022","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"pmbae9e80bib31","doi-asserted-by":"publisher","first-page":"bbab569","DOI":"10.1093\/bib\/bbab569","type":"journal-article","article-title":"Multimodal deep learning for biomedical data fusion: a review","volume":"23","author":"Stahlschmidt","year":"2022","journal-title":"Brief. Bioinform."},{"key":"pmbae9e80bib32","doi-asserted-by":"publisher","first-page":"841","DOI":"10.1109\/TCBB.2018.2806438","type":"journal-article","article-title":"A multimodal deep neural network for human breast cancer prognosis prediction by integrating multi-dimensional data","volume":"16","author":"Sun","year":"2019","journal-title":"IEEE\/ACM Trans. Comput. Biol. Bioinform."},{"key":"pmbae9e80bib33","doi-asserted-by":"publisher","first-page":"595","DOI":"10.1016\/j.cell.2018.03.043","type":"journal-article","article-title":"Deterministic evolutionary trajectories influence primary tumor growth: tRACERx","volume":"173","author":"Turajlic","year":"2018","journal-title":"Renal Cell."},{"key":"pmbae9e80bib34","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-92799-4","type":"journal-article","article-title":"Long-term cancer survival prediction using multimodal deep learning","volume":"11","author":"Vale-Silva","year":"2021","journal-title":"Sci. Rep."},{"key":"pmbae9e80bib35","doi-asserted-by":"publisher","first-page":"970","DOI":"10.1038\/s41586-024-07894-z","type":"journal-article","article-title":"A pathology foundation model for cancer diagnosis and prognosis prediction","volume":"634","author":"Wang","year":"2024","journal-title":"Nature"},{"key":"pmbae9e80bib36","first-page":"1","type":"conference-proceedings","article-title":"Survtrace: transformers for survival analysis with competing events","author":"Wang","year":"2022"},{"key":"pmbae9e80bib37","doi-asserted-by":"publisher","first-page":"134","DOI":"10.1186\/s12911-020-01340-6","type":"journal-article","article-title":"Richer fusion network for breast cancer classification based on multimodal data","volume":"21","author":"Yan","year":"2021","journal-title":"BMC Med. Inform. Decis. Mak."}],"container-title":["Physics in Medicine &amp; Biology"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/ae9e80","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/ae9e80\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/ae9e80","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/ae9e80\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/ae9e80\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/ae9e80\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/ae9e80\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/ae9e80\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,7]],"date-time":"2026-09-07T15:58:37Z","timestamp":1788796717000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/1361-6560\/ae9e80"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,7]]},"references-count":37,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2026,9,7]]},"published-print":{"date-parts":[[2026,9,14]]}},"URL":"https:\/\/doi.org\/10.1088\/1361-6560\/ae9e80","relation":{},"ISSN":["0031-9155","1361-6560"],"issn-type":[{"value":"0031-9155","type":"print"},{"value":"1361-6560","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,7]]},"assertion":[{"value":"Survival prediction for clear cell renal cell carcinoma based on deep multimodal synergistic survival network","name":"article_title","label":"Article Title"},{"value":"Physics in Medicine & Biology","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2026 Institute of Physics and Engineering in Medicine. All rights, including for text and data mining, AI training, and similar technologies, are reserved.","name":"copyright_information","label":"Copyright Information"},{"value":"2026-05-11","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2026-08-25","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2026-09-07","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}