{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,30]],"date-time":"2025-07-30T11:42:01Z","timestamp":1753875721954,"version":"3.41.2"},"reference-count":42,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2025,3,21]],"date-time":"2025-03-21T00:00:00Z","timestamp":1742515200000},"content-version":"vor","delay-in-days":20,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100009110","name":"Natural Science Foundation of Xinjiang Uygur Autonomous Region","doi-asserted-by":"publisher","award":["2024D01C54"],"award-info":[{"award-number":["2024D01C54"]}],"id":[{"id":"10.13039\/100009110","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Basic Scientific Research Business Expenses of Xinjiang Uygur Autonomous Region","award":["XJEDU2024P027"],"award-info":[{"award-number":["XJEDU2024P027"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,3,4]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Survival prediction serves as a pivotal component in precision oncology, enabling the optimization of treatment strategies through mortality risk assessment. While the integration of histopathological images and genomic profiles offers enhanced potential for patient stratification, existing methodologies are constrained by two fundamental limitations: (i) insufficient attention to fine-grained local features in favor of global representations, and (ii) suboptimal cross-modal fusion strategies that either neglect intrinsic correlations or discard modality-specific information. To address these challenges, we propose DSCASurv, a novel cross-modal fusion alignment framework designed to explore and integrate intrinsic correlations across multimodal data, thereby improving the accuracy of survival prediction. Specifically, DSCASurv leverages the local feature extraction capabilities of convolutional layers and the long-range dependency modeling of scanning state space models to extract intra-modal representations, while generating cross-modal representations through dual parallel mixer architectures. A cross-modal attention module functions as a bridge for inter-modal information exchange and complementary information transfer. The framework ultimately integrates all intra-modal representations to generate survival predictions by enhancing and recalibrating complementary information. Extensive experiments on five benchmark cancer datasets demonstrate the superior performance of our approach compared to existing methods.<\/jats:p>","DOI":"10.1093\/bib\/bbaf103","type":"journal-article","created":{"date-parts":[[2025,3,23]],"date-time":"2025-03-23T08:45:36Z","timestamp":1742719536000},"source":"Crossref","is-referenced-by-count":0,"title":["Dual-stream cross-modal fusion alignment network for survival analysis"],"prefix":"10.1093","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0847-9813","authenticated-orcid":false,"given":"Jinmiao","family":"Song","sequence":"first","affiliation":[{"name":"School of Software, Xinjiang University , Urumqi 830046 ,","place":["China"]}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-6432-9929","authenticated-orcid":false,"given":"Yatong","family":"Hao","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Dalian Minzu University , Dalian 116650 ,","place":["China"]},{"name":"State Ethnic Affairs Commission Key Laboratory of Big Data Applied Technology, Dalian Minzu University , Dalian 116650 ,","place":["China"]},{"name":"Dalian Key Laboratory of Digital Technology for Minzu Culture, Dalian Minzu University , Dalian 116650 ,","place":["China"]}]},{"given":"Shuang","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Dalian Minzu University , Dalian 116650 ,","place":["China"]},{"name":"State Ethnic Affairs Commission Key Laboratory of Big Data Applied Technology, Dalian Minzu University , Dalian 116650 ,","place":["China"]},{"name":"Dalian Key Laboratory of Digital Technology for Minzu Culture, Dalian Minzu University , Dalian 116650 ,","place":["China"]}]},{"given":"Peng","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Software, Xinjiang University , Urumqi 830046 ,","place":["China"]}]},{"given":"Qilin","family":"Feng","sequence":"additional","affiliation":[{"name":"School of Software, Xinjiang University , Urumqi 830046 ,","place":["China"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3040-2492","authenticated-orcid":false,"given":"Qiguo","family":"Dai","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Dalian Minzu University , Dalian 116650 ,","place":["China"]},{"name":"State Ethnic Affairs Commission Key Laboratory of Big Data Applied Technology, Dalian Minzu University , Dalian 116650 ,","place":["China"]},{"name":"Dalian Key Laboratory of Digital Technology for Minzu Culture, Dalian Minzu University , Dalian 116650 ,","place":["China"]}]},{"given":"Xiaodong","family":"Duan","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Dalian Minzu University , Dalian 116650 ,","place":["China"]},{"name":"State Ethnic Affairs Commission Key Laboratory of Big Data Applied Technology, Dalian Minzu University , Dalian 116650 ,","place":["China"]},{"name":"Dalian Key Laboratory of Digital Technology for Minzu Culture, Dalian Minzu University , Dalian 116650 ,","place":["China"]}]}],"member":"286","published-online":{"date-parts":[[2025,3,21]]},"reference":[{"key":"2025032119012704200_ref1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13073-021-00968-x","article-title":"Deep learning in cancer diagnosis, prognosis and treatment selection","volume":"13","author":"Tran","year":"2021","journal-title":"Genome Med"},{"author":"","key":"2025032119012704200_ref2"},{"author":"","key":"2025032119012704200_ref3"},{"key":"2025032119012704200_ref4","doi-asserted-by":"publisher","first-page":"102302","DOI":"10.1016\/j.compmedimag.2023.102302","article-title":"Explainable survival analysis with uncertainty using convolution-involved vision transformer","volume":"110","author":"Tang","year":"2023","journal-title":"Comput Med Imaging Graph"},{"key":"2025032119012704200_ref5","doi-asserted-by":"publisher","first-page":"e33","DOI":"10.1016\/S2589-7500(23)00208-X","article-title":"End-to-end prognostication in colorectal cancer by deep learning: a retrospective, multicentre study","volume":"6","author":"Jiang","year":"2024","journal-title":"Lancet Digit Health"},{"article-title":"WSISA: Making Survival Prediction from Whole Slide Histopathological Images","volume-title":"2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)","author":"","key":"2025032119012704200_ref6"},{"key":"2025032119012704200_ref7","doi-asserted-by":"publisher","first-page":"21948","DOI":"10.1038\/s41598-022-26096-z","article-title":"Risk-aware survival time prediction from whole slide pathological images","volume":"12","author":"Xu","year":"2022","journal-title":"Sci Rep"},{"key":"2025032119012704200_ref8","doi-asserted-by":"publisher","first-page":"45","DOI":"10.1016\/j.cmpb.2018.04.008","article-title":"Integrating genomic data and pathological images to effectively predict breast cancer clinical outcome","volume":"161","author":"Sun","year":"2018","journal-title":"Comput Methods Programs Biomed"},{"article-title":"Multimodal Co-Attention Transformer for Survival Prediction in Gigapixel Whole Slide Images","volume-title":"2021 IEEE\/CVF International Conference on Computer Vision (ICCV)","author":"","key":"2025032119012704200_ref9"},{"article-title":"Joint Multi-Task Learning for Survival Prediction of Gastric Cancer Patients using CT Images","volume-title":"2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI)","author":"","key":"2025032119012704200_ref10"},{"key":"2025032119012704200_ref11","doi-asserted-by":"publisher","first-page":"75976","DOI":"10.1109\/ACCESS.2019.2920396","article-title":"Predicting the gene status and survival outcome of lower grade glioma patients with multimodal MRI features","volume":"7","author":"Chaddad","year":"2019","journal-title":"IEEE Access"},{"key":"2025032119012704200_ref12","doi-asserted-by":"publisher","first-page":"103020","DOI":"10.1016\/j.media.2023.103020","article-title":"AdvMIL: adversarial multiple instance learning for the survival analysis on whole-slide images","volume":"91","author":"Liu","year":"2024","journal-title":"Med Image Anal"},{"key":"2025032119012704200_ref13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12885-020-07492-y","article-title":"Improved personalized survival prediction of patients with diffuse large B-cell lymphoma using gene expression profiling","volume":"20","author":"Mosquera Orgueira","year":"2020","journal-title":"BMC Cancer"},{"author":"","key":"2025032119012704200_ref14"},{"article-title":"Modeling Dense Multimodal Interactions Between Biological Pathways and Histology for Survival Prediction","volume-title":"2024 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR)","author":"","key":"2025032119012704200_ref15"},{"key":"2025032119012704200_ref16","article-title":"Deep learning based multimodal biomedical data fusion: An overview and comparative review","volume":"112","author":"","journal-title":"Information Fusion"},{"article-title":"Multimodal deep learning for robust RGB-D object recognition","volume-title":"2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS)","author":"","key":"2025032119012704200_ref17"},{"author":"","key":"2025032119012704200_ref18"},{"key":"2025032119012704200_ref19","doi-asserted-by":"publisher","first-page":"5687","DOI":"10.1038\/s41598-024-56172-5","article-title":"Multimodal artificial intelligence-based pathogenomics improves survival prediction in oral squamous cell carcinoma","volume":"14","author":"Vollmer","year":"2024","journal-title":"Sci Rep"},{"key":"2025032119012704200_ref20","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1109\/TCBB.2023.3335369","article-title":"Graph-based fusion of imaging, genetic and clinical data for degenerative disease diagnosis","volume":"21","author":"Guo","year":"2024","journal-title":"IEEE\/ACM Trans Comput Biol Bioinform"},{"key":"2025032119012704200_ref21","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1038\/s43856-023-00276-y","article-title":"Multimodal deep learning to predict prognosis in adult and pediatric brain tumors","volume":"3","author":"Steyaert","year":"2023","journal-title":"Commun Med"},{"key":"2025032119012704200_ref22","doi-asserted-by":"publisher","first-page":"106576","DOI":"10.1016\/j.compbiomed.2023.106576","article-title":"Deep multimodal graph-based network for survival prediction from highly multiplexed images and patient variables","volume":"154","author":"Fu","year":"2023","journal-title":"Comput Biol Med"},{"author":"","key":"2025032119012704200_ref23"},{"author":"","key":"2025032119012704200_ref24"},{"author":"","key":"2025032119012704200_ref25"},{"key":"2025032119012704200_ref26","doi-asserted-by":"publisher","first-page":"10826","DOI":"10.1109\/TPEL.2018.2799819","article-title":"Accuracy analysis of the zero-order hold model for digital pulse width modulation","volume":"33","author":"Ma","year":"2018","journal-title":"IEEE Trans Power Electron"},{"author":"","key":"2025032119012704200_ref27"},{"author":"","key":"2025032119012704200_ref28"},{"article-title":"Cross-Modal Translation and Alignment for Survival Analysis","volume-title":"2023 IEEE\/CVF International Conference on Computer Vision (ICCV)","author":"","key":"2025032119012704200_ref29"},{"key":"2025032119012704200_ref30","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1038\/s41698-021-00225-9","article-title":"Genetic mutation and biological pathway prediction based on whole slide images in breast carcinoma using deep learning","volume":"5","author":"Qu","year":"2021","journal-title":"NPJ Precis Oncol"},{"key":"2025032119012704200_ref31","doi-asserted-by":"publisher","first-page":"1739","DOI":"10.1093\/bioinformatics\/btr260","article-title":"Molecular signatures database (MSigDB) 3.0","volume":"27","author":"Liberzon","year":"2011","journal-title":"Bioinformatics"},{"key":"2025032119012704200_ref32","doi-asserted-by":"publisher","first-page":"D687","DOI":"10.1093\/nar\/gkab1028","article-title":"The reactome pathway knowledgebase 2022","volume":"50","author":"Gillespie","year":"2022","journal-title":"Nucleic Acids Res"},{"key":"2025032119012704200_ref33","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1007\/s10654-023-00973-x","article-title":"Prognostic models in COVID-19 infection that predict severity: a systematic review","volume":"38","author":"Buttia","year":"2023","journal-title":"Eur J Epidemiol"},{"key":"2025032119012704200_ref34","first-page":"661","article-title":"Survival analysis of patient healing in mental disorders using Kaplan Meier\u2019s method and log-rank test","volume":"8","author":"Darmawan","year":"2023","journal-title":"Mathline: J Mat dan Pendidik Mat"},{"key":"2025032119012704200_ref35","doi-asserted-by":"publisher","first-page":"102559","DOI":"10.1016\/j.media.2022.102559","article-title":"Transformer-based unsupervised contrastive learning for histopathological image classification","volume":"81","author":"Wang","year":"2022","journal-title":"Med Image Anal"},{"author":"","key":"2025032119012704200_ref36"},{"author":"","key":"2025032119012704200_ref37"},{"author":"","key":"2025032119012704200_ref38"},{"key":"2025032119012704200_ref39","first-page":"2136","article-title":"TransMIL: transformer based correlated multiple instance learning for whole slide image classification","volume":"34","author":"Shao","year":"2021","journal-title":"Adv Neural Inf Process Syst"},{"article-title":"Multimodal Optimal Transport-based CoAttention Transformer with Global Structure Consistency for Survival Prediction","volume-title":"2023 IEEE\/CVF International Conference on Computer Vision (ICCV)","author":"","key":"2025032119012704200_ref40"},{"key":"2025032119012704200_ref41","doi-asserted-by":"publisher","first-page":"865","DOI":"10.1016\/j.ccell.2022.07.004","article-title":"Pan-cancer integrative histology-genomic analysis via multimodal deep learning","volume":"40","author":"Chen","year":"2022","journal-title":"Cancer Cell"},{"key":"2025032119012704200_ref42","doi-asserted-by":"publisher","first-page":"101563","DOI":"10.1016\/j.media.2019.101563","article-title":"Hover-Net: simultaneous segmentation and classification of nuclei in multi-tissue histology images","volume":"58","author":"Graham","year":"2019","journal-title":"Med Image Anal"}],"container-title":["Briefings in Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/26\/2\/bbaf103\/62519387\/bbaf103.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bib\/article-pdf\/26\/2\/bbaf103\/62519387\/bbaf103.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,23]],"date-time":"2025-03-23T08:45:52Z","timestamp":1742719552000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bib\/article\/doi\/10.1093\/bib\/bbaf103\/8089931"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3]]},"references-count":42,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,3,4]]}},"URL":"https:\/\/doi.org\/10.1093\/bib\/bbaf103","relation":{},"ISSN":["1467-5463","1477-4054"],"issn-type":[{"type":"print","value":"1467-5463"},{"type":"electronic","value":"1477-4054"}],"subject":[],"published-other":{"date-parts":[[2025,3]]},"published":{"date-parts":[[2025,3]]},"article-number":"bbaf103"}}