{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,6]],"date-time":"2026-02-06T00:16:00Z","timestamp":1770336960186,"version":"3.49.0"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,8,21]],"date-time":"2023-08-21T00:00:00Z","timestamp":1692576000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,21]],"date-time":"2023-08-21T00:00:00Z","timestamp":1692576000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61972274"],"award-info":[{"award-number":["61972274"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"the Major Program of the National Natural Science Foundation of China","award":["U21A20469"],"award-info":[{"award-number":["U21A20469"]}]},{"name":"Central and local development fund projects","award":["YDZJSX2022C004"],"award-info":[{"award-number":["YDZJSX2022C004"]}]},{"name":"Basic Research Plan Project of Shanxi Province","award":["202103021224066"],"award-info":[{"award-number":["202103021224066"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2024,2]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Recently, lung cancer prediction based on imaging genomics has attracted great attention. However, such studies often have many challenges, such as small sample size, high-dimensional information redundancy, and the inefficiency of multimodal fusion. Therefore, in this paper, a deep convolution cascade attention fusion network (DCCAFN) based on imaging genomics is proposed for the prediction of lung cancer patients\u2019 survival. The network consists of three modules: an image feature extraction module (IFEM), a gene feature extraction module (GFEM), and an attention fusion network (AFN). In the IFEM, a pretrained residual network based on transfer learning is used to extract deep image features to fully capture the computed tomography (CT) image information conducive to prognosis prediction. In the GFEM, the <jats:italic>F<\/jats:italic>-test is first used for gene screening to eliminate redundant information, and then, a cascade network with the convolution cascade module (CCM) that contains a convolution operation, a pooling operation, and an ensemble forest classifier is designed to better extract the gene features. In the AFN, a bimodal attention fusion mechanism is proposed to fuse deep image features and gene features to improve the performance of predicting lung cancer survival. The experimental results show that the DCCAFN model achieves good performance, and its accuracy and AUC are 0.831 and 0.816, respectively. It indicates that the model is an effective multimodal data fusion method for predicting the survival prognosis of lung cancer, which can greatly help physicians stratify patients' risks, and achieve personalized treatment for improving the quality of patients' lives.<\/jats:p>","DOI":"10.1007\/s40747-023-01204-2","type":"journal-article","created":{"date-parts":[[2023,8,21]],"date-time":"2023-08-21T02:01:45Z","timestamp":1692583305000},"page":"1115-1130","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["DCCAFN: deep convolution cascade attention fusion network based on imaging genomics for prediction survival analysis of lung cancer"],"prefix":"10.1007","volume":"10","author":[{"given":"Liye","family":"Jia","sequence":"first","affiliation":[]},{"given":"Xueting","family":"Ren","sequence":"additional","affiliation":[]},{"given":"Wei","family":"Wu","sequence":"additional","affiliation":[]},{"given":"Juanjuan","family":"Zhao","sequence":"additional","affiliation":[]},{"given":"Yan","family":"Qiang","sequence":"additional","affiliation":[]},{"given":"Qianqian","family":"Yang","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,8,21]]},"reference":[{"issue":"1","key":"1204_CR1","doi-asserted-by":"publisher","first-page":"7","DOI":"10.3322\/caac.21708","volume":"72","author":"RL Siegel","year":"2022","unstructured":"Siegel RL, Miller KD, Jemal A (2022) Cancer statistics, 2022. CA Cancer J Clin 72(1):7\u201333","journal-title":"CA Cancer J Clin"},{"key":"1204_CR2","doi-asserted-by":"crossref","unstructured":"Barta JA, Powell CA, Wisnivesky JP (2019) Global epidemiology of lung cancer. Ann Glob Health 85(1):1\u201316","DOI":"10.5334\/aogh.2419"},{"key":"1204_CR3","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1016\/j.cmpb.2015.10.006","volume":"124","author":"IRS Valente","year":"2016","unstructured":"Valente IRS, Cortez PC, Neto EC et al (2016) Automatic 3D pulmonary nodule detection in CT images: a survey. Comput Methods Programs Biomed 124:91\u2013107","journal-title":"Comput Methods Programs Biomed"},{"key":"1204_CR4","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1016\/j.lungcan.2017.10.015","volume":"115","author":"R Thawani","year":"2018","unstructured":"Thawani R, McLane M, Beig N et al (2018) Radiomics and radiogenomics in lung cancer: a review for the clinician. Lung Cancer 115:34\u201341","journal-title":"Lung Cancer"},{"issue":"4","key":"1204_CR5","doi-asserted-by":"publisher","first-page":"435","DOI":"10.1586\/14737159.2016.1149469","volume":"16","author":"JF Palma","year":"2016","unstructured":"Palma JF, Das P, Liesenfeld O (2016) Lung cancer screening: utility of molecular applications in conjunction with low-dose computed tomography guidelines. Expert Rev Mol Diagn 16(4):435\u2013447","journal-title":"Expert Rev Mol Diagn"},{"issue":"11","key":"1204_CR6","doi-asserted-by":"publisher","first-page":"1673","DOI":"10.3390\/cancers11111673","volume":"11","author":"S Wang","year":"2019","unstructured":"Wang S, Yang DM, Rong R et al (2019) Artificial intelligence in lung cancer pathology image analysis. Cancers 11(11):1673","journal-title":"Cancers"},{"issue":"4","key":"1204_CR7","doi-asserted-by":"publisher","first-page":"497","DOI":"10.1016\/j.acra.2019.05.019","volume":"27","author":"TA D'Antonoli","year":"2020","unstructured":"D\u2019Antonoli TA, Farchione A, Lenkowicz J et al (2020) CT radiomics signature of tumor and peritumoral lung parenchyma to predict nonsmall cell lung cancer postsurgical recurrence risk. Acad Radiol 27(4):497\u2013507","journal-title":"Acad Radiol"},{"issue":"17","key":"1204_CR8","doi-asserted-by":"publisher","first-page":"E601","DOI":"10.1503\/cmaj.212097","volume":"194","author":"DR Brenner","year":"2022","unstructured":"Brenner DR, Poirier A, Woods RR et al (2022) Projected estimates of cancer in Canada in 2022. CMAJ 194(17):E601\u2013E607","journal-title":"CMAJ"},{"issue":"1","key":"1204_CR9","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1007\/s11517-020-02302-w","volume":"59","author":"P Marentakis","year":"2021","unstructured":"Marentakis P, Karaiskos P, Kouloulias V et al (2021) Lung cancer histology classification from CT images based on radiomics and deep learning models. Med Biol Eng Compu 59(1):215\u2013226","journal-title":"Med Biol Eng Compu"},{"key":"1204_CR10","doi-asserted-by":"crossref","unstructured":"Gao J, Lyu T, Xiong F et al (2021) Predicting the survival of cancer patients with multimodal graph neural network. IEEE\/ACM Trans Comput Biol Bioinform 19(2):699\u2013709","DOI":"10.1109\/TCBB.2021.3083566"},{"key":"1204_CR11","doi-asserted-by":"crossref","unstructured":"Subramanian V, Syeda-Mahmood T, Do MN (2021) Multimodal fusion using sparse CCA for breast cancer survival prediction. In: 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI). IEEE, 2021, pp 1429\u20131432","DOI":"10.1109\/ISBI48211.2021.9434033"},{"key":"1204_CR12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.cmpb.2017.09.005","volume":"153","author":"Y Xiao","year":"2018","unstructured":"Xiao Y, Wu J, Lin Z et al (2018) A deep learning-based multi-model ensemble method for cancer prediction. Comput Methods Programs Biomed 153:1\u20139","journal-title":"Comput Methods Programs Biomed"},{"issue":"1","key":"1204_CR13","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12874-018-0482-1","volume":"18","author":"JL Katzman","year":"2018","unstructured":"Katzman JL, Shaham U, Cloninger A et al (2018) DeepSurv: personalized treatment recommender system using a Cox proportional hazards deep neural network. BMC Med Res Methodol 18(1):1\u201312","journal-title":"BMC Med Res Methodol"},{"issue":"6","key":"1204_CR14","doi-asserted-by":"publisher","first-page":"e205842","DOI":"10.1001\/jamanetworkopen.2020.5842","volume":"3","author":"Y She","year":"2020","unstructured":"She Y, Jin Z, Wu J et al (2020) Development and validation of a deep learning model for non-small cell lung cancer survival. JAMA Netw Open 3(6):e205842\u2013e205842","journal-title":"JAMA Netw Open"},{"key":"1204_CR15","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1016\/j.ejmp.2019.03.024","volume":"60","author":"M Astaraki","year":"2019","unstructured":"Astaraki M, Wang C, Buizza G et al (2019) Early survival prediction in non-small cell lung cancer from PET\/CT images using an intra-tumor partitioning method. Phys Med 60:58\u201365","journal-title":"Phys Med"},{"key":"1204_CR16","doi-asserted-by":"crossref","unstructured":"Amini M, Nazari M, Shiri I, et al (2020) Multi-Level PET and CT Fusion Radiomics-based Survival Analysis of NSCLC Patients. In: 2020 IEEE Nuclear Science Symposium and Medical Imaging Conference (NSS\/MIC). IEEE, pp 1\u20134","DOI":"10.1109\/NSS\/MIC42677.2020.9507759"},{"issue":"5","key":"1204_CR17","doi-asserted-by":"publisher","first-page":"274","DOI":"10.1038\/s42256-020-0173-6","volume":"2","author":"P Mukherjee","year":"2020","unstructured":"Mukherjee P, Zhou M, Lee E et al (2020) A shallow convolutional neural network predicts prognosis of lung cancer patients in multi-institutional computed tomography image datasets. Nat Mach Intell 2(5):274\u2013282","journal-title":"Nat Mach Intell"},{"key":"1204_CR18","doi-asserted-by":"crossref","unstructured":"Wu Y, Ma J, Huang X, et al (2021) DeepMMSA: A novel multimodal deep learning method for non-small cell lung cancer survival analysis. In: 2021 IEEE International Conference on systems, man, and cybernetics (SMC). IEEE, 2021, pp 1468\u20131472","DOI":"10.1109\/SMC52423.2021.9658891"},{"issue":"4","key":"1204_CR19","doi-asserted-by":"publisher","DOI":"10.1148\/rycan.2021200157","volume":"3","author":"KJ Lafata","year":"2021","unstructured":"Lafata KJ, Corradetti MN, Gao J et al (2021) Radiogenomic analysis of locally advanced lung cancer based on CT imaging and intratreatment changes in cell-free DNA. Radiol Imaging Cancer 3(4):e200157","journal-title":"Radiol Imaging Cancer"},{"key":"1204_CR20","doi-asserted-by":"crossref","unstructured":"Wang H, Subramanian V, Syeda-Mahmood T (2021) Modeling uncertainty in multi-modal fusion for lung cancer survival analysis. In: 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI). IEEE, 2021, pp 1169\u20131172","DOI":"10.1109\/ISBI48211.2021.9433823"},{"key":"1204_CR21","doi-asserted-by":"crossref","unstructured":"Singh A, Wang Z, Katz S, et al (2021) Development of a radiogenomic biomarker for tumor characterization and prognosis in non-small cell lung cancer patients. In: Medical Imaging 2021: Computer-Aided Diagnosis. International Society for Optics and Photonics, 2021, 11597: 115972W","DOI":"10.1117\/12.2582142"},{"issue":"18","key":"1204_CR22","doi-asserted-by":"publisher","first-page":"2963","DOI":"10.1093\/bioinformatics\/btab185","volume":"37","author":"Z Wang","year":"2021","unstructured":"Wang Z, Li R, Wang M et al (2021) GPDBN: deep bilinear network integrating both genomic data and pathological images for breast cancer prognosis prediction. Bioinformatics 37(18):2963\u20132970","journal-title":"Bioinformatics"},{"issue":"9","key":"1204_CR23","doi-asserted-by":"publisher","first-page":"2587","DOI":"10.1093\/bioinformatics\/btac113","volume":"38","author":"R Li","year":"2022","unstructured":"Li R, Wu X, Li A et al (2022) HFBSurv: hierarchical multimodal fusion with factorized bilinear models for cancer survival prediction. Bioinformatics 38(9):2587\u20132594","journal-title":"Bioinformatics"},{"issue":"4","key":"1204_CR24","doi-asserted-by":"publisher","first-page":"757","DOI":"10.1109\/TMI.2020.3021387","volume":"41","author":"RJ Chen","year":"2022","unstructured":"Chen RJ, Lu MY, Wang J et al (2022) Pathomic fusion: an integrated framework for fusing histopathology and genomic features for cancer diagnosis and prognosis. IEEE Trans Med Imaging 41(4):757\u2013770","journal-title":"IEEE Trans Med Imaging"},{"key":"1204_CR25","doi-asserted-by":"crossref","unstructured":"Lu Y, Jha A, Deng R, et al (2022) Contrastive learning meets transfer learning: a case study in medical image analysis. In: Medical Imaging 2022: Computer-Aided Diagnosis. SPIE, 2022, 12033: 715\u2013722","DOI":"10.1117\/12.2610990"},{"key":"1204_CR26","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2020.104115","volume":"128","author":"MA Morid","year":"2021","unstructured":"Morid MA, Borjali A, Del Fiol G (2021) A scoping review of transfer learning research on medical image analysis using ImageNet. Comput Biol Med 128:104115","journal-title":"Comput Biol Med"},{"key":"1204_CR27","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2021.102078","volume":"116","author":"D Karimi","year":"2021","unstructured":"Karimi D, Warfield SK, Gholipour A (2021) Transfer learning in medical image segmentation: New insights from analysis of the dynamics of model parameters and learned representations. Artif Intell Med 116:102078","journal-title":"Artif Intell Med"},{"key":"1204_CR28","unstructured":"Godasu R, Zeng D, Sutrave K (2020) Transfer learning in medical image classification: challenges and opportunities. Transfer 5:28"},{"issue":"7639","key":"1204_CR29","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nature21056","volume":"542","author":"A Esteva","year":"2017","unstructured":"Esteva A, Kuprel B, Novoa RA et al (2017) Dermatologist-level classification of skin cancer with deep neural networks. Nature 542(7639):115\u2013118","journal-title":"Nature"},{"issue":"1","key":"1204_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-020-69813-2","volume":"10","author":"M Hassan","year":"2020","unstructured":"Hassan M, Ali S, Alquhayz H et al (2020) Developing intelligent medical image modality classification system using deep transfer learning and LDA. Sci Rep 10(1):1\u201314","journal-title":"Sci Rep"},{"key":"1204_CR31","doi-asserted-by":"crossref","unstructured":"Pang M, Ting K M, Zhao P, et al (2020) Improving deep forest by screening. IEEE Trans Knowl Data Eng 34(9):4298\u20134312","DOI":"10.1109\/TKDE.2020.3038799"},{"issue":"1","key":"1204_CR32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12859-019-3172-z","volume":"20","author":"Y Dong","year":"2019","unstructured":"Dong Y, Yang W, Wang J et al (2019) MLW-gcForest: a multi-weighted gcForest model towards the staging of lung adenocarcinoma based on multi-modal genetic data. BMC Bioinform 20(1):1\u201314","journal-title":"BMC Bioinform"},{"issue":"1","key":"1204_CR33","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1093\/nsr\/nwy108","volume":"6","author":"ZH Zhou","year":"2019","unstructured":"Zhou ZH, Feng J (2019) Deep forest. Natl Sci Rev 6(1):74\u201386","journal-title":"Natl Sci Rev"},{"key":"1204_CR34","unstructured":"Ni S, Kao HY (2020) PSForest: Improving deep forest via feature pooling and error screening. In: Asian Conference on machine learning. PMLR, 2020, pp 769\u2013781"},{"issue":"4","key":"1204_CR35","doi-asserted-by":"publisher","first-page":"2955","DOI":"10.1007\/s00500-019-04073-5","volume":"24","author":"H Wang","year":"2020","unstructured":"Wang H, Tang Y, Jia Z et al (2020) Dense adaptive cascade forest: a self-adaptive deep ensemble for classification problems. Soft Comput 24(4):2955\u20132968","journal-title":"Soft Comput"},{"issue":"2","key":"1204_CR36","doi-asserted-by":"publisher","first-page":"616","DOI":"10.3906\/elk-2002-175","volume":"29","author":"AA Mossa","year":"2021","unstructured":"Mossa AA, Cevik U (2021) Ensemble learning of multiview CNN models for survival time prediction of braintumor patients using multimodal MRI scans. Turk J Electr Eng Comput Sci 29(2):616\u2013631","journal-title":"Turk J Electr Eng Comput Sci"},{"key":"1204_CR37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s40747-022-00741-6","volume":"8","author":"MA Shaaban","year":"2022","unstructured":"Shaaban MA, Hassan YF, Guirguis SK (2022) Deep convolutional forest: a dynamic deep ensemble approach for spam detection in text. Complex Intell Syst 8:1\u201313","journal-title":"Complex Intell Syst"},{"issue":"12","key":"1204_CR38","doi-asserted-by":"publisher","first-page":"3197","DOI":"10.1007\/s10115-022-01756-8","volume":"64","author":"X Li","year":"2022","unstructured":"Li X, Xiong H, Li X et al (2022) Interpretable deep learning: Interpretation, interpretability, trustworthiness, and beyond. Knowl Inf Syst 64(12):3197\u20133234","journal-title":"Knowl Inf Syst"},{"key":"1204_CR39","doi-asserted-by":"crossref","unstructured":"Zhou B, Khosla A, Lapedriza A, et al (2016) Learning deep features for discriminative localization. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, 2016, pp 2921\u20132929","DOI":"10.1109\/CVPR.2016.319"},{"key":"1204_CR40","doi-asserted-by":"crossref","unstructured":"Selvaraju R R, Cogswell M, Das A, et al (2017) Grad-cam: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on computer vision, 2017, pp 618\u2013626","DOI":"10.1109\/ICCV.2017.74"},{"key":"1204_CR41","unstructured":"Katafuchi R, Tokunaga T (2021) LEA-Net: layer-wise external attention network for efficient color anomaly detection. arXiv preprint arXiv:2109.05493"},{"key":"1204_CR42","doi-asserted-by":"publisher","DOI":"10.1016\/j.compstruc.2022.106918","volume":"275","author":"MM Rosso","year":"2023","unstructured":"Rosso MM, Marasco G, Aiello S et al (2023) Convolutional networks and transformers for intelligent road tunnel investigations. Comput Struct 275:106918","journal-title":"Comput Struct"},{"key":"1204_CR43","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1007\/978-981-15-5852-8_13","volume-title":"Innovation in medicine and healthcare","author":"P Aonpong","year":"2020","unstructured":"Aonpong P, Iwamoto Y, Wang W et al (2020) Hand-crafted and deep learning-based radiomics models for recurrence prediction of non-small cells lung cancers. In: Chen Y-W, Tanaka S, Howlett RJ, Jain LC (eds) Innovation in medicine and healthcare. Springer, Singapore, pp 135\u2013144"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01204-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-023-01204-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01204-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,10]],"date-time":"2024-02-10T22:29:36Z","timestamp":1707604176000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-023-01204-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,21]]},"references-count":43,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,2]]}},"alternative-id":["1204"],"URL":"https:\/\/doi.org\/10.1007\/s40747-023-01204-2","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"value":"2199-4536","type":"print"},{"value":"2198-6053","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,21]]},"assertion":[{"value":"28 February 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 August 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 August 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}