{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,20]],"date-time":"2026-04-20T02:45:38Z","timestamp":1776653138776,"version":"3.51.2"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"10","license":[{"start":{"date-parts":[[2023,4,21]],"date-time":"2023-04-21T00:00:00Z","timestamp":1682035200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,4,21]],"date-time":"2023-04-21T00:00:00Z","timestamp":1682035200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100006690","name":"Politecnico di Milano","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100006690","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Purpose<\/jats:title>\n                <jats:p>Primary central nervous system lymphoma (PCNSL) is a rare, aggressive form of extranodal non-Hodgkin lymphoma. To predict the overall survival (OS) in advance is of utmost importance as it has the potential to aid clinical decision-making. Though radiomics-based machine learning (ML) has demonstrated the promising performance in PCNSL, it demands large amounts of manual feature extraction efforts from magnetic resonance images beforehand. deep learning (DL) overcomes this limitation.\n<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>In this paper, we tailored the 3D ResNet to predict the OS of patients with PCNSL. To overcome the limitation of data sparsity, we introduced data augmentation and transfer learning, and we evaluated the results using <jats:italic>r<\/jats:italic> stratified <jats:italic>k<\/jats:italic>-fold cross-validation. To explain the results of our model, gradient-weighted class activation mapping was applied.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>We obtained the best performance (the standard error) on post-contrast T1-weighted (T1Gd)\u2014area under curve <jats:inline-formula><jats:alternatives><jats:tex-math>$$=0.81(0.03)$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                    <mml:mrow>\n                      <mml:mo>=<\/mml:mo>\n                      <mml:mn>0.81<\/mml:mn>\n                      <mml:mo>(<\/mml:mo>\n                      <mml:mn>0.03<\/mml:mn>\n                      <mml:mo>)<\/mml:mo>\n                    <\/mml:mrow>\n                  <\/mml:math><\/jats:alternatives><\/jats:inline-formula>, accuracy <jats:inline-formula><jats:alternatives><jats:tex-math>$$=0.87(0.07)$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                    <mml:mrow>\n                      <mml:mo>=<\/mml:mo>\n                      <mml:mn>0.87<\/mml:mn>\n                      <mml:mo>(<\/mml:mo>\n                      <mml:mn>0.07<\/mml:mn>\n                      <mml:mo>)<\/mml:mo>\n                    <\/mml:mrow>\n                  <\/mml:math><\/jats:alternatives><\/jats:inline-formula>, precision <jats:inline-formula><jats:alternatives><jats:tex-math>$$=0.88(0.07)$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                    <mml:mrow>\n                      <mml:mo>=<\/mml:mo>\n                      <mml:mn>0.88<\/mml:mn>\n                      <mml:mo>(<\/mml:mo>\n                      <mml:mn>0.07<\/mml:mn>\n                      <mml:mo>)<\/mml:mo>\n                    <\/mml:mrow>\n                  <\/mml:math><\/jats:alternatives><\/jats:inline-formula>, recall <jats:inline-formula><jats:alternatives><jats:tex-math>$$=0.88(0.07)$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                    <mml:mrow>\n                      <mml:mo>=<\/mml:mo>\n                      <mml:mn>0.88<\/mml:mn>\n                      <mml:mo>(<\/mml:mo>\n                      <mml:mn>0.07<\/mml:mn>\n                      <mml:mo>)<\/mml:mo>\n                    <\/mml:mrow>\n                  <\/mml:math><\/jats:alternatives><\/jats:inline-formula> and <jats:italic>F<\/jats:italic>1-score <jats:inline-formula><jats:alternatives><jats:tex-math>$$=0.87(0.07)$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                    <mml:mrow>\n                      <mml:mo>=<\/mml:mo>\n                      <mml:mn>0.87<\/mml:mn>\n                      <mml:mo>(<\/mml:mo>\n                      <mml:mn>0.07<\/mml:mn>\n                      <mml:mo>)<\/mml:mo>\n                    <\/mml:mrow>\n                  <\/mml:math><\/jats:alternatives><\/jats:inline-formula>, while compared with ML-based models on clinical data and radiomics data, respectively, further confirming the stability of our model. Also, we observed that PCNSL is a whole-brain disease and in the cases where the OS is less than 1 year, it is more difficult to distinguish the tumor boundary from the normal part of the brain, which is consistent with the clinical outcome.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>All these findings indicate that T1Gd can improve prognosis predictions of patients with PCNSL. To the best of our knowledge, this is the first time to use DL to explain model patterns in OS classification of patients with PCNSL. Future work would involve collecting more data of patients with PCNSL, or additional retrospective studies on different patient populations with rare diseases, to further promote the clinical role of our model.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11548-023-02886-2","type":"journal-article","created":{"date-parts":[[2023,4,21]],"date-time":"2023-04-21T15:11:34Z","timestamp":1682089894000},"page":"1849-1856","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Deep learning-based overall survival prediction model in patients with rare cancer: a case study for primary central nervous system lymphoma"],"prefix":"10.1007","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3787-6941","authenticated-orcid":false,"given":"Ziyu","family":"She","sequence":"first","affiliation":[]},{"given":"Aldo","family":"Marzullo","sequence":"additional","affiliation":[]},{"given":"Michela","family":"Destito","sequence":"additional","affiliation":[]},{"given":"Maria Francesca","family":"Spadea","sequence":"additional","affiliation":[]},{"given":"Riccardo","family":"Leone","sequence":"additional","affiliation":[]},{"given":"Nicoletta","family":"Anzalone","sequence":"additional","affiliation":[]},{"given":"Sara","family":"Steffanoni","sequence":"additional","affiliation":[]},{"given":"Federico","family":"Erbella","sequence":"additional","affiliation":[]},{"given":"Andr\u00e9s J. M.","family":"Ferreri","sequence":"additional","affiliation":[]},{"given":"Giancarlo","family":"Ferrigno","sequence":"additional","affiliation":[]},{"given":"Teresa","family":"Calimeri","sequence":"additional","affiliation":[]},{"given":"Elena","family":"De Momi","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,4,21]]},"reference":[{"issue":"21","key":"2886_CR1","doi-asserted-by":"publisher","first-page":"2410","DOI":"10.1200\/JCO.2017.72.7602","volume":"35","author":"C Grommes","year":"2017","unstructured":"Grommes C, DeAngelis LM (2017) Primary cns lymphoma. J Clin Oncol 35(21):2410","journal-title":"J Clin Oncol"},{"issue":"1","key":"2886_CR2","doi-asserted-by":"publisher","first-page":"565","DOI":"10.1182\/asheducation-2017.1.565","volume":"2017","author":"AJM Ferreri","year":"2017","unstructured":"Ferreri AJM (2017) Therapy of primary cns lymphoma: role of intensity, radiation, and novel agents. Hematol Am Soc Hematol Educ Program Book 2017(1):565\u2013577","journal-title":"Hematol Am Soc Hematol Educ Program Book"},{"issue":"6","key":"2886_CR3","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1038\/nrneurol.2013.83","volume":"9","author":"A Korfel","year":"2013","unstructured":"Korfel A, Schlegel U (2013) Diagnosis and treatment of primary cns lymphoma. Nat Rev Neurol 9(6):317\u2013327","journal-title":"Nat Rev Neurol"},{"issue":"5","key":"2886_CR4","doi-asserted-by":"publisher","first-page":"401","DOI":"10.1097\/PPO.0b013e3181bdc2e0","volume":"15","author":"JJ Driscoll","year":"2009","unstructured":"Driscoll JJ, Rixe O (2009) Overall survival: still the gold standard: why overall survival remains the definitive end point in cancer clinical trials. Cancer J 15(5):401\u2013405","journal-title":"Cancer J"},{"issue":"2","key":"2886_CR5","doi-asserted-by":"publisher","first-page":"563","DOI":"10.1148\/radiol.2015151169","volume":"278","author":"RJ Gillies","year":"2016","unstructured":"Gillies RJ, Kinahan PE, Hricak H (2016) Radiomics: images are more than pictures, they are data. Radiology 278(2):563","journal-title":"Radiology"},{"issue":"3","key":"2886_CR6","doi-asserted-by":"publisher","first-page":"505","DOI":"10.1148\/radiol.2021202553","volume":"298","author":"MR Tomaszewski","year":"2021","unstructured":"Tomaszewski MR, Gillies RJ (2021) The biological meaning of radiomic features. Radiology 298(3):505","journal-title":"Radiology"},{"key":"2886_CR7","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"issue":"5","key":"2886_CR8","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0197992","volume":"13","author":"Y Cai","year":"2018","unstructured":"Cai Y, Shaoju W, Zhao W, Li Z, Zheyang W, Ji S (2018) Concussion classification via deep learning using whole-brain white matter fiber strains. PLoS ONE 13(5):e0197992","journal-title":"PLoS ONE"},{"issue":"10","key":"2886_CR9","doi-asserted-by":"publisher","first-page":"2439","DOI":"10.1162\/08997660260293292","volume":"14","author":"A Vehtari","year":"2002","unstructured":"Vehtari A, Lampinen J (2002) Bayesian model assessment and comparison using cross-validation predictive densities. Neural Comput 14(10):2439\u20132468","journal-title":"Neural Comput"},{"key":"2886_CR10","doi-asserted-by":"crossref","unstructured":"Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D (2017) Grad-cam: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE international conference on computer vision, pp 618\u2013626","DOI":"10.1109\/ICCV.2017.74"},{"key":"2886_CR11","doi-asserted-by":"publisher","DOI":"10.1016\/j.jneumeth.2021.109098","volume":"353","author":"Y Zhang","year":"2021","unstructured":"Zhang Y, Hong D, McClement D, Oladosu O, Pridham G, Slaney G (2021) Grad-cam helps interpret the deep learning models trained to classify multiple sclerosis types using clinical brain magnetic resonance imaging. J Neurosci Methods 353:109098","journal-title":"J Neurosci Methods"},{"key":"2886_CR12","doi-asserted-by":"crossref","unstructured":"Irie R, Otsuka Y, Hagiwara A, Kamagata K, Kamiya K, Suzuki M, Wada A, Maekawa T, Fujita S, Kato S (2020) A novel deep learning approach with a 3d convolutional ladder network for differential diagnosis of idiopathic normal pressure hydrocephalus and Alzheimer\u2019s disease. Magn Resonan Med Sci mp\u20132019","DOI":"10.2463\/mrms.mp.2019-0106"},{"issue":"5","key":"2886_CR13","doi-asserted-by":"publisher","first-page":"E5","DOI":"10.3171\/2018.8.FOCUS18325","volume":"45","author":"AV Nguyen","year":"2018","unstructured":"Nguyen AV, Blears EE, Ross E, Lall RR, Ortega-Barnett J (2018) Machine learning applications for the differentiation of primary central nervous system lymphoma from glioblastoma on imaging: a systematic review and meta-analysis. Neurosurg Focus 45(5):E5","journal-title":"Neurosurg Focus"},{"issue":"2","key":"2886_CR14","doi-asserted-by":"publisher","first-page":"560","DOI":"10.1002\/jmri.26602","volume":"50","author":"CH Suh","year":"2019","unstructured":"Suh CH, Kim HS, Jung SC, Park JE, Choi CG, Kim SJ (2019) Mri as a diagnostic biomarker for differentiating primary central nervous system lymphoma from glioblastoma: a systematic review and meta-analysis. J Magn Reson Imaging 50(2):560\u2013572","journal-title":"J Magn Reson Imaging"},{"key":"2886_CR15","doi-asserted-by":"publisher","first-page":"1151","DOI":"10.3389\/fonc.2020.01151","volume":"10","author":"C Chen","year":"2020","unstructured":"Chen C, Zheng A, Ou X, Wang J, Ma X (2020) Comparison of radiomics-based machine-learning classifiers in diagnosis of glioblastoma from primary central nervous system lymphoma. Front Oncol 10:1151","journal-title":"Front Oncol"},{"key":"2886_CR16","doi-asserted-by":"publisher","first-page":"73","DOI":"10.3389\/fncom.2019.00073","volume":"13","author":"L Weninger","year":"2019","unstructured":"Weninger L, Haarburger C, Merhof D (2019) Robustness of radiomics for survival prediction of brain tumor patients depending on resection status. Front Comput Neurosci 13:73","journal-title":"Front Comput Neurosci"},{"key":"2886_CR17","doi-asserted-by":"crossref","unstructured":"Liu S, Liu S, Cai W, Pujol S, Kikinis R, Feng D (2014) Early diagnosis of Alzheimer\u2019s disease with deep learning. In: 2014 IEEE 11th international symposium on biomedical imaging (ISBI). IEEE, pp 1015\u20131018","DOI":"10.1109\/ISBI.2014.6868045"},{"key":"2886_CR18","doi-asserted-by":"crossref","unstructured":"Chen W, Liu B, Peng S, Sun J, Qiao X (2018) S3d-unet: separable 3d u-net for brain tumor segmentation. In: International MICCAI Brainlesion workshop. Springer, pp 358\u2013368","DOI":"10.1007\/978-3-030-11726-9_32"},{"key":"2886_CR19","doi-asserted-by":"publisher","DOI":"10.1016\/j.ebiom.2020.103121","volume":"62","author":"Yu He","year":"2020","unstructured":"He Yu, Ian P, Bingting B, Kasey H, Marcello C, Hui L, Shuping P, Sebro Ronnie A, Jing G, Thomas Y (2020) Deep learning-based classification of primary bone tumors on radiographs: a preliminary study. EBioMedicine 62:103121","journal-title":"EBioMedicine"},{"key":"2886_CR20","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2021.106086","volume":"205","author":"TK Yoo","year":"2021","unstructured":"Yoo TK, Choi JY, Kim HK, Ryu IH, Kim JK (2021) Adopting low-shot deep learning for the detection of conjunctival melanoma using ocular surface images. Comput Methods Programs Biomed 205:106086","journal-title":"Comput Methods Programs Biomed"},{"key":"2886_CR21","unstructured":"https:\/\/www.slicer.org"},{"issue":"1","key":"2886_CR22","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1002\/acm2.12795","volume":"21","author":"H Moradmand","year":"2020","unstructured":"Moradmand H, Aghamiri SMR, Ghaderi R (2020) Impact of image preprocessing methods on reproducibility of radiomic features in multimodal magnetic resonance imaging in glioblastoma. J Appl Clin Med Phys 21(1):179\u2013190","journal-title":"J Appl Clin Med Phys"},{"key":"2886_CR23","doi-asserted-by":"crossref","unstructured":"Hatamizadeh A, Tang Y, Nath V, Yang D, Myronenko A, Landman B, Roth HR, Xu D (2022) Unetr: transformers for 3d medical image segmentation. In: Proceedings of the IEEE\/CVF winter conference on applications of computer vision pp 574\u2013584","DOI":"10.1109\/WACV51458.2022.00181"},{"issue":"10","key":"2886_CR24","doi-asserted-by":"publisher","first-page":"1993","DOI":"10.1109\/TMI.2014.2377694","volume":"34","author":"BH Menze","year":"2014","unstructured":"Menze BH, Jakab A, Bauer S, Kalpathy-Cramer J, Farahani K, Kirby J, Burren Y, Porz N, Slotboom J, Wiest R (2014) The multimodal brain tumor image segmentation benchmark (brats). IEEE Trans Med Imaging 34(10):1993\u20132024","journal-title":"IEEE Trans Med Imaging"},{"key":"2886_CR25","unstructured":"https:\/\/en.wikipedia.org\/wiki\/Student"},{"issue":"1","key":"2886_CR26","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1002\/jmri.24756","volume":"42","author":"D Bonekamp","year":"2015","unstructured":"Bonekamp D, Deike K, Wiestler B, Wick W, Bendszus M, Radbruch A, Heiland S (2015) Association of overall survival in patients with newly diagnosed glioblastoma with contrast-enhanced perfusion mri: comparison of intraindividually matched t1-and t2*-based bolus techniques. J Magn Reson Imaging 42(1):87\u201396","journal-title":"J Magn Reson Imaging"},{"key":"2886_CR27","doi-asserted-by":"crossref","unstructured":"Chan H-W, Weng Y-T, Huang T-Y (2020) Automatic classification of brain tumor types with the MRI scans and histopathology images pp 353\u2013359","DOI":"10.1007\/978-3-030-46643-5_35"},{"issue":"7440","key":"2886_CR28","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1038\/nature11971","volume":"495","author":"D Ma","year":"2013","unstructured":"Ma D, Gulani V, Seiberlich N, Liu K, Sunshine JL, Duerk JL, Griswold MA (2013) Magnetic resonance fingerprinting. Nature 495(7440):187\u2013192","journal-title":"Nature"},{"issue":"10","key":"2886_CR29","doi-asserted-by":"publisher","first-page":"1557","DOI":"10.1212\/01.WNL.0000034256.20173.EA","volume":"59","author":"R Lai","year":"2002","unstructured":"Lai R, Rosenblum MK, DeAngelis LM (2002) Primary cns lymphoma: a whole-brain disease? Neurology 59(10):1557\u20131562","journal-title":"Neurology"},{"issue":"8","key":"2886_CR30","doi-asserted-by":"publisher","first-page":"708","DOI":"10.7150\/ijms.4843","volume":"9","author":"B Chen","year":"2012","unstructured":"Chen B, Wang H, Ge P, Zhao J, Li W, Huizi G, Wang G, Luo Y, Chen D (2012) Gross total resection of glioma with the intraoperative fluorescence-guidance of fluorescein sodium. Int J Med Sci 9(8):708","journal-title":"Int J Med Sci"},{"issue":"2","key":"2886_CR31","doi-asserted-by":"publisher","first-page":"71","DOI":"10.21767\/2254-6081.100071","volume":"4","author":"J Yun","year":"2016","unstructured":"Yun J, Iwamoto FM, Sonabend AM (2016) Primary central nervous system lymphoma: a critical review of the role of surgery for resection. Arch Cancer Res 4(2):71","journal-title":"Arch Cancer Res"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-023-02886-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-023-02886-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-023-02886-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,12]],"date-time":"2023-09-12T05:17:48Z","timestamp":1694495868000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-023-02886-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,21]]},"references-count":31,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["2886"],"URL":"https:\/\/doi.org\/10.1007\/s11548-023-02886-2","relation":{},"ISSN":["1861-6429"],"issn-type":[{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,21]]},"assertion":[{"value":"9 December 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 March 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 April 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and\/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. Besides, this observational study was approved by the Ethical Committee of San Raffaele Hospital in Milan (Italy) with number 22\/INT\/2021.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Informed consent was obtained from all individual participants included in the study.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}]}}