{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T19:04:49Z","timestamp":1771700689827,"version":"3.50.1"},"reference-count":47,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,1,7]],"date-time":"2021-01-07T00:00:00Z","timestamp":1609977600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2021,1,7]],"date-time":"2021-01-07T00:00:00Z","timestamp":1609977600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["81973154"],"award-info":[{"award-number":["81973154"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["81502897"],"award-info":[{"award-number":["81502897"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Under the influences of chemotherapy regimens, clinical staging, immunologic expressions and other factors, the survival rates of patients with diffuse large B-cell lymphoma (DLBCL) are different. The accurate prediction of mortality hazards is key to precision medicine, which can help clinicians make optimal therapeutic decisions to extend the survival times of individual patients with DLBCL. Thus, we have developed a predictive model to predict the mortality hazard of DLBCL patients within 2\u2009years of treatment.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>We evaluated 406 patients with DLBCL and collected 17 variables from each patient. The predictive variables were selected by the Cox model, the logistic model and the random forest algorithm. Five classifiers were chosen as the base models for ensemble learning: the na\u00efve Bayes, logistic regression, random forest, support vector machine and feedforward neural network models. We first calibrated the biased outputs from the five base models by using probability calibration methods (including shape-restricted polynomial regression, Platt scaling and isotonic regression). Then, we aggregated the outputs from the various base models to predict the 2-year mortality of DLBCL patients by using three strategies (stacking, simple averaging and weighted averaging). Finally, we assessed model performance over 300 hold-out tests.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Gender, stage, IPI, KPS and rituximab were significant factors for predicting the deaths of DLBCL patients within 2\u2009years of treatment. The stacking model that first calibrated the base model by shape-restricted polynomial regression performed best (AUC\u2009=\u20090.820, ECE\u2009=\u20098.983, MCE\u2009=\u200921.265) in all methods. In contrast, the performance of the stacking model without undergoing probability calibration is inferior (AUC\u2009=\u20090.806, ECE\u2009=\u20099.866, MCE\u2009=\u200924.850). In the simple averaging model and weighted averaging model, the prediction error of the ensemble model also decreased with probability calibration.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>Among all the methods compared, the proposed model has the lowest prediction error when predicting the 2-year mortality of DLBCL patients. These promising results may indicate that our modeling strategy of applying probability calibration to ensemble learning is successful.<\/jats:p><\/jats:sec>","DOI":"10.1186\/s12911-020-01354-0","type":"journal-article","created":{"date-parts":[[2021,1,7]],"date-time":"2021-01-07T13:04:57Z","timestamp":1610024697000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Applying probability calibration to ensemble methods to predict 2-year mortality in patients with DLBCL"],"prefix":"10.1186","volume":"21","author":[{"given":"Shuanglong","family":"Fan","sequence":"first","affiliation":[]},{"given":"Zhiqiang","family":"Zhao","sequence":"additional","affiliation":[]},{"given":"Hongmei","family":"Yu","sequence":"additional","affiliation":[]},{"given":"Lei","family":"Wang","sequence":"additional","affiliation":[]},{"given":"Chuchu","family":"Zheng","sequence":"additional","affiliation":[]},{"given":"Xueqian","family":"Huang","sequence":"additional","affiliation":[]},{"given":"Zhenhuan","family":"Yang","sequence":"additional","affiliation":[]},{"given":"Meng","family":"Xing","sequence":"additional","affiliation":[]},{"given":"Qing","family":"Lu","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0943-4169","authenticated-orcid":false,"given":"Yanhong","family":"Luo","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,1,7]]},"reference":[{"issue":"5","key":"1354_CR1","first-page":"1","volume":"52","author":"A Jemal","year":"2013","unstructured":"Jemal A, Siegel R, Xu JQ, et al. Cancer statistics. CA Cancer J Clin. 2013;52(5):1\u201324.","journal-title":"CA Cancer J Clin"},{"issue":"1","key":"1354_CR2","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1038\/nrclinonc.2013.197","volume":"11","author":"M Roschewski","year":"2014","unstructured":"Roschewski M, Staudt LM, Wilson WH. Diffuse large B-cell lymphoma\u2014treatment approaches in the molecular era. Nat Rev Clin Oncol. 2014;11(1):12\u201323.","journal-title":"Nat Rev Clin Oncol"},{"issue":"21","key":"1354_CR3","doi-asserted-by":"publisher","first-page":"2307","DOI":"10.1182\/blood-2017-11-764332","volume":"131","author":"L Pasqualucci","year":"2018","unstructured":"Pasqualucci L, Dalla-Favera R. Genetics of diffuse large B-cell lymphoma. Blood. 2018;131(21):2307\u201319.","journal-title":"Blood"},{"issue":"2","key":"1354_CR4","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1016\/j.critrevonc.2012.12.009","volume":"87","author":"M Martelli","year":"2013","unstructured":"Martelli M, Ferreri AJM, Agostinelli C, et al. Diffuse large B-cell lymphoma. Crit Rev Oncol Hematol. 2013;87(2):146\u201371.","journal-title":"Crit Rev Oncol Hematol"},{"issue":"Suppl 7","key":"1354_CR5","doi-asserted-by":"publisher","first-page":"vii78","DOI":"10.1093\/annonc\/mds273","volume":"23","author":"H Tilly","year":"2012","unstructured":"Tilly H, Vitolo U, Walewski J, et al. Diffuse large B-cell lymphoma (DLBCL): ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann Oncol. 2012;23(Suppl 7):vii78\u201382.","journal-title":"Ann Oncol"},{"issue":"7","key":"1354_CR6","doi-asserted-by":"publisher","first-page":"1564","DOI":"10.1038\/leu.2015.43","volume":"29","author":"H Horn","year":"2015","unstructured":"Horn H, Ziepert M, Wartenberg M, et al. Different biological risk factors in young poor-prognosis and elderly patients with diffuse large B-cell lymphoma. Leukemia. 2015;29(7):1564\u201370.","journal-title":"Leukemia"},{"issue":"2","key":"1354_CR7","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1016\/j.jgo.2014.11.004","volume":"6","author":"VA Morrison","year":"2015","unstructured":"Morrison VA, Hamlin P, Soubeyran P, et al. Diffuse large B-cell lymphoma in the elderly: impact of prognosis, comorbidities, geriatric assessment, and supportive care on clinical practice. An International Society of Geriatric Oncology (SIOG) expert position paper. J Geriatr Oncol. 2015;6(2):141\u201352.","journal-title":"J Geriatr Oncol"},{"issue":"23","key":"1354_CR8","doi-asserted-by":"publisher","first-page":"2229","DOI":"10.1056\/NEJMsb1503104","volume":"372","author":"JL Jameson","year":"2015","unstructured":"Jameson JL, Longo DL. Precision medicine \u2014 personalized, problematic, and promising. N Engl J Med. 2015;372(23):2229\u201334.","journal-title":"N Engl J Med"},{"issue":"7","key":"1354_CR9","doi-asserted-by":"publisher","first-page":"1869","DOI":"10.1007\/s11695-017-3099-2","volume":"28","author":"E Stenberg","year":"2018","unstructured":"Stenberg E, Cao Y, Szabo E, et al. Risk prediction model for severe postoperative complication in bariatric surgery. Obes Surg. 2018;28(7):1869\u201375.","journal-title":"Obes Surg"},{"issue":"18","key":"1354_CR10","doi-asserted-by":"publisher","first-page":"1840","DOI":"10.1200\/JCO.2017.75.9480","volume":"36","author":"AC Degnim","year":"2018","unstructured":"Degnim AC, Winham SJ, Frank RD, et al. Model for predicting breast cancer risk in women with atypical hyperplasia. J Clin Oncol. 2018;36(18):1840\u20136.","journal-title":"J Clin Oncol"},{"key":"1354_CR11","first-page":"171","volume-title":"Maching learning","author":"ZH Zhou","year":"2016","unstructured":"Zhou ZH. Ensemble learning. In: Maching learning. Beijing: Tsinghua University press; 2016. p. 171\u201396."},{"issue":"1","key":"1354_CR12","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1109\/MCI.2015.2471235","volume":"11","author":"Y Ren","year":"2016","unstructured":"Ren Y, Zhang L, Suganthan PN. Ensemble classification and regression-recent developments, applications and future directions. IEEE Comput Intell Mag. 2016;11(1):41\u201353.","journal-title":"IEEE Comput Intell Mag"},{"key":"1354_CR13","doi-asserted-by":"publisher","unstructured":"Dietterich T.G. (2000) Ensemble methods in machine learning. In: Multiple classifier systems. MCS 2000. Lecture notes in computer science, vol 1857. Berlin, Heidelberg: Springer. https:\/\/doi.org\/10.1007\/3-540-45014-9_1.","DOI":"10.1007\/3-540-45014-9_1"},{"key":"1354_CR14","unstructured":"Kohavi R, Wolpert DH. Bias plus variance decomposition for zero-one loss functions. In: ICML'96: Proceedings of the thirteenth international conference on international conference on machine learning. 1996. p. 275\u2013283."},{"issue":"8","key":"1354_CR15","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1007\/s10509-019-3602-4","volume":"364","author":"Y Wang","year":"2019","unstructured":"Wang Y, Pan Z, Zheng J, et al. A hybrid ensemble method for pulsar candidate classification. Astrophysics Space Sci. 2019;364(8):139.","journal-title":"Astrophysics Space Sci"},{"key":"1354_CR16","volume-title":"Ensemble deep learning for regression and time series forecasting. Computational intelligence in ensemble learning","author":"X Qiu","year":"2015","unstructured":"Qiu X, Zhang L, Ren Y, et al. Ensemble deep learning for regression and time series forecasting. Computational intelligence in ensemble learning, 2015."},{"issue":"7","key":"1354_CR17","doi-asserted-by":"publisher","first-page":"1650025","DOI":"10.1142\/S0129065716500258","volume":"26","author":"A Ortiz","year":"2016","unstructured":"Ortiz A, Munilla J, G\u00f3rriz JM, et al. Ensembles of deep learning architectures for the early diagnosis of the Alzheimer\u2019s disease. Int J Neural Syst. 2016;26(7):1650025.","journal-title":"Int J Neural Syst"},{"key":"1354_CR18","first-page":"121","volume":"2008","author":"H Bostr\u00f6m","year":"2008","unstructured":"Bostr\u00f6m H. Calibrating random forests. Seventh Int Conf Mach Learn Appl. 2008;2008:121\u20136.","journal-title":"Seventh Int Conf Mach Learn Appl"},{"issue":"3","key":"1354_CR19","first-page":"61","volume":"10","author":"J Platt","year":"1999","unstructured":"Platt J. Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Adv Large Margin Classifiers. 1999;10(3):61\u201374.","journal-title":"Adv Large Margin Classifiers"},{"key":"1354_CR20","doi-asserted-by":"publisher","unstructured":"Bostr\u00f6m H. Estimating class probabilities in random forests. In: Sixth international conference on machine learning and applications (ICMLA 2007), Cincinnati, OH. 2007. p. 211\u2013216. https:\/\/doi.org\/10.1109\/ICMLA.2007.64.","DOI":"10.1109\/ICMLA.2007.64"},{"key":"1354_CR21","doi-asserted-by":"publisher","first-page":"694","DOI":"10.1145\/775047.775151","volume-title":"Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"B Zadrozny","year":"2002","unstructured":"Zadrozny B, Elkan C. Transforming classifier scores into accurate multiclass probability estimates. In: Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining; 2002. p. 694\u20139."},{"key":"1354_CR22","first-page":"609","volume":"1","author":"B Zadrozny","year":"2001","unstructured":"Zadrozny B, Elkan C. Obtaining calibrated probability estimates from decision trees and naive Bayesian classifiers. ICML. 2001;1:609\u201316.","journal-title":"ICML"},{"key":"1354_CR23","first-page":"625","volume-title":"Predicting good probabilities with supervised learning","author":"A Niculescu-Mizil","year":"2005","unstructured":"Niculescu-Mizil A, Caruana R. Predicting good probabilities with supervised learning. Bonn: Association for Computing Machinery; 2005. p. 625\u201332."},{"issue":"8","key":"1354_CR24","doi-asserted-by":"publisher","first-page":"1813","DOI":"10.1109\/TPAMI.2019.2895794","volume":"41","author":"Y Wang","year":"2019","unstructured":"Wang Y, Li L, Dang C. Calibrating classification probabilities with shape-restricted polynomial regression. IEEE Trans Pattern Anal Mach Intell. 2019;41(8):1813\u201327.","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"3","key":"1354_CR25","doi-asserted-by":"publisher","first-page":"226","DOI":"10.1056\/NEJMoa1002358","volume":"364","author":"GW Stone","year":"2011","unstructured":"Stone GW, Maehara A, Lansky AJ, et al. A prospective natural-history study of coronary atherosclerosis. N Engl J Med. 2011;364(3):226\u201335.","journal-title":"N Engl J Med"},{"issue":"12","key":"1354_CR26","doi-asserted-by":"publisher","first-page":"1503","DOI":"10.1016\/0895-4356(95)00048-8","volume":"48","author":"P Peduzzi","year":"1995","unstructured":"Peduzzi P, Concato J, Feinstein AR, et al. Importance of events per independent variable in proportional hazards regression analysis II. Accuracy and precision of regression estimates. J Clin Epidemiol. 1995;48(12):1503\u201310.","journal-title":"J Clin Epidemiol"},{"issue":"1","key":"1354_CR27","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1186\/1471-2407-14-153","volume":"14","author":"X He","year":"2014","unstructured":"He X, Chen Z, Fu T, et al. Ki-67 is a valuable prognostic predictor of lymphoma but its utility varies in lymphoma subtypes: evidence from a systematic meta-analysis. BMC Cancer. 2014;14(1):153.","journal-title":"BMC Cancer"},{"issue":"2","key":"1354_CR28","doi-asserted-by":"publisher","first-page":"140","DOI":"10.1007\/s12185-014-1719-3","volume":"101","author":"MK Song","year":"2015","unstructured":"Song MK, Chung JS, Lee JJ, et al. High Ki-67 expression in involved bone marrow predicts worse clinical outcome in diffuse large B cell lymphoma patients treated with R-CHOP therapy. Int J Hematol. 2015;101(2):140\u20137.","journal-title":"Int J Hematol"},{"issue":"4","key":"1354_CR29","first-page":"381","volume":"4","author":"A Weigend","year":"1993","unstructured":"Weigend A. On overfitting and the effective number of hidden units. Proc Connectionist Models Summer School. 1993;4(4):381\u201391.","journal-title":"Proc Connectionist Models Summer School"},{"key":"1354_CR30","doi-asserted-by":"crossref","unstructured":"Caruana R, Lawrence S, Giles CL. Overfitting in neural nets: backpropagation, conjugate gradient, and early stopping. In: Advances in neural information processing systems. 2000. p. 402\u2013408.","DOI":"10.1109\/IJCNN.2000.857823"},{"key":"1354_CR31","unstructured":"Lawrence S, Giles CL, Tsoi AC. Lessons in neural network training: overfitting may be harder than expected. In: National conference on artificial intelligence. 1997. p. 540\u2013545."},{"issue":"5","key":"1354_CR32","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1016\/0893-6080(89)90020-8","volume":"2","author":"K Hornik","year":"1989","unstructured":"Hornik K, Stinchcombe M, White H. Multilayer feedforward networks are universal approximators. Neural Netw. 1989;2(5):359\u201366.","journal-title":"Neural Netw"},{"key":"1354_CR33","first-page":"97","volume-title":"Maching learning","author":"ZH Zhou","year":"2016","unstructured":"Zhou ZH. Neural networks. In: Maching learning. Beijing: Tsinghua University press; 2016. p. 97\u2013120."},{"issue":"4","key":"1354_CR34","doi-asserted-by":"publisher","first-page":"641","DOI":"10.1214\/aoms\/1177728423","volume":"26","author":"M Ayer","year":"1955","unstructured":"Ayer M, Brunk HD, Ewing GM, et al. An empirical distribution function for sampling with incomplete information. Ann Math Stat. 1955;26(4):641\u20137.","journal-title":"Ann Math Stat"},{"issue":"2","key":"1354_CR35","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1016\/S0893-6080(05)80023-1","volume":"5","author":"DH Wolpert","year":"1992","unstructured":"Wolpert DH. Stacked generalization. Neural Netw. 1992;5(2):241\u201359.","journal-title":"Neural Netw"},{"issue":"14","key":"1354_CR36","doi-asserted-by":"publisher","first-page":"1377","DOI":"10.1001\/jama.2017.12126","volume":"318","author":"AC Alba","year":"2017","unstructured":"Alba AC, Agoritsas T, Walsh M, et al. Discrimination and calibration of clinical prediction models: users\u2019 guides to the medical literature. JAMA. 2017;318(14):1377\u201384.","journal-title":"JAMA"},{"issue":"9","key":"1354_CR37","doi-asserted-by":"publisher","first-page":"965","DOI":"10.1002\/(SICI)1097-0258(19970515)16:9<965::AID-SIM509>3.0.CO;2-O","volume":"16","author":"DW Hosmer","year":"1997","unstructured":"Hosmer DW, Hosmer T, Le Cessie S, et al. A comparison of goodness-of-fit tests for the logistic regression model. Stat Med. 1997;16(9):965\u201380.","journal-title":"Stat Med"},{"key":"1354_CR38","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1137\/1.9781611974010.24","volume-title":"Proceedings of the 2015 SIAM International Conference on Data Mining","author":"MP Naeini","year":"2015","unstructured":"Naeini MP, Cooper GF, Hauskrecht M. Binary classifier calibration using a Bayesian non-parametric approach. In: Proceedings of the 2015 SIAM International Conference on Data Mining; 2015. p. 208\u201316."},{"issue":"1","key":"1354_CR39","first-page":"2909","volume":"17","author":"S Diamond","year":"2016","unstructured":"Diamond S, Boyd S. CVXPY: a Python-embedded modeling language for convex optimization. J Mach Learn Res. 2016;17(1):2909\u201313.","journal-title":"J Mach Learn Res"},{"issue":"1","key":"1354_CR40","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1080\/23307706.2017.1397554","volume":"5","author":"A Agrawal","year":"2018","unstructured":"Agrawal A, Verschueren R, Diamond S, et al. A rewriting system for convex optimization problems. J Control Decis. 2018;5(1):42\u201360.","journal-title":"J Control Decis"},{"issue":"4","key":"1354_CR41","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1056\/NEJMoa011795","volume":"346","author":"B Coiffier","year":"2002","unstructured":"Coiffier B, Lepage E, Bri\u00e8re J, et al. CHOP chemotherapy plus rituximab compared with CHOP alone in elderly patients with diffuse large-B-cell lymphoma. N Engl J Med. 2002;346(4):235\u201342.","journal-title":"N Engl J Med"},{"key":"1354_CR42","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1016\/S1470-2045(06)70664-7","volume":"7","author":"M Pfreundschuh","year":"2006","unstructured":"Pfreundschuh M, Tr\u00fcmper L, Osterborg A, et al. CHOP-like chemotherapy plus rituximab versus CHOP-like chemotherapy alone in young patients with good-prognosis diffuse large-B-cell lymphoma: a randomised controlled trial by the MabThera international trial (MInT) group. Lancet Oncol. 2006;7:379\u201391.","journal-title":"Lancet Oncol"},{"issue":"12","key":"1354_CR43","doi-asserted-by":"publisher","first-page":"2040","DOI":"10.1182\/blood-2010-03-276246","volume":"116","author":"B Coiffier","year":"2010","unstructured":"Coiffier B, Thieblemont C, Van Den Neste E, et al. Long-term outcome of patients in the LNH-98.5 trial, the first randomized study comparing rituximab-CHOP to standard CHOP chemotherapy in DLBCL patients : a study by the Groupe d'Etudes des Lymphomes de l'Adulte. Blood. 2010;116(12):2040\u20135.","journal-title":"Blood"},{"issue":"28","key":"1354_CR44","doi-asserted-by":"publisher","first-page":"4587","DOI":"10.1200\/JCO.2007.15.9277","volume":"26","author":"K Fu","year":"2008","unstructured":"Fu K, Weisenburger DD, Choi WWL, et al. Addition of rituximab to standard chemotherapy improves the survival of both the germinal center B-cell-like and non-germinal center B-cell-like subtypes of diffuse large B-cell lymphoma. J Clin Oncol. 2008;26(28):4587\u201394.","journal-title":"J Clin Oncol"},{"issue":"9","key":"1354_CR45","first-page":"816","volume":"34","author":"Chinese Society of Hematology","year":"2013","unstructured":"Chinese Society of Hematology. Guidelines for the diagnosis and treatment of diffuse large B-cell lymphoma in China (2013 edition). Chin J Hematol. 2013;34(9):816\u20139.","journal-title":"Chin J Hematol"},{"issue":"12","key":"1354_CR46","doi-asserted-by":"publisher","first-page":"1043","DOI":"10.1046\/j.1440-1827.1999.00980.x","volume":"49","author":"A Zhang","year":"2010","unstructured":"Zhang A, Ohshima K, Sato K, et al. Prognostic clinicopathologic factors, including immunologic expression in diffuse large B-cell lymphomas. Pathol Int. 2010;49(12):1043\u201352.","journal-title":"Pathol Int"},{"issue":"6","key":"1354_CR47","doi-asserted-by":"publisher","first-page":"650","DOI":"10.6004\/jnccn.2019.0029","volume":"17","author":"A Zelenetz","year":"2019","unstructured":"Zelenetz A, Gordon L, Abramson J, et al. NCCN clinical practice guidelines in oncology: B-cell lymphomas, Version 3.2019. J Natl Compr Canc Netw. 2019;17(6):650\u201361.","journal-title":"J Natl Compr Canc Netw."}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-020-01354-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12911-020-01354-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-020-01354-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,10]],"date-time":"2022-12-10T22:06:01Z","timestamp":1670709961000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-020-01354-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,7]]},"references-count":47,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["1354"],"URL":"https:\/\/doi.org\/10.1186\/s12911-020-01354-0","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,7]]},"assertion":[{"value":"6 July 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 November 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 January 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"We have got the ethics approval from the \u201cShan Xi tumor hospital ethics committee\u201d and get the reference number of 201835. Because our research did not involve any participants\u2019 identifiers such as name, address, only oral consent was obtained from each participant after they were informed about the study\u2019s purpose and procedure and the confidentiality of data. This procedure was approved by the ethics committee.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"14"}}