{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,31]],"date-time":"2025-12-31T22:19:53Z","timestamp":1767219593404},"reference-count":67,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,7,24]],"date-time":"2021-07-24T00:00:00Z","timestamp":1627084800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,7,24]],"date-time":"2021-07-24T00:00:00Z","timestamp":1627084800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Inform Decis Mak"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Many models are published which predict outcomes in hospitalized COVID-19 patients. The generalizability of many is unknown. We evaluated the performance of selected models from the literature and our own models to predict outcomes in patients at our institution.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>We searched the literature for models predicting outcomes in inpatients with COVID-19. We produced models of mortality or criticality (mortality or ICU admission) in a development cohort. We tested external models which provided sufficient information and our models using a test cohort of our most recent patients. The performance of models was compared using the area under the receiver operator curve (AUC).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Our literature review yielded 41 papers. Of those, 8 were found to have sufficient documentation and concordance with features available in our cohort to implement in our test cohort. All models were from Chinese patients. One model predicted criticality and seven mortality. Tested against the test cohort, internal models had an AUC of 0.84 (0.74\u20130.94) for mortality and 0.83 (0.76\u20130.90) for criticality. The best external model had an AUC of 0.89 (0.82\u20130.96) using three variables, another an AUC of 0.84 (0.78\u20130.91) using ten variables. AUC\u2019s ranged from 0.68 to 0.89. On average, models tested were unable to produce predictions in 27% of patients due to missing lab data.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>Despite differences in pandemic timeline, race, and socio-cultural healthcare context some models derived in China performed well. For healthcare organizations considering implementation of an external model, concordance between the features used in the model and features available in their own patients may be important. Analysis of both local and external models should be done to help decide on what prediction method is used to provide clinical decision support to clinicians treating COVID-19 patients as well as what lab tests should be included in order sets.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12911-021-01576-w","type":"journal-article","created":{"date-parts":[[2021,7,24]],"date-time":"2021-07-24T07:03:07Z","timestamp":1627110187000},"update-policy":"http:\/\/dx.doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Predicting clinical outcomes among hospitalized COVID-19 patients using both local and published models"],"prefix":"10.1186","volume":"21","author":[{"given":"William","family":"Galanter","sequence":"first","affiliation":[]},{"given":"Jorge Mario","family":"Rodr\u00edguez-Fern\u00e1ndez","sequence":"additional","affiliation":[]},{"given":"Kevin","family":"Chow","sequence":"additional","affiliation":[]},{"given":"Samuel","family":"Harford","sequence":"additional","affiliation":[]},{"given":"Karl M.","family":"Kochendorfer","sequence":"additional","affiliation":[]},{"given":"Maryam","family":"Pishgar","sequence":"additional","affiliation":[]},{"given":"Julian","family":"Theis","sequence":"additional","affiliation":[]},{"given":"John","family":"Zulueta","sequence":"additional","affiliation":[]},{"given":"Houshang","family":"Darabi","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,7,24]]},"reference":[{"issue":"1","key":"1576_CR1","doi-asserted-by":"crossref","first-page":"69","DOI":"10.32776\/revbiomed.v17i1.440","volume":"17","author":"JK Taubenberger","year":"2006","unstructured":"Taubenberger JK, Morens DM. 1918 Influenza: the mother of all pandemics. Rev Biomed. 2006;17(1):69\u201379.","journal-title":"Rev Biomed"},{"key":"1576_CR2","doi-asserted-by":"publisher","unstructured":"Bhutta N, Blair J, Dettling LJ, Moore KB. COVID-19, the CARES Act, and families' financial security. SSRN 2020. https:\/\/doi.org\/10.2139\/ssrn.3631903.","DOI":"10.2139\/ssrn.3631903"},{"issue":"5804","key":"1576_CR3","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1136\/bmj.2.5804.9","volume":"2","author":"F De Dombal","year":"1972","unstructured":"De Dombal F, Leaper D, Staniland JR, McCann A, Horrocks JC. Computer-aided diagnosis of acute abdominal pain. Br Med J. 1972;2(5804):9\u201313.","journal-title":"Br Med J"},{"issue":"1","key":"1576_CR4","first-page":"69","volume":"139","author":"J Ranson","year":"1974","unstructured":"Ranson J, Rifkind K, Roses D, Fink S, Spencer F. Prognostic signs and the role of operative management in acute pancreatitis. Surg Gynecol Obstet. 1974;139(1):69\u201381.","journal-title":"Surg Gynecol Obstet"},{"issue":"6","key":"1576_CR5","doi-asserted-by":"publisher","first-page":"762","DOI":"10.1016\/j.jemermed.2015.02.018","volume":"48","author":"DC Kuo","year":"2015","unstructured":"Kuo DC, Rider AC, Estrada P, Kim D, Pillow MT. Acute pancreatitis: what\u2019s the score? J Emerg Med. 2015;48(6):762\u201370.","journal-title":"J Emerg Med"},{"issue":"25 Pt B","key":"1576_CR6","doi-asserted-by":"publisher","first-page":"2935","DOI":"10.1016\/j.jacc.2013.11.005","volume":"63","author":"DC Goff","year":"2014","unstructured":"Goff DC, Lloyd-Jones DM, Bennett G, Coady S, D\u2019agostino RB, Gibbons R, Greenland P, Lackland DT, Levy D, O\u2019donnell CJ. 2013 ACC\/AHA guideline on the assessment of cardiovascular risk: a report of the American College of Cardiology\/American Heart Association Task Force on Practice Guidelines. J Am Coll Cardiol. 2014;63(25 Pt B):2935\u201359.","journal-title":"J Am Coll Cardiol"},{"issue":"18","key":"1576_CR7","doi-asserted-by":"publisher","first-page":"2118","DOI":"10.1016\/j.jacc.2016.02.055","volume":"67","author":"JS Rana","year":"2016","unstructured":"Rana JS, Tabada GH, Solomon MD, Lo JC, Jaffe MG, Sung SH, Ballantyne CM, Go AS. Accuracy of the atherosclerotic cardiovascular risk equation in a large contemporary, multiethnic population. J Am Coll Cardiol. 2016;67(18):2118\u201330.","journal-title":"J Am Coll Cardiol"},{"key":"1576_CR8","doi-asserted-by":"publisher","DOI":"10.1002\/9781118548387","volume-title":"Applied logistic regression","author":"DW Hosmer Jr","year":"2013","unstructured":"Hosmer DW Jr, Lemeshow S, Sturdivant RX. Applied logistic regression, vol. 398. Hoboken: Wiley; 2013."},{"issue":"3","key":"1576_CR9","doi-asserted-by":"publisher","first-page":"660","DOI":"10.1109\/21.97458","volume":"21","author":"SR Safavian","year":"1991","unstructured":"Safavian SR, Landgrebe D. A survey of decision tree classifier methodology. IEEE Trans Syst Man Cybern Syst. 1991;21(3):660\u201374.","journal-title":"IEEE Trans Syst Man Cybern Syst"},{"issue":"3","key":"1576_CR10","first-page":"18","volume":"2","author":"A Liaw","year":"2002","unstructured":"Liaw A, Wiener M. Classification and regression by randomForest. R news. 2002;2(3):18\u201322.","journal-title":"R news"},{"key":"1576_CR11","doi-asserted-by":"crossref","unstructured":"Chen T, Guestrin C. XGBoost: a scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining; San Fransisco, CA. 2016. p. 785\u201394.","DOI":"10.1145\/2939672.2939785"},{"key":"1576_CR12","unstructured":"Ke G, Meng Q, Finley T, Wang T, Chen W, Ma W, Ye Q, Liu T-Y. LightGBM: a highly efficient gradient boosting decision tree. In: Presented at Advances in Neural Information Processing Systems, NIPS, Long Beach, CA, vol. 30. 2017. p. 3146\u201354."},{"key":"1576_CR13","unstructured":"Prokhorenkova L, Gusev G, Vorobev A, Dorogush AV, Gulin A. CatBoost: unbiased boosting with categorical features. In: Advances in Neural Information Processing Systems; 2018. p. 6638\u201348."},{"issue":"3","key":"1576_CR14","doi-asserted-by":"publisher","first-page":"837","DOI":"10.2307\/2531595","volume":"44","author":"ER DeLong","year":"1988","unstructured":"DeLong ER, DeLong DM, Clarke-Pearson DL. Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics. 1988;44(3):837\u201345.","journal-title":"Biometrics"},{"issue":"12","key":"1576_CR15","doi-asserted-by":"publisher","first-page":"11306","DOI":"10.18632\/aging.103583","volume":"12","author":"G Bousquet","year":"2020","unstructured":"Bousquet G, Falgarone G, Deutsch D, Derolez S, Lopez-Sublet M, Goudot F-X, Amari K, Uzunhan Y, Bouchaud O, Pamoukdjian F. ADL-dependency, D-Dimers, LDH and absence of anticoagulation are independently associated with one-month mortality in older inpatients with Covid-19. Aging (Albany NY). 2020;12(12):11306\u201313.","journal-title":"Aging (Albany NY)"},{"issue":"11","key":"1576_CR16","doi-asserted-by":"publisher","first-page":"2473","DOI":"10.1002\/jmv.26166","volume":"92","author":"EA Toraih","year":"2020","unstructured":"Toraih EA, Elshazli RM, Hussein MH, Elgaml A, Amin MN, El-Mowafy M, El-Mesery M, Ellythy A, Duchesne J, Killackey MT. Association of cardiac biomarkers and comorbidities with increased mortality, severity, and cardiac injury in COVID-19 patients: a meta-regression and decision tree analysis. J Med Virol. 2020;92(11):2473\u201388.","journal-title":"J Med Virol"},{"issue":"6","key":"1576_CR17","doi-asserted-by":"publisher","first-page":"1393","DOI":"10.1093\/cid\/ciaa414","volume":"71","author":"D Ji","year":"2020","unstructured":"Ji D, Zhang D, Xu J, Chen Z, Yang T, Zhao P, Chen G, Cheng G, Wang Y, Bi J. Prediction for progression risk in patients with COVID-19 pneumonia: the CALL Score. Clin Infect Dis. 2020;71(6):1393\u20139.","journal-title":"Clin Infect Dis"},{"issue":"16","key":"1576_CR18","doi-asserted-by":"publisher","first-page":"2079","DOI":"10.1093\/cid\/ciaa538","volume":"71","author":"K Wang","year":"2020","unstructured":"Wang K, Zuo P, Liu Y, Zhang M, Zhao X, Xie S, Zhang H, Chen X, Liu C. Clinical and laboratory predictors of in-hospital mortality in patients with COVID-19: a cohort study in Wuhan, China. Clin Infect Dis. 2020;71(16):2079\u201388.","journal-title":"Clin Infect Dis"},{"issue":"8","key":"1576_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1001\/jamainternmed.2020.2033","volume":"180","author":"W Liang","year":"2020","unstructured":"Liang W, Liang H, Ou L, Chen B, Chen A, Li C, Li Y, Guan W, Sang L, Lu J. Development and validation of a clinical risk score to predict the occurrence of critical illness in hospitalized patients with COVID-19. JAMA Intern Med. 2020;180(8):1\u20139.","journal-title":"JAMA Intern Med"},{"key":"1576_CR20","doi-asserted-by":"publisher","first-page":"e168","DOI":"10.1017\/S0950268820001727","volume":"148","author":"X Ma","year":"2020","unstructured":"Ma X, Ng M, Xu S, Xu Z, Qiu H, Liu Y, Lyu J, You J, Zhao P, Wang S. Development and validation of prognosis model of mortality risk in patients with COVID-19. Epidemiol Infect. 2020;148:e168.","journal-title":"Epidemiol Infect"},{"issue":"7","key":"1576_CR21","doi-asserted-by":"publisher","first-page":"1100","DOI":"10.1515\/cclm-2020-0459","volume":"58","author":"G Bonetti","year":"2020","unstructured":"Bonetti G, Manelli F, Patroni A, Bettinardi A, Borrelli G, Fiordalisi G, Marino A, Menolfi A, Saggini S, Volpi R, et al. Laboratory predictors of death from coronavirus disease 2019 (COVID-19) in the area of Valcamonica, Italy. Clin Chem Lab Med. 2020;58(7):1100\u20135.","journal-title":"Clin Chem Lab Med"},{"issue":"7","key":"1576_CR22","doi-asserted-by":"publisher","first-page":"e0236618","DOI":"10.1371\/journal.pone.0236618","volume":"15","author":"Z Zhao","year":"2020","unstructured":"Zhao Z, Chen A, Hou W, Graham JM, Li H, Richman PS, Thode HC, Singer AJ, Duong TQ. Prediction model and risk scores of ICU admission and mortality in COVID-19. PLoS ONE. 2020;15(7):e0236618.","journal-title":"PLoS ONE"},{"issue":"16","key":"1576_CR23","doi-asserted-by":"publisher","first-page":"2089","DOI":"10.1093\/cid\/ciaa539","volume":"71","author":"L Hu","year":"2020","unstructured":"Hu L, Chen S, Fu Y, Gao Z, Long H, Ren H, Zuo Y, Li H, Wang J, Xv Q. Risk factors associated with clinical outcomes in 323 coronavirus disease 2019 (COVID-19) Hospitalized Patients in Wuhan, China. Clin Infect Dis. 2020;71(16):2089\u201398.","journal-title":"Clin Infect Dis"},{"issue":"1","key":"1576_CR24","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1016\/j.chest.2020.04.010","volume":"158","author":"R Chen","year":"2020","unstructured":"Chen R, Liang W, Jiang M, Guan W, Zhan C, Wang T, Tang C, Sang L, Liu J, Ni Z. Risk factors of fatal outcome in hospitalized subjects with coronavirus disease 2019 from a nationwide analysis in China. Chest. 2020;158(1):97\u2013105.","journal-title":"Chest"},{"issue":"2","key":"1576_CR25","doi-asserted-by":"publisher","first-page":"2001104","DOI":"10.1183\/13993003.01104-2020","volume":"56","author":"G Wu","year":"2020","unstructured":"Wu G, Yang P, Xie Y, Woodruff HC, Rao X, Guiot J, Frix A-N, Louis R, Moutschen M, Li J. Development of a clinical decision support system for severity risk prediction and triage of COVID-19 patients at hospital admission: an international multicentre study. Eur Respir J. 2020;56(2):2001104.","journal-title":"Eur Respir J"},{"issue":"3","key":"1576_CR26","doi-asserted-by":"publisher","first-page":"106110","DOI":"10.1016\/j.ijantimicag.2020.106110","volume":"56","author":"A Cheng","year":"2020","unstructured":"Cheng A, Hu L, Wang Y, Huang L, Zhao L, Zhang C, Liu X, Xu R, Liu F, Li J. Diagnostic performance of initial blood urea nitrogen combined with D-Dimer levels for predicting in-hospital mortality in COVID-19 patients. Int J Antimicrob Agents. 2020;56(3):106110.","journal-title":"Int J Antimicrob Agents"},{"issue":"4","key":"1576_CR27","doi-asserted-by":"publisher","first-page":"799","DOI":"10.1016\/j.jaci.2020.07.009","volume":"146","author":"R Laguna-Goya","year":"2020","unstructured":"Laguna-Goya R, Utrero-Rico A, Talayero P, Lasa-Lazaro M, Ramirez-Fernandez A, Naranjo L, Segura-Tudela A, Cabrera-Marante O, de Frias ER, Garcia-Garcia R. IL-6-based mortality risk model for hospitalized patients with COVID-19. J Allergy Clin Immunol. 2020;146(4):799\u2013807.","journal-title":"J Allergy Clin Immunol"},{"key":"1576_CR28","doi-asserted-by":"publisher","first-page":"e129","DOI":"10.1017\/S0950268820001442","volume":"148","author":"Q Liu","year":"2020","unstructured":"Liu Q, Song N, Zheng Z, Li J, Li S. Laboratory findings and a combined multifactorial approach to predict death in critically ill patients with COVID-19: a retrospective study. Epidemiol Infect. 2020;148:e129.","journal-title":"Epidemiol Infect"},{"issue":"2","key":"1576_CR29","doi-asserted-by":"publisher","first-page":"786","DOI":"10.1002\/jmv.26300","volume":"93","author":"F Ok","year":"2021","unstructured":"Ok F, Erdogan O, Durmus E, Carkci S, Canik A. Predictive values of blood urea nitrogen\/creatinine ratio and other routine blood parameters on disease severity and survival of COVID-19 patients. J Med Virol. 2021;93(2):786\u201393.","journal-title":"J Med Virol"},{"issue":"8","key":"1576_CR30","doi-asserted-by":"publisher","first-page":"e20259","DOI":"10.2196\/20259","volume":"22","author":"A Abdulaal","year":"2020","unstructured":"Abdulaal A, Patel A, Charani E, Denny S, Mughal N, Moore L. Prognostic modeling of COVID-19 using artificial intelligence in the United Kingdom: model development and validation. J Med Internet Res. 2020;22(8):e20259.","journal-title":"J Med Internet Res"},{"issue":"4","key":"1576_CR31","doi-asserted-by":"publisher","first-page":"1104","DOI":"10.1161\/HYPERTENSIONAHA.120.15528","volume":"76","author":"J-J Qin","year":"2020","unstructured":"Qin J-J, Cheng X, Zhou F, Lei F, Akolkar G, Cai J, Zhang X-J, Blet A, Xie J, Zhang P. Redefining cardiac biomarkers in predicting mortality of inpatients with COVID-19. Hypertension. 2020;76(4):1104\u201312.","journal-title":"Hypertension"},{"issue":"8","key":"1576_CR32","doi-asserted-by":"publisher","first-page":"e0237558","DOI":"10.1371\/journal.pone.0237558","volume":"15","author":"JJ Turcotte","year":"2020","unstructured":"Turcotte JJ, Meisenberg BR, MacDonald JH, Menon N, Fowler MB, West M, Rhule J, Qureshi SS, MacDonald EB. Risk factors for severe illness in hospitalized Covid-19 patients at a regional hospital. PLoS ONE. 2020;15(8):e0237558.","journal-title":"PLoS ONE"},{"key":"1576_CR33","doi-asserted-by":"publisher","first-page":"100426","DOI":"10.1016\/j.eclinm.2020.100426","volume":"24","author":"Y Shang","year":"2020","unstructured":"Shang Y, Liu T, Wei Y, Li J, Shao L, Liu M, Zhang Y, Zhao Z, Xu H, Peng Z. Scoring systems for predicting mortality for severe patients with COVID-19. EClinicalMedicine. 2020;24:100426.","journal-title":"EClinicalMedicine"},{"key":"1576_CR34","doi-asserted-by":"publisher","DOI":"10.1002\/jmv.26244","author":"Z Zeng","year":"2020","unstructured":"Zeng Z, Ma Y, Zeng H, Huang P, Liu W, Jiang M, Xiang X, Deng D, Liao X, Chen P. Simple nomogram based on initial laboratory data for predicting the probability of ICU transfer of COVID-19 patients: multicenter retrospective study. J Med Virol. 2020. https:\/\/doi.org\/10.1002\/jmv.26244.","journal-title":"J Med Virol"},{"issue":"2","key":"1576_CR35","doi-asserted-by":"publisher","first-page":"168","DOI":"10.1016\/j.amepre.2020.05.002","volume":"59","author":"C Yu","year":"2020","unstructured":"Yu C, Lei Q, Li W, Wang X, Liu W, Fan X, Li W. Clinical characteristics, associated factors, and predicting COVID-19 mortality risk: a retrospective study in Wuhan, China. Am J Prev Med. 2020;59(2):168\u201375.","journal-title":"Am J Prev Med"},{"key":"1576_CR36","doi-asserted-by":"publisher","first-page":"104431","DOI":"10.1016\/j.jcv.2020.104431","volume":"128","author":"L Sun","year":"2020","unstructured":"Sun L, Liu G, Song F, Shi N, Liu F, Li S, Li P, Zhang W, Jiang X, Zhang Y. Combination of four clinical indicators predicts the severe\/critical symptom of patients infected COVID-19. J Clin Virol. 2020;128:104431.","journal-title":"J Clin Virol"},{"key":"1576_CR37","doi-asserted-by":"publisher","first-page":"3154","DOI":"10.1093\/cid\/ciaa793","volume":"71","author":"S Wu","year":"2020","unstructured":"Wu S, Du Z, Shen S, Zhang B, Yang H, Li X, Cui W, Chen F, Huang J. Identification and validation of a novel clinical signature to predict the prognosis in confirmed COVID-19 patients. Clin Infect Dis. 2020;71:3154\u201362.","journal-title":"Clin Infect Dis"},{"issue":"5","key":"1576_CR38","first-page":"489","volume":"27","author":"A Lorente-Ros","year":"2020","unstructured":"Lorente-Ros A, Ruiz JMM, Rinc\u00f3n LM, P\u00e9rez RO, Rivas S, Mart\u00ednez-Moya R, Sanrom\u00e1n MA, Manzano L, Alonso GL, Ib\u00e1\u00f1ez B. Myocardial injury determination improves risk stratification and predicts mortality in COVID-19 patients. Cardiol J. 2020;27(5):489\u201396.","journal-title":"Cardiol J"},{"issue":"5","key":"1576_CR39","doi-asserted-by":"publisher","first-page":"652","DOI":"10.1097\/SHK.0000000000001585","volume":"54","author":"D Tatum","year":"2020","unstructured":"Tatum D, Taghavi S, Houghton A, Stover J, Toraih E, Duchesne J. Neutrophil-to-lymphocyte ratio and outcomes in Louisiana COVID-19 patients. Shock. 2020;54(5):652\u20138.","journal-title":"Shock"},{"issue":"6","key":"1576_CR40","doi-asserted-by":"publisher","first-page":"404","DOI":"10.7883\/yoken.JJID.2020.194","volume":"73","author":"X Liu","year":"2020","unstructured":"Liu X, Shi S, Xiao J, Wang H, Chen L, Li J, Han K. Prediction of the severity of Corona Virus Disease 2019 and its adverse clinical outcomes. Jpn J Infect Dis. 2020;73(6):404\u201310.","journal-title":"Jpn J Infect Dis"},{"issue":"2","key":"1576_CR41","doi-asserted-by":"publisher","first-page":"282","DOI":"10.1016\/j.jinf.2020.05.064","volume":"81","author":"JB Galloway","year":"2020","unstructured":"Galloway JB, Norton S, Barker RD, Brookes A, Carey I, Clarke BD, Jina R, Reid C, Russell MD, Sneep R. A clinical risk score to identify patients with COVID-19 at high risk of critical care admission or death: an observational cohort study. J Infect. 2020;81(2):282\u20138.","journal-title":"J Infect"},{"issue":"5","key":"1576_CR42","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1038\/s42256-020-0180-7","volume":"2","author":"L Yan","year":"2020","unstructured":"Yan L, Zhang H-T, Goncalves J, Xiao Y, Wang M, Guo Y, Sun C, Tang X, Jing L, Zhang M. An interpretable mortality prediction model for COVID-19 patients. Nat Mach Intell. 2020;2(5):283\u20138.","journal-title":"Nat Mach Intell"},{"key":"1576_CR43","doi-asserted-by":"publisher","first-page":"109927","DOI":"10.1016\/j.jclinane.2020.109927","volume":"66","author":"M Su","year":"2020","unstructured":"Su M, Yuan J, Peng J, Wu M, Yang Y, Peng YG. Clinical prediction model for mortality of adult diabetes inpatients with COVID-19 in Wuhan, China: a retrospective pilot study. J Clin Anesth. 2020;66:109927.","journal-title":"J Clin Anesth"},{"key":"1576_CR44","doi-asserted-by":"publisher","unstructured":"Xie J, Hungerford D, Chen H, Abrams ST, Li S, Wang G, Wang Y, Kang H, Bonnett L, Zheng R. Development and external validation of a prognostic multivariable model on admission for hospitalized patients with COVID-19. https:\/\/doi.org\/10.1101\/2020.03.28.20045997.","DOI":"10.1101\/2020.03.28.20045997"},{"issue":"1","key":"1576_CR45","doi-asserted-by":"publisher","first-page":"438","DOI":"10.1186\/s13054-020-03123-x","volume":"24","author":"S Zhang","year":"2020","unstructured":"Zhang S, Guo M, Duan L, Wu F, Hu G, Wang Z, Huang Q, Liao T, Xu J, Ma Y. Development and validation of a risk factor-based system to predict short-term survival in adult hospitalized patients with COVID-19: a multicenter, retrospective, cohort study. Crit Care. 2020;24(1):438\u201351.","journal-title":"Crit Care"},{"key":"1576_CR46","first-page":"343","volume":"69","author":"C Hun","year":"2020","unstructured":"Hun C, Liu Z, Jiang Y, Shi O, Zhang X, Xu K, Suo C, Wang Q, Song Y, Yu K, et al. Early prediction of mortality risk among severe COVID-19 patients using machine learning. Int J Epidemiol. 2020;69:343.","journal-title":"Int J Epidemiol"},{"key":"1576_CR47","first-page":"727","volume":"382","author":"F Caramelo","year":"2020","unstructured":"Caramelo F, Ferreira N, Oliveiros B. Estimation of risk factors for COVID-19 mortality-preliminary results. medRxiv. 2020;382:727.","journal-title":"medRxiv"},{"key":"1576_CR48","first-page":"357","volume":"46","author":"E Carr","year":"2020","unstructured":"Carr E, Bendayan R, Bean D, Stammers M, Wang W, Zhang H, Searle T, Kraljevic Z, Shek A, Phan HT. Evaluation and improvement of the National Early Warning Score (NEWS2) for COVID-19: a multi-hospital study. medRxiv. 2020;46:357.","journal-title":"medRxiv"},{"issue":"1","key":"1576_CR49","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13054-020-2833-7","volume":"24","author":"Y Shi","year":"2020","unstructured":"Shi Y, Yu X, Zhao H, Wang H, Zhao R, Sheng J. Host susceptibility to severe COVID-19 and establishment of a host risk score: findings of 487 cases outside Wuhan. Crit Care. 2020;24(1):1\u20134.","journal-title":"Crit Care"},{"key":"1576_CR50","first-page":"113","volume":"2","author":"H Huang","year":"2020","unstructured":"Huang H, Cai S, Li Y, Li Y, Fan Y, Li L, Lei C, Tang X, Hu F, Li F, et al. Prognostic factors for COVID-19 pneumonia progression to severe symptom based on the earlier clinical features: a retrospective analysis. medRxiv. 2020;2:113.","journal-title":"medRxiv"},{"key":"1576_CR51","doi-asserted-by":"publisher","unstructured":"Zhang H, Shi T, Wu X, Zhang X, Wang K, Bean D, Dobson R, Teo JT, Sun J, Zhao P. Risk prediction for poor outcome and death in hospital in-patients with COVID-19: derivation in Wuhan, China and external validation in London, UK. 2020. https:\/\/doi.org\/10.1101\/2020.04.28.20082222.","DOI":"10.1101\/2020.04.28.20082222"},{"key":"1576_CR52","doi-asserted-by":"publisher","unstructured":"Jans M, Kuijper T, den Hollander J, Bisoendial R, Pogany K, van den Dorpel M, Zirkzee E, Kok M, Waverijn G, Ruiter R. Predicting severe COVID-19 at presentation, introducing the COVID severity score. SSRN 2020; https:\/\/doi.org\/10.2139\/ssrn.3627260.","DOI":"10.2139\/ssrn.3627260"},{"key":"1576_CR53","doi-asserted-by":"publisher","unstructured":"P\u00e9rez FM, Del Pino JL, Garc\u00eda NJ, Ruiz EM, M\u00e9ndez CA, Jim\u00e9nez JG, Romero FN, Rodr\u00edguez MN. Comorbidity and prognostic factors on admission in a COVID-19 cohort of a general hospital. Rev Clin Esp. 2020. https:\/\/doi.org\/10.1016\/j.rceng.2020.05.010.","DOI":"10.1016\/j.rceng.2020.05.010"},{"issue":"11","key":"1576_CR54","doi-asserted-by":"publisher","first-page":"e0240781","DOI":"10.1371\/journal.pone.0240781","volume":"15","author":"J Regina","year":"2020","unstructured":"Regina J, Papadimitriou-Olivgeris M, Burger R, Le Pogam M-A, Niemi T, Filippidis P, Tschopp J, Desgranges F, Viala B, Kampouri E. Epidemiology, risk factors and clinical course of SARS-CoV-2 infected patients in a Swiss university hospital: an observational retrospective study. PLoS ONE. 2020;15(11):e0240781.","journal-title":"PLoS ONE"},{"issue":"1","key":"1576_CR55","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12911-020-01316-6","volume":"20","author":"A Abdulaal","year":"2020","unstructured":"Abdulaal A, Patel A, Charani E, Denny S, Alqahtani SA, Davies GW, Mughal N, Moore LS. Comparison of deep learning with regression analysis in creating predictive models for SARS-CoV-2 outcomes. BMC Med Inform Decis Mak. 2020;20(1):1\u201311.","journal-title":"BMC Med Inform Decis Mak"},{"issue":"7821","key":"1576_CR56","doi-asserted-by":"publisher","first-page":"430","DOI":"10.1038\/s41586-020-2521-4","volume":"584","author":"EJ Williamson","year":"2020","unstructured":"Williamson EJ, Walker AJ, Bhaskaran K, Bacon S, Bates C, Morton CE, Curtis HJ, Mehrkar A, Evans D, Inglesby P. Factors associated with COVID-19-related death using OpenSAFELY. Nature. 2020;584(7821):430\u20136.","journal-title":"Nature"},{"issue":"9","key":"1576_CR57","doi-asserted-by":"publisher","first-page":"e2022310","DOI":"10.1001\/jamanetworkopen.2020.22310","volume":"3","author":"GN Ioannou","year":"2020","unstructured":"Ioannou GN, Locke E, Green P, Berry K, O\u2019Hare AM, Shah JA, Crothers K, Eastment MC, Dominitz JA, Fan VS. Risk factors for hospitalization, mechanical ventilation, or death among 10 131 US veterans with SARS-CoV-2 infection. JAMA Netw Open. 2020;3(9):e2022310.","journal-title":"JAMA Netw Open"},{"key":"1576_CR58","first-page":"1708","volume":"SS2","author":"M O\u2019Driscoll","year":"2020","unstructured":"O\u2019Driscoll M, Dos Santos GR, Wang L, Cummings DA, Azman AS, Paireau J, Fontanet A, Cauchemez S, Salje H. Age-specific mortality and immunity patterns of SARS-CoV-2. Nature. 2020;SS2:1708.","journal-title":"Nature"},{"issue":"2","key":"1576_CR59","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1097\/CCM.0000000000004747","volume":"49","author":"JM Dennis","year":"2020","unstructured":"Dennis JM, McGovern AP, Vollmer SJ, Mateen BA. Improving survival of critical care patients with coronavirus disease 2019 in England: a national cohort study, March to June 2020. Crit Care Med. 2020;49(2):209\u201314.","journal-title":"Crit Care Med"},{"key":"1576_CR60","doi-asserted-by":"crossref","unstructured":"Horwitz L, Jones SA, Cerfolio RJ, Francois F, Greco J, Rudy B, Petrilli CM. Trends in Covid-19 risk-adjusted mortality rates in a single health system. J Hosp Med. 2020;16(2):90\u20132.","DOI":"10.12788\/jhm.3552"},{"issue":"6","key":"1576_CR61","doi-asserted-by":"publisher","first-page":"2003498","DOI":"10.1183\/13993003.03498-2020","volume":"56","author":"RK Gupta","year":"2020","unstructured":"Gupta RK, Marks M, Samuels TH, Luintel A, Rampling T, Chowdhury H, Quartagno M, Nair A, Lipman M, Abubakar I. Systematic evaluation and external validation of 22 prognostic models among hospitalised adults with COVID-19: an observational cohort study. Eur Respir J. 2020;56(6):2003498.","journal-title":"Eur Respir J"},{"issue":"9","key":"1576_CR62","first-page":"302","volume":"74","author":"E Lim","year":"2015","unstructured":"Lim E, Miyamura J, Chen JJ. Racial\/ethnic-specific reference intervals for common laboratory tests: a comparison among Asians, Blacks, Hispanics, and White. Hawaii J Med Public Health. 2015;74(9):302\u201310.","journal-title":"Hawaii J Med Public Health"},{"issue":"7","key":"1576_CR63","doi-asserted-by":"publisher","first-page":"2135","DOI":"10.1681\/ASN.2015050542","volume":"27","author":"K Br\u00fcck","year":"2016","unstructured":"Br\u00fcck K, Stel VS, Gambaro G, Hallan S, V\u00f6lzke H, \u00c4rnl\u00f6v J, Kastarinen M, Guessous I, Vinhas J, Stengel B. CKD prevalence varies across the European general population. J Am Soc Nephrol. 2016;27(7):2135\u201347.","journal-title":"J Am Soc Nephrol"},{"issue":"5","key":"1576_CR64","doi-asserted-by":"publisher","first-page":"1812","DOI":"10.1093\/ndt\/gfr547","volume":"27","author":"K McCullough","year":"2012","unstructured":"McCullough K, Sharma P, Ali T, Khan I, Smith WC, MacLeod A, Black C. Measuring the population burden of chronic kidney disease: a systematic literature review of the estimated prevalence of impaired kidney function. Nephrol Dial Transplant. 2012;27(5):1812\u201321.","journal-title":"Nephrol Dial Transplant"},{"key":"1576_CR65","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1016\/j.ijid.2020.05.055","volume":"96","author":"F Zeng","year":"2020","unstructured":"Zeng F, Huang Y, Guo Y, Yin M, Chen X, Xiao L, Deng G. Association of inflammatory markers with the severity of COVID-19: a meta-analysis. Int J Infect Dis. 2020;96:467\u201374.","journal-title":"Int J Infect Dis"},{"issue":"12","key":"1576_CR66","doi-asserted-by":"publisher","first-page":"1642","DOI":"10.1055\/s-0040-1718532","volume":"120","author":"S Schulman","year":"2020","unstructured":"Schulman S, Hu Y, Konstantinides S. Venous Thromboembolism in COVID-19. Thromb Haemost. 2020;120(12):1642\u201353.","journal-title":"Thromb Haemost"},{"issue":"11","key":"1576_CR67","first-page":"772","volume":"45","author":"AE Borsky","year":"2019","unstructured":"Borsky AE, Savitz LA, Bindman AB, Mossburg S, Thompson L. AHRQ series on improving translation of evidence: perceived value of translational products by the AHRQ EPC Learning Health Systems Panel. Jt Comm J Qual Patient Saf. 2019;45(11):772\u20138.","journal-title":"Jt Comm J Qual Patient Saf"}],"container-title":["BMC Medical Informatics and Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-021-01576-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12911-021-01576-w\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12911-021-01576-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,5]],"date-time":"2023-02-05T07:04:20Z","timestamp":1675580660000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedinformdecismak.biomedcentral.com\/articles\/10.1186\/s12911-021-01576-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,24]]},"references-count":67,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["1576"],"URL":"https:\/\/doi.org\/10.1186\/s12911-021-01576-w","relation":{},"ISSN":["1472-6947"],"issn-type":[{"value":"1472-6947","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,24]]},"assertion":[{"value":"27 March 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 June 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 July 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"This study was approved by University of Illinois at Chicago Internal Review Board. Permission from University of Illinois at Chicago Privacy Board and Internal Review Board were required to access the data used in this study. All the experiment protocols involving human data were in accordance with the University of Illinois at Chicago Privacy Board and Internal Review Board guidelines.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate."}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"224"}}