{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,10]],"date-time":"2026-04-10T23:28:29Z","timestamp":1775863709470,"version":"3.50.1"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,6,3]],"date-time":"2021-06-03T00:00:00Z","timestamp":1622678400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,6,3]],"date-time":"2021-06-03T00:00:00Z","timestamp":1622678400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1928481"],"award-info":[{"award-number":["1928481"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The strain on healthcare resources brought forth by the recent COVID-19 pandemic has highlighted the need for efficient resource planning and allocation through the prediction of future consumption. Machine learning can predict resource utilization such as the need for hospitalization based on past medical data stored in electronic medical records (EMR). We conducted this study on 3194 patients (46% male with mean age 56.7 (\u00b116.8), 56% African American, 7% Hispanic) flagged as COVID-19 positive cases in 12 centers under Emory Healthcare network from February 2020 to September 2020, to assess whether a COVID-19 positive patient\u2019s need for hospitalization can be predicted at the time of RT-PCR test using the EMR data prior to the test. Five main modalities of EMR, i.e., demographics, medication, past medical procedures, comorbidities, and laboratory results, were used as features for predictive modeling, both individually and fused together using late, middle, and early fusion. Models were evaluated in terms of precision, recall, F1-score (within 95% confidence interval). The early fusion model is the most effective predictor with 84% overall F1-score [CI 82.1\u201386.1]. The predictive performance of the model drops by 6 % when using recent clinical data while omitting the long-term medical history. Feature importance analysis indicates that history of cardiovascular disease, emergency room visits in the past year prior to testing, and demographic factors are predictive of the disease trajectory. We conclude that fusion modeling using medical history and current treatment data can forecast the need for hospitalization for patients infected with COVID-19 at the time of the RT-PCR test.<\/jats:p>","DOI":"10.1038\/s41746-021-00461-0","type":"journal-article","created":{"date-parts":[[2021,6,3]],"date-time":"2021-06-03T10:14:48Z","timestamp":1622715288000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["Patient-specific COVID-19 resource utilization prediction using fusion AI model"],"prefix":"10.1038","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5932-2491","authenticated-orcid":false,"given":"Amara","family":"Tariq","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6712-6626","authenticated-orcid":false,"given":"Leo Anthony","family":"Celi","sequence":"additional","affiliation":[]},{"given":"Janice M.","family":"Newsome","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3625-534X","authenticated-orcid":false,"given":"Saptarshi","family":"Purkayastha","sequence":"additional","affiliation":[]},{"given":"Neal Kumar","family":"Bhatia","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6648-8334","authenticated-orcid":false,"given":"Hari","family":"Trivedi","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1097-316X","authenticated-orcid":false,"given":"Judy Wawira","family":"Gichoya","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3327-8004","authenticated-orcid":false,"given":"Imon","family":"Banerjee","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,6,3]]},"reference":[{"key":"461_CR1","unstructured":"CDC COVID Data Tracker. (2019)."},{"key":"461_CR2","unstructured":"COVID-19 Projections. (2020)."},{"key":"461_CR3","doi-asserted-by":"publisher","first-page":"1054","DOI":"10.1016\/S0140-6736(20)30566-3","volume":"395","author":"F Zhou","year":"2020","unstructured":"Zhou, F. Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study. Lancet 395, 1054\u20131062 (2020).","journal-title":"Lancet"},{"key":"461_CR4","doi-asserted-by":"publisher","first-page":"168","DOI":"10.1016\/j.amepre.2020.05.002","volume":"59","author":"C Yu","year":"2020","unstructured":"Yu, C. et al. Clinical characteristics, associated factors, and predicting COVID-19 mortality risk: a retrospective study in Wuhan, China. Am. J. Preventive Med. 59, 168\u2013175 (2020).","journal-title":"Am. J. Preventive Med"},{"key":"461_CR5","doi-asserted-by":"crossref","unstructured":"Vaid, A. et al. Machine learning to predict mortality and critical events in COVID-19 positive New York city patients: a cohort study. J. Med. Internet Res. 22, e24018 (2020).","DOI":"10.2196\/24018"},{"key":"461_CR6","doi-asserted-by":"crossref","unstructured":"Parchure, P. et al. Development and validation of a machine learning-based prediction model for near-term in-hospital mortality among patients with COVID-19. BMJ Support. Palliat. Care, (BMJ Supportive & Palliative Care, British Medical Journal Publishing Group, 2020).","DOI":"10.1136\/bmjspcare-2020-002602"},{"key":"461_CR7","unstructured":"Williamson, E. et al. OpenSAFELY: factors associated with COVID-19-related hospital death in the linked electronic health records of 17 million adult NHS patients. Preprint at https:\/\/www.medrxiv.org\/content\/10.1101\/2020.05.06.20092999v1 (2020)."},{"key":"461_CR8","doi-asserted-by":"publisher","first-page":"1668","DOI":"10.3390\/jcm9061668","volume":"9","author":"F-Y Cheng","year":"2020","unstructured":"Cheng, F.-Y. et al. Using machine learning to predict ICU transfer in hospitalized COVID-19 patients. J. Clin. Med. 9, 1668 (2020).","journal-title":"J. Clin. Med."},{"key":"461_CR9","unstructured":"Shashikumar, S.P. et al. Development and Prospective Validation of a Deep Learning Algorithm for Predicting Need for Mechanical Ventilation. Chest (2020).."},{"key":"461_CR10","unstructured":"Wynants, L. et al. Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal. BMJ 369 (2020)."},{"key":"461_CR11","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1093\/infdis\/jiaa663","volume":"223","author":"H Sun","year":"2021","unstructured":"Sun, H. et al. CoVA: an acuity score for outpatient screening that predicts COVID-19 prognosis. J. infect. Dis. 223, 38\u201346 (2021).","journal-title":"J. infect. Dis."},{"key":"461_CR12","doi-asserted-by":"publisher","first-page":"E46","DOI":"10.1148\/radiol.2020202723","volume":"298","author":"S Schalekamp","year":"2021","unstructured":"Schalekamp, S. et al. Model-based prediction of critical illness in hospitalized patients with COVID-19. Radiology 298, E46\u2013E54 (2021).","journal-title":"Radiology"},{"key":"461_CR13","unstructured":"Levy, T. J. et al. Development and validation of a survival calculator for hospitalized patients with COVID-19. Preprint at https:\/\/www.medrxiv.org\/content\/10.1101\/2020.04.22.20075416v3 (2020)."},{"key":"461_CR14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41746-019-0211-0","volume":"3","author":"S-C Huang","year":"2020","unstructured":"Huang, S.-C., Pareek, A., Seyyedi, S., Banerjee, I. & Lungren, M. P. Fusion of medical imaging and electronic health records using deep learning: a systematic review and implementation guidelines. NPJ Digital Med. 3, 1\u20139 (2020).","journal-title":"NPJ Digital Med."},{"key":"461_CR15","doi-asserted-by":"crossref","unstructured":"Hastie, T., Tibshirani, R. & Friedman, J. The Elements of Statistical Learning: Data Mining, Inference, and Prediction, (Springer Science & Business Media, 2009).","DOI":"10.1007\/978-0-387-84858-7"},{"key":"461_CR16","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1016\/j.dsx.2020.03.016","volume":"14","author":"AK Singh","year":"2020","unstructured":"Singh, A. K., Gupta, R. & Misra, A. Comorbidities in COVID-19: Outcomes in hypertensive cohort and controversies with renin angiotensin system blockers. Diabetes Metab. Syndr. 14, 283\u2013287 (2020).","journal-title":"Diabetes Metab. Syndr."},{"key":"461_CR17","doi-asserted-by":"publisher","first-page":"829","DOI":"10.1016\/j.kint.2020.03.005","volume":"97","author":"Y Cheng","year":"2020","unstructured":"Cheng, Y. et al. Kidney disease is associated with in-hospital death of patients with COVID-19. Kidney Int. 97, 829\u2013838 (2020).","journal-title":"Kidney Int."},{"key":"461_CR18","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1089\/thy.2020.0363","volume":"31","author":"M Chen","year":"2021","unstructured":"Chen, M., Zhou, W. & Xu, W. Thyroid function analysis in 50 patients with COVID-19: a retrospective study. Thyroid 31, 8\u201311 (2021).","journal-title":"Thyroid"},{"key":"461_CR19","first-page":"0","volume":"77","author":"A Vaid","year":"2020","unstructured":"Vaid, A. et al. Federated Learning of Electronic Health Records Improves Mortality Prediction in Patients. Ethnicity 52 77, 0\u2013001 (2020).","journal-title":"Ethnicity 52"},{"key":"461_CR20","doi-asserted-by":"publisher","first-page":"e58227","DOI":"10.7554\/eLife.58227","volume":"9","author":"T Wagner","year":"2020","unstructured":"Wagner, T. et al. Augmented curation of clinical notes from a massive EHR system reveals symptoms of impending COVID-19 diagnosis. Elife 9, e58227 (2020).","journal-title":"Elife"},{"key":"461_CR21","doi-asserted-by":"crossref","unstructured":"Wang, Z. et al. Analysis of hospitalized COVID-19 patients in the Mount Sinai Health System using electronic medical records (EMR) reveals important prognostic factors for improved clinical outcomes. Preprint at https:\/\/www.medrxiv.org\/content\/10.1101\/2020.04.28.20075788v1 (2020).","DOI":"10.1101\/2020.04.28.20075788"},{"key":"461_CR22","doi-asserted-by":"publisher","first-page":"1321","DOI":"10.1093\/jamia\/ocaa105","volume":"27","author":"JS Obeid","year":"2020","unstructured":"Obeid, J. S. et al. An artificial intelligence approach to COVID-19 infection risk assessment in virtual visits: a case report. J. Am. Med. Inform. Assoc. 27, 1321\u20131325 (2020).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"461_CR23","doi-asserted-by":"publisher","first-page":"890","DOI":"10.1093\/infdis\/jiaa372","volume":"222","author":"R Kullar","year":"2020","unstructured":"Kullar, R. et al. Racial disparity of coronavirus disease 2019 in African American communities. J. Infect. Dis. 222, 890\u2013893 (2020).","journal-title":"J. Infect. Dis."},{"key":"461_CR24","doi-asserted-by":"publisher","first-page":"220","DOI":"10.1001\/jamaoncol.2020.6178","volume":"7","author":"Q Wang","year":"2021","unstructured":"Wang, Q., Berger, N. A. & Xu, R. Analyses of risk, racial disparity, and outcomes among us patients with cancer and COVID-19 infection. JAMA Oncol. 7, 220\u2013227 (2021).","journal-title":"JAMA Oncol."},{"key":"461_CR25","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1161\/CIRCULATIONAHA.114.014508","volume":"131","author":"GS Collins","year":"2015","unstructured":"Collins, G. S., Reitsma, J. B., Altman, D. G. & Moons, K. G. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD) the TRIPOD statement. Circulation 131, 211\u2013219 (2015).","journal-title":"Circulation"},{"key":"461_CR26","doi-asserted-by":"publisher","first-page":"e198719","DOI":"10.1001\/jamanetworkopen.2019.8719","volume":"2","author":"I Banerjee","year":"2019","unstructured":"Banerjee, I. et al. Development and performance of the pulmonary embolism result forecast model (PERFORM) for computed tomography clinical decision support. JAMA Netw. open 2, e198719\u2013e198719 (2019).","journal-title":"JAMA Netw. open"},{"key":"461_CR27","doi-asserted-by":"publisher","first-page":"101844","DOI":"10.1016\/j.media.2020.101844","volume":"67","author":"H Chao","year":"2021","unstructured":"Chao, H. et al. Integrative analysis for COVID-19 patient outcome prediction. Med. Image Anal. 67, 101844 (2021).","journal-title":"Med. Image Anal."},{"key":"461_CR28","doi-asserted-by":"publisher","first-page":"1197","DOI":"10.1038\/s41551-020-00633-5","volume":"4","author":"W Ning","year":"2020","unstructured":"Ning, W. et al. Open resource of clinical data from patients with pneumonia for the prediction of COVID-19 outcomes via deep learning. Nat. Biomed. Eng. 4, 1197\u20131207 (2020).","journal-title":"Nat. Biomed. Eng."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00461-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00461-0","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00461-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,3]],"date-time":"2022-12-03T18:53:24Z","timestamp":1670093604000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00461-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,3]]},"references-count":28,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["461"],"URL":"https:\/\/doi.org\/10.1038\/s41746-021-00461-0","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,3]]},"assertion":[{"value":"1 December 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 May 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 June 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"94"}}