{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,15]],"date-time":"2026-05-15T00:29:41Z","timestamp":1778804981792,"version":"3.51.4"},"reference-count":29,"publisher":"Oxford University Press (OUP)","issue":"6","license":[{"start":{"date-parts":[[2021,1,22]],"date-time":"2021-01-22T00:00:00Z","timestamp":1611273600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"name":"Israeli Ministry of Health. MG received support from the U.S.-Israel Binational Science Foundation","award":["2016126"],"award-info":[{"award-number":["2016126"]}]},{"DOI":"10.13039\/501100003977","name":"Israel Science Foundation","doi-asserted-by":"publisher","award":["1950\/19"],"award-info":[{"award-number":["1950\/19"]}],"id":[{"id":"10.13039\/501100003977","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2021,6,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>The spread of coronavirus disease 2019 (COVID-19) has led to severe strain on hospital capacity in many countries. We aim to develop a model helping planners assess expected COVID-19 hospital resource utilization based on individual patient characteristics.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Materials and Methods<\/jats:title>\n                    <jats:p>We develop a model of patient clinical course based on an advanced multistate survival model. The model predicts the patient's disease course in terms of clinical states\u2014critical, severe, or moderate. The model also predicts hospital utilization on the level of entire hospitals or healthcare systems. We cross-validated the model using a nationwide registry following the day-by-day clinical status of all hospitalized COVID-19 patients in Israel from March 1 to May 2, 2020 (n\u2009=\u20092703).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Per-day mean absolute errors for predicted total and critical care hospital bed utilization were 4.72\u2009\u00b1\u20091.07 and 1.68\u2009\u00b1\u20090.40, respectively, over cohorts of 330 hospitalized patients; areas under the curve for prediction of critical illness and in-hospital mortality were 0.88\u2009\u00b1\u20090.04 and 0.96\u2009\u00b1\u20090.04, respectively. We further present the impact of patient influx scenarios on day-by-day healthcare system utilization. We provide an accompanying R software package.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>The proposed model accurately predicts total and critical care hospital utilization. The model enables evaluating impacts of patient influx scenarios on utilization, accounting for the state of currently hospitalized patients and characteristics of incoming patients. We show that accurate hospital load predictions were possible using only a patient\u2019s age, sex, and day-by-day clinical state (critical, severe, or moderate).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>The multistate model we develop is a powerful tool for predicting individual-level patient outcomes and hospital-level utilization.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/jamia\/ocab005","type":"journal-article","created":{"date-parts":[[2021,1,13]],"date-time":"2021-01-13T16:53:41Z","timestamp":1610556821000},"page":"1188-1196","source":"Crossref","is-referenced-by-count":34,"title":["Development and validation of a machine learning model predicting illness trajectory and hospital utilization of COVID-19 patients: A nationwide study"],"prefix":"10.1093","volume":"28","author":[{"given":"Michael","family":"Roimi","sequence":"first","affiliation":[{"name":"Department of Critical Care Medicine, Rambam Health Care Campus, Haifa, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rom","family":"Gutman","sequence":"additional","affiliation":[{"name":"Faculty of Industrial Engineering and Management, Technion \u2013 Israel Institute of Technology, Haifa, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jonathan","family":"Somer","sequence":"additional","affiliation":[{"name":"Faculty of Industrial Engineering and Management, Technion \u2013 Israel Institute of Technology, Haifa, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Asaf","family":"Ben Arie","sequence":"additional","affiliation":[{"name":"Department of Statistics and Operations Research, Tel Aviv University, Tel Aviv, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ido","family":"Calman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yaron","family":"Bar-Lavie","sequence":"additional","affiliation":[{"name":"Department of Critical Care Medicine, Rambam Health Care Campus, Haifa, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Udi","family":"Gelbshtein","sequence":"additional","affiliation":[{"name":"Division of General Medicine, Medical Directorate, Israel Ministry of Health, Jerusalem, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sigal","family":"Liverant-Taub","sequence":"additional","affiliation":[{"name":"Division of General Medicine, Medical Directorate, Israel Ministry of Health, Jerusalem, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Arnona","family":"Ziv","sequence":"additional","affiliation":[{"name":"Gertner Institute for Epidemiology and Health Policy Research, Chaim Sheba Medical Center, Tel HaShomer, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Danny","family":"Eytan","sequence":"additional","affiliation":[{"name":"Pediatric Intensive Care, Rambam Health Care Campus, Haifa, Israel"},{"name":"Faculty of Medicine, Technion \u2013 Israel Institute of Technology, Haifa, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Malka","family":"Gorfine","sequence":"additional","affiliation":[{"name":"Department of Statistics and Operations Research, Tel Aviv University, Tel Aviv, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Uri","family":"Shalit","sequence":"additional","affiliation":[{"name":"Faculty of Industrial Engineering and Management, Technion \u2013 Israel Institute of Technology, Haifa, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2021,2,26]]},"reference":[{"key":"2021061318592626700_ocab005-B1","volume-title":"Coronavirus Disease 2019 (COVID-19): Situation Report, 51","year":"2020"},{"issue":"16","key":"2021061318592626700_ocab005-B2","doi-asserted-by":"crossref","first-page":"1545","DOI":"10.1001\/jama.2020.4031","article-title":"Critical care utilization for the COVID-19 outbreak in Lombardy, Italy","volume":"323","author":"Grasselli","year":"2020","journal-title":"JAMA"},{"issue":"19","key":"2021061318592626700_ocab005-B3","doi-asserted-by":"crossref","first-page":"e52","DOI":"10.1056\/NEJMc2010853","article-title":"Transforming ORs into ICUs","volume":"382","author":"Peters","year":"2020","journal-title":"N Engl J Med"},{"issue":"5","key":"2021061318592626700_ocab005-B4","doi-asserted-by":"crossref","first-page":"e208297","DOI":"10.1001\/jamanetworkopen.2020.8297","article-title":"Estimated demand for US hospital inpatient and intensive care unit beds for patients with COVID-19 based on comparisons with Wuhan and Guangzhou, China","volume":"3","author":"Li","year":"2020","journal-title":"JAMA Netw Open"},{"issue":"1","key":"2021061318592626700_ocab005-B5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12916-020-01726-3","article-title":"COVID-19 length of hospital stay: a systematic review and data synthesis","volume":"18","author":"Rees","year":"2020","journal-title":"BMC Med"},{"key":"2021061318592626700_ocab005-B6","year":"2018"},{"issue":"4","key":"2021061318592626700_ocab005-B7","doi-asserted-by":"crossref","first-page":"1100","DOI":"10.1214\/aos\/1176345976","article-title":"Cox\u2019s regression model for counting processes: a large sample study","volume":"10","author":"Andersen","year":"1982","journal-title":"Ann Statist"},{"key":"2021061318592626700_ocab005-B8","first-page":"153","article-title":"Non-and semi-parametric estimation of transition probabilities from censored observation of a non-homogeneous Markov process","author":"Andersen","year":"1991","journal-title":"Scand J Stat"},{"key":"2021061318592626700_ocab005-B9","volume-title":"Survival Analysis: Techniques for Censored and Truncated Data","author":"Klein","year":"2006"},{"key":"2021061318592626700_ocab005-B10","volume-title":"The Statistical Analysis of Failure Time Data","author":"Kalbfleisch","year":"2011"},{"key":"2021061318592626700_ocab005-B11","year":"2020"},{"key":"2021061318592626700_ocab005-B12","year":"2020"},{"issue":"8","key":"2021061318592626700_ocab005-B13","doi-asserted-by":"crossref","first-page":"E192","DOI":"10.1016\/S1473-3099(20)30483-7","article-title":"A minimal common outcome measure set for COVID-19 clinical research","volume":"20","author":"Marshall","year":"2020","journal-title":"Lancet Infect Dis"},{"key":"2021061318592626700_ocab005-B14","article-title":"Impact of COVID-19 on Madrid hospital system","author":"Condes","year":"2020","journal-title":"Enferm Infecc Microbiol Clin"},{"issue":"1","key":"2021061318592626700_ocab005-B15","doi-asserted-by":"crossref","first-page":"21","DOI":"10.7326\/M20-1260","article-title":"Locally informed simulation to predict hospital capacity needs during the COVID-19 pandemic","volume":"173","author":"Weissman","year":"2020","journal-title":"Ann Intern Med"},{"issue":"16","key":"2021061318592626700_ocab005-B16","doi-asserted-by":"crossref","first-page":"9122","DOI":"10.1073\/pnas.2004064117","article-title":"Projecting hospital utilization during the COVID-19 outbreaks in the United States","volume":"117","author":"Moghadas","year":"2020","journal-title":"Proc Natl Acad Sci U S A"},{"key":"2021061318592626700_ocab005-B17","article-title":"The competing risk between in-hospital mortality and recovery: a pitfall in COVID-19 survival analysis research","author":"Oulhaj","journal-title":"medRxiv"},{"issue":"1","key":"2021061318592626700_ocab005-B18","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1186\/s12874-020-01082-z","article-title":"Joint analysis of duration of ventilation, length of intensive care, and mortality of COVID-19 patients: a multistate approach","volume":"20","author":"Hazard","year":"2020","journal-title":"BMC Med Res Methodol"},{"key":"2021061318592626700_ocab005-B19","doi-asserted-by":"crossref","first-page":"1121","DOI":"10.1016\/S2213-2600(20)30328-3","article-title":"Extracorporeal membrane oxygenation for severe acute respiratory distress syndrome associated with COVID-19: a retrospective cohort study","author":"Schmidt","year":"2020","journal-title":"Lancet Respir Med"},{"key":"2021061318592626700_ocab005-B20","first-page":"1","article-title":"A hidden absorbing semi-Markov model for informatively censored temporal data: Learning and inference","volume":"19","author":"Alaa","year":"2018","journal-title":"J Mach Learn Res"},{"key":"2021061318592626700_ocab005-B21","author":"Groha"},{"key":"2021061318592626700_ocab005-B22","author":"Ishwaran","year":"2019"},{"issue":"8242","key":"2021061318592626700_ocab005-B23","doi-asserted-by":"crossref","first-page":"m1328","DOI":"10.1136\/bmj.m1328","article-title":"Prediction models for diagnosis and prognosis of COVID-19 infection: systematic review and critical appraisal","volume":"369","author":"Wynants","year":"2020","journal-title":"BMJ"},{"issue":"8","key":"2021061318592626700_ocab005-B24","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1001\/jamainternmed.2020.2033","article-title":"Development and validation of a clinical risk score to predict the occurrence of critical illness in hospitalized patients with COVID-19","volume":"180","author":"Liang","year":"2020","journal-title":"JAMA Intern Med"},{"issue":"8","key":"2021061318592626700_ocab005-B25","doi-asserted-by":"crossref","DOI":"10.1210\/clinem\/dgaa346","article-title":"Predicting mortality due to SARS-CoV-2: a mechanistic score relating obesity and diabetes to COVID-19 outcomes in Mexico","volume":"105","author":"Bello-Chavolla","year":"2020","journal-title":"J Clin Endocrinol Metab"},{"issue":"11","key":"2021061318592626700_ocab005-B26","doi-asserted-by":"crossref","first-page":"2224","DOI":"10.1093\/gerona\/glaa183","article-title":"Preexisting Comorbidities Predicting COVID-19 and Mortality in the UK Biobank Community Cohort","volume":"75","author":"Atkins","year":"2020","journal-title":"J Gerontol A Biol Sci Med Sci"},{"key":"2021061318592626700_ocab005-B27","first-page":"369","article-title":"Factors associated with hospital admission and critical illness among 5279 people with coronavirus disease 2019 in New York City: prospective cohort study","author":"Petrilli","year":"2020","journal-title":"BMJ"},{"issue":"4","key":"2021061318592626700_ocab005-B28","doi-asserted-by":"crossref","first-page":"e21","DOI":"10.1016\/S2213-2600(20)30116-8","article-title":"Are patients with hypertension and diabetes mellitus at increased risk for COVID-19 infection?","volume":"8","author":"Fang","year":"2020","journal-title":"Lancet Respir Med"},{"issue":"12","key":"2021061318592626700_ocab005-B29","doi-asserted-by":"crossref","first-page":"1448","DOI":"10.1093\/jamia\/ocz127","article-title":"A nonparametric updating method to correct clinical prediction model drift","volume":"26","author":"Davis","year":"2019","journal-title":"J Am Med Inform Assoc"}],"container-title":["Journal of the American Medical Informatics Association"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/jamia\/advance-article-pdf\/doi\/10.1093\/jamia\/ocab005\/35930408\/ocab005.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/6\/1188\/38615402\/ocab005.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/jamia\/article-pdf\/28\/6\/1188\/38615402\/ocab005.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,6,13]],"date-time":"2021-06-13T15:00:25Z","timestamp":1623596425000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jamia\/article\/28\/6\/1188\/6105188"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,26]]},"references-count":29,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,2,26]]},"published-print":{"date-parts":[[2021,6,12]]}},"URL":"https:\/\/doi.org\/10.1093\/jamia\/ocab005","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2020.09.04.20185645","asserted-by":"object"}]},"ISSN":["1527-974X"],"issn-type":[{"value":"1527-974X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2021,6,1]]},"published":{"date-parts":[[2021,2,26]]}}}