{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T08:07:01Z","timestamp":1780301221208,"version":"3.54.0"},"reference-count":41,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T00:00:00Z","timestamp":1776297600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"funder":[{"DOI":"10.13039\/100017037","name":"Cepheid","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100017037","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Institute of Heart, Lung, and Blood","award":["R38HL143605"],"award-info":[{"award-number":["R38HL143605"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,4,28]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Accurately predicting hospitalization risk in severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) positive outpatients is critical for triage and resource planning. We developed and externally validated a clinical prediction model for 30-day COVID-19 hospitalization using data from symptomatic adults who tested positive in the outpatient setting. The derivation cohort included 22 859 patients from 185 outpatient clinics in a large Utah health care network between December 2021 and March 2023, during Omicron variant predominance. Among these patients, 281 (1.2%) were hospitalized for COVID-19 within 30 days.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We fit random forest and multivariable logistic regression models incorporating clinical variables (vital signs, comorbidities, and vaccination status), social determinants of health, seasonality, and air quality indices. We externally validated our model using data from 10 670 patients in a Pennsylvania healthcare network who tested positive between October 2021 and November 2022, among whom 166 (1.6%) were hospitalized.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>In cross-validation, a random forest model including only clinical predictors performed similarly to an expanded model that also included social, environmental, and seasonal predictors (area under the receiver operator characteristic curve [AUC]: 0.83, 95% CI: 0.77\u20130.88 for both). A parsimonious logistic regression model with only 3 clinical predictors (respiratory rate, age, and pulse oximetry) achieved an AUC of 0.79 (95% CI: .72\u2013.86) on internal validation and an AUC of 0.88 (95% CI: .85\u2013.90) on external validation. Calibration was robust, and decision curve analysis demonstrated clinical utility at low-risk thresholds.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>We conclude that a parsimonious 3-predictor model can effectively stratify hospitalization risk in SARS-CoV-2 positive outpatients, offering a practical tool to support clinical decision-making and optimize resource allocation during current and future COVID-19 surges.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/ofid\/ofag226","type":"journal-article","created":{"date-parts":[[2026,4,12]],"date-time":"2026-04-12T11:37:51Z","timestamp":1775993871000},"source":"Crossref","is-referenced-by-count":0,"title":["Development and External Validation of a Prognostic Prediction Model for Hospitalization in SARS-CoV-2-Infected Ambulatory Patients"],"prefix":"10.1093","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3099-1143","authenticated-orcid":false,"given":"Robert J","family":"Williams","sequence":"first","affiliation":[{"name":"Division of Infectious Diseases, Department of Internal Medicine, University of Utah , Salt Lake City, Utah ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4695-0290","authenticated-orcid":false,"given":"Ben J","family":"Brintz","sequence":"additional","affiliation":[{"name":"Division of Infectious Diseases, Department of Internal Medicine, University of Utah , Salt Lake City, Utah ,","place":["USA"]},{"name":"Division of Epidemiology, Department of Internal Medicine, University of Utah , Salt Lake City, Utah ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nancy","family":"Grisel","sequence":"additional","affiliation":[{"name":"Division of Infectious Diseases and Clinical Epidemiology, Intermountain Medical Center , Murray, Utah ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-8019-5773","authenticated-orcid":false,"given":"Josh V","family":"Otterloo","sequence":"additional","affiliation":[{"name":"Division of Infectious Diseases and Clinical Epidemiology, Intermountain Medical Center , Murray, Utah ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9135-9099","authenticated-orcid":false,"given":"Autumn","family":"Kieber-Emmons","sequence":"additional","affiliation":[{"name":"Lehigh Valley Health Network, University of South Florida Morsani College of Medicine , Allentown, Pennsylvania ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mark","family":"Ebell","sequence":"additional","affiliation":[{"name":"Department of Family Medicine, College of Human Medicine, Michigan State University , East Lansing, Michigan ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8401-0801","authenticated-orcid":false,"given":"Daniel T","family":"Leung","sequence":"additional","affiliation":[{"name":"Division of Infectious Diseases, Department of Internal Medicine, University of Utah , Salt Lake City, Utah ,","place":["USA"]},{"name":"Division of Microbiology and Immunology, Department of Pathology, University of Utah , Salt Lake City, Utah ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7449-5398","authenticated-orcid":false,"given":"Bert K","family":"Lopansri","sequence":"additional","affiliation":[{"name":"Division of Infectious Diseases, Department of Internal Medicine, University of Utah , Salt Lake City, Utah ,","place":["USA"]},{"name":"Division of Infectious Diseases and Clinical Epidemiology, Intermountain Medical Center , Murray, Utah ,","place":["USA"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,4,16]]},"reference":[{"key":"2026060103465160000_ofag226-B1","author":"WHO COVID-19 dashboard"},{"key":"2026060103465160000_ofag226-B2","doi-asserted-by":"crossref","first-page":"835","DOI":"10.1016\/j.cmi.2023.03.017","article-title":"Clinical outcomes of the severe acute respiratory syndrome coronavirus 2 Omicron and Delta variant: systematic review and meta-analysis of 33 studies covering 6 037 144 coronavirus disease 2019-positive patients","volume":"29","author":"Hu","year":"2023","journal-title":"Clin Microbiol Infect"},{"key":"2026060103465160000_ofag226-B3","doi-asserted-by":"crossref","first-page":"92","DOI":"10.7326\/M22-2202","article-title":"Outpatient treatment of confirmed COVID-19: a living, rapid review for the American College of Physicians","volume":"176","author":"Sommer","year":"2023","journal-title":"Ann Intern Med"},{"key":"2026060103465160000_ofag226-B4","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1001\/jamainternmed.2020.2033","article-title":"Development and validation of a clinical risk score to predict the occurrence of critical illness in hospitalized patients with COVID-19","volume":"180","author":"Liang","year":"2020","journal-title":"JAMA Intern Med"},{"key":"2026060103465160000_ofag226-B5","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1038\/s42256-020-0180-7","article-title":"An interpretable mortality prediction model for COVID-19 patients","volume":"2","author":"Yan","year":"2020","journal-title":"Nat Mach Intell"},{"key":"2026060103465160000_ofag226-B6","doi-asserted-by":"crossref","first-page":"1393","DOI":"10.1093\/cid\/ciaa414","article-title":"Prediction for progression risk in patients with COVID-19 pneumonia: the CALL score","volume":"71","author":"Ji","year":"2020","journal-title":"Clin Infect Dis"},{"key":"2026060103465160000_ofag226-B7","doi-asserted-by":"crossref","first-page":"1962","DOI":"10.1093\/cid\/ciaa674","article-title":"Predictors for severe COVID-19 infection","volume":"71","author":"Bhargava","year":"2020","journal-title":"Clin Infect Dis"},{"key":"2026060103465160000_ofag226-B8","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1093\/cid\/ciad618","article-title":"A systematic review of predictor composition, outcomes, risk of bias, and validation of COVID-19 prognostic scores","volume":"78","author":"Appel","year":"2024","journal-title":"Clin Infect Dis"},{"key":"2026060103465160000_ofag226-B9","doi-asserted-by":"crossref","DOI":"10.3389\/fpubh.2023.1183725","article-title":"Artificial intelligence-driven prediction of COVID-19-related hospitalization and death: a systematic review","volume":"11","author":"Shakibfar","year":"2023","journal-title":"Front Public Health"},{"key":"2026060103465160000_ofag226-B10","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2020-044242","article-title":"Development and validation of the OUTCoV score to predict the risk of hospitalisation among patients with SARS-CoV-2 infection in ambulatory settings: a prospective cohort study","volume":"11","author":"Jacquerioz","year":"2021","journal-title":"BMJ Open"},{"key":"2026060103465160000_ofag226-B11","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1007\/s15010-021-01656-z","article-title":"Prediction of COVID-19 deterioration in high-risk patients at diagnosis: an early warning score for advanced COVID-19 developed by machine learning","volume":"50","author":"Jakob","year":"2022","journal-title":"Infection"},{"key":"2026060103465160000_ofag226-B12"},{"key":"2026060103465160000_ofag226-B13","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.72294","article-title":"External validation of a mobile clinical decision support system for diarrhea etiology prediction in children: a multicenter study in Bangladesh and Mali","volume":"11","author":"Garbern","year":"2022","journal-title":"Elife"},{"key":"2026060103465160000_ofag226-B14","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1001\/archpediatrics.2010.250","article-title":"Integrating spatial epidemiology into a decision model for evaluation of facial palsy in children","volume":"165","author":"Fine","year":"2011","journal-title":"Arch Pediatr Adolesc Med"},{"key":"2026060103465160000_ofag226-B15","doi-asserted-by":"crossref","first-page":"973","DOI":"10.1001\/jamapediatrics.2022.2535","article-title":"Improving antibiotic stewardship for diarrheal disease with probability-based electronic clinical decision support: a randomized crossover trial","volume":"176","author":"Nelson","year":"2022","journal-title":"JAMA Pediatr"},{"key":"2026060103465160000_ofag226-B16","doi-asserted-by":"crossref","DOI":"10.1126\/sciadv.adj9786","article-title":"Integration of population-level data sources into an individual-level clinical prediction model for dengue virus test positivity","volume":"10","author":"Williams","year":"2024","journal-title":"Sci Adv"},{"key":"2026060103465160000_ofag226-B17","doi-asserted-by":"crossref","DOI":"10.1016\/j.scitotenv.2023.163272","article-title":"Particulate matter air pollution and COVID-19 infection, severity, and mortality: a systematic review and meta-analysis","volume":"880","author":"Sheppard","year":"2023","journal-title":"Sci Total Environ"},{"key":"2026060103465160000_ofag226-B18","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1186\/s12940-021-00714-1","article-title":"Acute and chronic exposure to air pollution in relation with incidence, prevalence, severity and mortality of COVID-19: a rapid systematic review","volume":"20","author":"Katoto","year":"2021","journal-title":"Environ Health"},{"key":"2026060103465160000_ofag226-B19","doi-asserted-by":"crossref","first-page":"742","DOI":"10.1016\/j.atmosenv.2014.06.012","article-title":"Relationship between particulate air pollution and meteorological variables in Utah's Salt Lake Valley","volume":"94","author":"Whiteman","year":"2014","journal-title":"Atmos Environ"},{"key":"2026060103465160000_ofag226-B20","doi-asserted-by":"crossref","first-page":"2443","DOI":"10.1161\/CIRCULATIONAHA.106.636977","article-title":"Ischemic heart disease events triggered by short-term exposure to fine particulate air pollution","volume":"114","author":"Pope","year":"2006","journal-title":"Circulation"},{"key":"2026060103465160000_ofag226-B21","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.atmosres.2005.05.003","article-title":"Meteorological and environmental aspects of one of the worst national air pollution episodes (January, 2004) in Logan, Cache Valley, Utah, USA","volume":"79","author":"Malek","year":"2006","journal-title":"Atmospheric Res"},{"key":"2026060103465160000_ofag226-B22","doi-asserted-by":"crossref","first-page":"1385","DOI":"10.1289\/ehp.1104349","article-title":"Winter temperature inversions and emergency department visits for asthma in Salt Lake County, Utah, 2003\u20132008","volume":"120","author":"Beard","year":"2012","journal-title":"Environ Health Perspect"},{"key":"2026060103465160000_ofag226-B23","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1136\/jech.53.4.235","article-title":"Studying seasonality by using sine and cosine functions in regression analysis","volume":"53","author":"Stolwijk","year":"1999","journal-title":"J Epidemiol Community Health"},{"key":"2026060103465160000_ofag226-B24","doi-asserted-by":"crossref","first-page":"945","DOI":"10.1111\/j.1468-1331.2010.02955.x","article-title":"Random forest can predict 30-day mortality of spontaneous intracerebral hemorrhage with remarkable discrimination","volume":"17","author":"Peng","year":"2010","journal-title":"Eur J Neurol"},{"key":"2026060103465160000_ofag226-B25","doi-asserted-by":"crossref","first-page":"329","DOI":"10.3389\/fnagi.2017.00329","article-title":"Random forest algorithm for the classification of neuroimaging data in Alzheimer's disease: a systematic review","volume":"9","author":"Sarica","year":"2017","journal-title":"Front Aging Neurosci"},{"key":"2026060103465160000_ofag226-B26","doi-asserted-by":"crossref","DOI":"10.1136\/bmj-2023-078378","article-title":"TRIPOD + AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods","volume":"385","author":"Collins","year":"2024","journal-title":"BMJ"},{"key":"2026060103465160000_ofag226-B27","author":"U.S. Census Bureau","year":"2021"},{"key":"2026060103465160000_ofag226-B28","doi-asserted-by":"crossref","first-page":"324","DOI":"10.3122\/jabfm.2023.230208R1","article-title":"Prospective validation of a simple risk score to predict hospitalization during the omicron phase of COVID-19","volume":"37","author":"Ebell","year":"2024","journal-title":"J Am Board Fam Med"},{"key":"2026060103465160000_ofag226-B29","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0261508","article-title":"Simple scoring tool to estimate risk of hospitalization and mortality in ambulatory and emergency department patients with COVID-19","volume":"17","author":"Webb","year":"2022","journal-title":"PLoS One"},{"key":"2026060103465160000_ofag226-B30","doi-asserted-by":"crossref","first-page":"1838","DOI":"10.1016\/j.cmi.2021.07.006","article-title":"Predicting critical illness on initial diagnosis of COVID-19 based on easily obtained clinical variables: development and validation of the PRIORITY model","volume":"27","author":"Mart\u00ednez-Lacalzada","year":"2021","journal-title":"Clin Microbiol Infect"},{"key":"2026060103465160000_ofag226-B31","doi-asserted-by":"crossref","first-page":"1022","DOI":"10.1093\/cid\/ciaf006","article-title":"Predicting the risk of intensive care unit admission in patients with COVID-19 presenting in the emergency room: development and evaluation of the confusion, respiratory rate, oxygen saturation with or without concurrent supplemental oxygen, and oxygen supplementation score","volume":"80","author":"Xiang","year":"2025","journal-title":"Clin Infect Dis"},{"key":"2026060103465160000_ofag226-B32","doi-asserted-by":"crossref","DOI":"10.2196\/31549","article-title":"The development and validation of simplified machine learning algorithms to predict prognosis of hospitalized patients with COVID-19: multicenter, retrospective study","volume":"24","author":"He","year":"2022","journal-title":"J Med Internet Res"},{"key":"2026060103465160000_ofag226-B33","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0242953","article-title":"Development and external validation of a prognostic tool for COVID-19 critical disease","volume":"15","author":"Chow","year":"2020","journal-title":"PLoS One"},{"key":"2026060103465160000_ofag226-B34","doi-asserted-by":"crossref","first-page":"1062","DOI":"10.1186\/s12913-022-08421-4","article-title":"Reliability of predictive models to support early decision making in the emergency department for patients with confirmed diagnosis of COVID-19: the Pescara COVID Hospital score","volume":"22","author":"Polilli","year":"2022","journal-title":"BMC Health Serv Res"},{"key":"2026060103465160000_ofag226-B35","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0273006","article-title":"Development of lab score system for predicting COVID-19 patient severity: a retrospective analysis","volume":"17","author":"Sarkar","year":"2022","journal-title":"PLoS One"},{"key":"2026060103465160000_ofag226-B36","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0237419","article-title":"Development and validation of a model for individualized prediction of hospitalization risk in 4,536 patients with COVID-19","volume":"15","author":"Jehi","year":"2020","journal-title":"PLoS One"},{"key":"2026060103465160000_ofag226-B37","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2020-043790","article-title":"Clinical value of laboratory indicators for predicting disease progression and death in patients with COVID-19: a retrospective cohort study","volume":"11","author":"Wang","year":"2021","journal-title":"BMJ Open"},{"key":"2026060103465160000_ofag226-B38","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1186\/s12916-022-02651-3","article-title":"Prognostic models for COVID-19 needed updating to warrant transportability over time and space","volume":"20","author":"van Klaveren","year":"2022","journal-title":"BMC Med"},{"key":"2026060103465160000_ofag226-B39","doi-asserted-by":"crossref","DOI":"10.1136\/bmjgh-2023-012328","article-title":"Severity and outcomes of Omicron variant of SARS-CoV-2 compared to Delta variant and severity of Omicron sublineages: a systematic review and metanalysis","volume":"8","author":"Relan","year":"2023","journal-title":"BMJ Glob Health"},{"key":"2026060103465160000_ofag226-B40","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1093\/jamia\/ocac062","article-title":"Development and validation of predictive models for COVID-19 outcomes in a safety-net hospital population","volume":"29","author":"Hao","year":"2022","journal-title":"J Am Med Inform Assoc"},{"key":"2026060103465160000_ofag226-B41","doi-asserted-by":"crossref","first-page":"3246","DOI":"10.1038\/s41598-021-81844-x","article-title":"Developing and validating COVID-19 adverse outcome risk prediction models from a bi-national European cohort of 5594 patients","volume":"11","author":"Jimenez-Solem","year":"2021","journal-title":"Sci Rep"}],"container-title":["Open Forum Infectious Diseases"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/ofid\/advance-article-pdf\/doi\/10.1093\/ofid\/ofag226\/68088230\/ofag226.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/ofid\/article-pdf\/13\/5\/ofag226\/68088230\/ofag226.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/ofid\/article-pdf\/13\/5\/ofag226\/68088230\/ofag226.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T07:47:03Z","timestamp":1780300023000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/ofid\/article\/doi\/10.1093\/ofid\/ofag226\/8654586"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,16]]},"references-count":41,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2026,4,28]]}},"URL":"https:\/\/doi.org\/10.1093\/ofid\/ofag226","relation":{},"ISSN":["2328-8957"],"issn-type":[{"value":"2328-8957","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,5]]},"published":{"date-parts":[[2026,4,16]]},"article-number":"ofag226"}}