{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T17:51:09Z","timestamp":1777917069021,"version":"3.51.4"},"reference-count":40,"publisher":"SAGE Publications","issue":"3","license":[{"start":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T00:00:00Z","timestamp":1769990400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/100005326","name":"Yale University","doi-asserted-by":"publisher","award":["Yale School of Public Health COVID-19 Rapid Respon"],"award-info":[{"award-number":["Yale School of Public Health COVID-19 Rapid Respon"]}],"id":[{"id":"10.13039\/100005326","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000060","name":"National Institute of Allergy and Infectious Diseases","doi-asserted-by":"publisher","award":["R01AI153351"],"award-info":[{"award-number":["R01AI153351"]}],"id":[{"id":"10.13039\/100000060","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["R21AI173746"],"award-info":[{"award-number":["R21AI173746"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Med Decis Making"],"published-print":{"date-parts":[[2026,4]]},"abstract":"<jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>During the COVID-19 pandemic, many communities across the United States experienced surges in hospitalizations, which strained the local hospital capacity. Some risk metrics, such as the Center for Disease Control and Prevention\u2019s (CDC\u2019s) Community Levels, were developed to predict the impact of COVID-19 on the community-level health care system based on routine surveillance data. However, they had limited utility as they were not routinely updated based on accumulating data and were not directly linked to specific outcomes, such as surges in COVID-19 hospitalizations beyond local capacities.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>In this article, we evaluated decision tree classifiers developed in real time to predict surges in local hospitalizations due to COVID-19 between July 2020 and November 2022. These classifiers would have provided visually intuitive and interpretable decision rules and, by being updated weekly, would have responded to changes in the epidemic. We compared the performance of these classifiers with that of logistic regression and neural network models using various metrics, including the area under the receiver-operating characteristic curve (auROC) and the area under the precision-recall curve (auPRC).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      Decision tree classifiers achieved an auROC of\n                      <jats:inline-formula>\n                        <mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" display=\"inline\" overflow=\"scroll\">\n                          <mml:mrow>\n                            <mml:mo>&gt;<\/mml:mo>\n                            <mml:mn>80<\/mml:mn>\n                            <mml:mo>%<\/mml:mo>\n                          <\/mml:mrow>\n                        <\/mml:math>\n                      <\/jats:inline-formula>\n                      for most pandemic weeks and outperformed the CDC\u2019s Community Levels in predicting high hospital occupancy. The auPRC, sensitivity, and specificity of the classifiers varied more substantially over time (between\n                      <jats:inline-formula>\n                        <mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\" display=\"inline\" overflow=\"scroll\">\n                          <mml:mrow>\n                            <mml:mn>20<\/mml:mn>\n                            <mml:mo>%<\/mml:mo>\n                            <mml:mspace width=\"0.25em\"\/>\n                            <mml:mi mathvariant=\"normal\">and<\/mml:mi>\n                            <mml:mspace width=\"0.25em\"\/>\n                            <mml:mn>100<\/mml:mn>\n                            <mml:mo>%<\/mml:mo>\n                          <\/mml:mrow>\n                        <\/mml:math>\n                      <\/jats:inline-formula>\n                      ) and in sync with pandemic waves. Decision tree classifiers demonstrated similar performance compared with logistic regression and neural network models while presenting more interpretable classification rules.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Using routinely collected hospital surveillance data, decision tree classifiers can be adaptively updated to predict surges in local hospitalizations. However, the sensitivity and specificity of these classifiers could change markedly during different pandemic waves.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Highlights<\/jats:title>\n                    <jats:list list-type=\"bullet\">\n                      <jats:list-item>\n                        <jats:p>A major concern during the COVID-19 pandemic was the risk of exceeding local health care capacity due to COVID-19-related hospitalizations.<\/jats:p>\n                      <\/jats:list-item>\n                      <jats:list-item>\n                        <jats:p>To assess this risk and inform mitigating strategies, several risk assessment tools were developed during the pandemic. Many of these tools, however, did not predict local outcomes, were not updated as the pandemic progressed, and\/or were not interpretable by decision makers.<\/jats:p>\n                      <\/jats:list-item>\n                      <jats:list-item>\n                        <jats:p>We propose an adaptive framework of decision tree classifiers to predict whether COVID-19\u2013related hospital occupancy would exceed a given capacity threshold. These classifiers demonstrated reasonable and stable prediction performance over time. However, their sensitivity and specificity may change substantially over the course of pandemic waves.<\/jats:p>\n                      <\/jats:list-item>\n                    <\/jats:list>\n                  <\/jats:sec>","DOI":"10.1177\/0272989x251408845","type":"journal-article","created":{"date-parts":[[2026,2,2]],"date-time":"2026-02-02T12:06:09Z","timestamp":1770033969000},"page":"371-385","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["Forecasting Local Surges in COVID-19 Hospitalizations through Adaptive Decision Tree Classifiers"],"prefix":"10.1177","volume":"46","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9079-5975","authenticated-orcid":false,"given":"Rachel E","family":"Murray-Watson","sequence":"first","affiliation":[{"name":"School of Public Health, Imperial College London"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-6041-7834","authenticated-orcid":false,"given":"Xavier","family":"Guaracha","sequence":"additional","affiliation":[{"name":"Philip R. Lee Institute for Health Policy Studies, University of California San Francisco, San Francisco, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9108-6660","authenticated-orcid":false,"given":"Alyssa","family":"Bilinski","sequence":"additional","affiliation":[{"name":"Department of Health Services, Policy and Practice, Brown University School of Public Health, Providence, RI, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9276-5750","authenticated-orcid":false,"given":"Reza","family":"Yaesoubi","sequence":"additional","affiliation":[{"name":"Philip R. Lee Institute for Health Policy Studies, University of California San Francisco, San Francisco, CA, USA"},{"name":"Department of Epidemiology and Biostatistics, University of California San Francisco, San Francisco, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2026,2,2]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.7326\/M21-1213"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2021.2828"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.abd7343"},{"issue":"10","key":"e_1_3_2_5_2","article-title":"An evaluation of prospective COVID-19 modelling studies in the usa: from data to science translation","volume":"4","author":"Nixon K","year":"2022","unstructured":"Nixon K, Jindal S, Parker F, et al. An evaluation of prospective COVID-19 modelling studies in the usa: from data to science translation. Lancet Digit Health. 2022;4(10):e738\u201347.","journal-title":"Lancet Digit Health"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-022-01517-w"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-86811-0"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-020-1132-9"},{"key":"e_1_3_2_9_2","volume-title":"CDC COVID-19 Science Briefs","author":"Centers for Disease Control and Prevention","year":"2022","unstructured":"Centers for Disease Control and Prevention. Science brief: indicators for monitoring COVID-19 community levels and making public health recommendations. In: CDC COVID-19 Science Briefs. Rockville (MD): Centers for Disease Control and Prevention; 2022. https:\/\/archive.cdc.gov\/www_cdc_gov\/coronavirus\/2019-ncov\/science\/science-briefs\/indicators-monitoring-community-levels.html"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.15585\/mmwr.mm7219e2"},{"key":"e_1_3_2_11_2","unstructured":"Centers for Disease Control and Prevention. COVID-19 county check. 2024. Available from: https:\/\/www.cdc.gov\/TemplatePackage\/contrib\/widgets\/covidcountycheck\/ [Accessed 4 March 2024]."},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.7326\/M22-0803"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2302528120"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-84858-7"},{"key":"e_1_3_2_15_2","volume-title":"The Hundred-Page Machine Learning Book","author":"Burkov A.","year":"2019","unstructured":"Burkov A. The Hundred-Page Machine Learning Book. Vol. 1. Quebec City (QC): Andriy Burkov; 2019."},{"key":"e_1_3_2_16_2","unstructured":"Coronavirus (Covid-19) data in the United States. The New York Times. 2021. Available from https:\/\/github.com\/nytimes\/covid-19-data."},{"key":"e_1_3_2_17_2","unstructured":"US Department of Health and Human Services. COVID-19 reported patient impact and hospital capacity statistics. 2023. Available from: https:\/\/healthdata.gov\/Hospital\/COVID-19-Reported-Patient-Impact-and-Hospital-Capa\/anag-cw7u\/about_data. [Accessed 7 August 2023]."},{"key":"e_1_3_2_18_2","first-page":"1","article-title":"Health service areas for the United States","volume":"112","author":"Makuc DM","year":"1991","unstructured":"Makuc DM, Haglund B, Ingram DD, Kleinman JC, Feldman JJ. Health service areas for the United States. Vital Health Stat 2. 1991;112:1\u2013102.","journal-title":"Vital Health Stat 2"},{"key":"e_1_3_2_19_2","unstructured":"Centers for Disease Control and Prevention. Indicators for monitoring COVID-19 community levels and COVID-19 and implementing COVID-19 prevention strategies. PowerPoint Presentation; 2022."},{"key":"e_1_3_2_20_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2004064117"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10729-023-09629-4"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1093\/oxfordjournals.pan.a004868"},{"key":"e_1_3_2_23_2","unstructured":"Scikit-learn Developers. Scikit-learn: machine learning in Python. 2021. Available from: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.utils.class_weight.compute_class_weight.html. [Accessed 18 March 2024]."},{"key":"e_1_3_2_24_2","article-title":"Scikit-learn: machine learning in python","volume":"12","author":"Pedregosa F","year":"2011","unstructured":"Pedregosa F, Varoquaux G, Gramfort A, et al. Scikit-learn: machine learning in python. J Machine Learn Res. 2011;12:2825\u201330.","journal-title":"J Machine Learn Res"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.7326\/M14-0698"},{"key":"e_1_3_2_26_2","article-title":"Net benefit approaches to the evaluation of prediction models, molecular markers, and diagnostic tests","volume":"352","author":"Vickers AJ","year":"2016","unstructured":"Vickers AJ, Van Calster B, Steyerberg EW. Net benefit approaches to the evaluation of prediction models, molecular markers, and diagnostic tests. BMJ. 2016;352:i6.","journal-title":"BMJ"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1038\/s42256-019-0138-9"},{"key":"e_1_3_2_28_2","volume-title":"Advances in Neural Information Processing Systems 30","author":"Lundberg SM","year":"2017","unstructured":"Lundberg SM, Lee S-I. A unified approach to interpreting model predictions. In: Guyon I, Luxburg UV, Bengio S, et al. eds. Advances in Neural Information Processing Systems 30. Red Hook (NY): Curran Associates, Inc.; 2017. p 4765\u201374."},{"key":"e_1_3_2_29_2","unstructured":"Centers for Disease Control and Prevention. COVID data tracker. Available from: https:\/\/covid.cdc.gov\/covid-data-tracker [Accessed 2 November 2023]."},{"key":"e_1_3_2_30_2","unstructured":"Johns Hopkins University. Johns Hopkins University and Medicine Coronavirus Resource Center. Available from: https:\/\/coronavirus.jhu.edu\/ [Accessed 2 November 2023]."},{"key":"e_1_3_2_31_2","unstructured":"USA Facts. US COVID-19 cases and deaths by state. Available from: https:\/\/usafacts.org\/visualizations\/coronavirus-covid-19-spread-map\/ [Accessed 2 November 2023]."},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2021359118"},{"key":"e_1_3_2_33_2","first-page":"100191","article-title":"County-level vaccination coverage and rates of covid-19 cases and deaths in the United States: an ecological analysis","volume":"9","author":"McLaughlin JM","year":"2022","unstructured":"McLaughlin JM, Khan F, Pugh S, Swerdlow DL, Jodar L. County-level vaccination coverage and rates of covid-19 cases and deaths in the United States: an ecological analysis. Lancet Reg Health Am. 2022;9:100191.","journal-title":"Lancet Reg Health Am"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1038\/414751a"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-01189-3"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.scitotenv.2020.142396"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1111\/jrh.12450"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1002\/jmv.27173"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijid.2021.12.115"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.amepre.2023.08.013"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1016\/S2352-4642(22)00372-8"}],"container-title":["Medical Decision Making"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0272989X251408845","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/0272989X251408845","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0272989X251408845","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T18:03:53Z","timestamp":1777658633000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0272989X251408845"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,2]]},"references-count":40,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,4]]}},"alternative-id":["10.1177\/0272989X251408845"],"URL":"https:\/\/doi.org\/10.1177\/0272989x251408845","relation":{},"ISSN":["0272-989X","1552-681X"],"issn-type":[{"value":"0272-989X","type":"print"},{"value":"1552-681X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,2]]}}}