{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T05:15:01Z","timestamp":1774934101574,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1007623","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,1,26]],"date-time":"2021-01-26T00:00:00Z","timestamp":1611619200000}}],"reference-count":27,"publisher":"Public Library of Science (PLoS)","issue":"1","license":[{"start":{"date-parts":[[2021,1,6]],"date-time":"2021-01-06T00:00:00Z","timestamp":1609891200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/publicdomain\/zero\/1.0\/"}],"funder":[{"DOI":"10.13039\/100008902","name":"Los Alamos National Laboratory","doi-asserted-by":"publisher","award":["20190546ECR"],"award-info":[{"award-number":["20190546ECR"]}],"id":[{"id":"10.13039\/100008902","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000057","name":"National Institutes of General Medical Sciences","doi-asserted-by":"crossref","award":["R35GM119582"],"award-info":[{"award-number":["R35GM119582"]}],"id":[{"id":"10.13039\/100000057","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100000030","name":"US Centers for Disease Control and Prevention","doi-asserted-by":"crossref","award":["1U01IP001122"],"award-info":[{"award-number":["1U01IP001122"]}],"id":[{"id":"10.13039\/100000030","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>With an estimated $10.4 billion in medical costs and 31.4 million outpatient visits each year, influenza poses a serious burden of disease in the United States. To provide insights and advance warning into the spread of influenza, the U.S. Centers for Disease Control and Prevention (CDC) runs a challenge for forecasting weighted influenza-like illness (wILI) at the national and regional level. Many models produce independent forecasts for each geographical unit, ignoring the constraint that the national wILI is a weighted sum of regional wILI, where the weights correspond to the population size of the region. We propose a novel algorithm that transforms a set of independent forecast distributions to obey this constraint, which we refer to as probabilistically coherent. Enforcing probabilistic coherence led to an increase in forecast skill for 79% of the models we tested over multiple flu seasons, highlighting the importance of respecting the forecasting system\u2019s geographical hierarchy.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1007623","type":"journal-article","created":{"date-parts":[[2021,1,6]],"date-time":"2021-01-06T16:41:12Z","timestamp":1609951272000},"page":"e1007623","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":6,"title":["Improving probabilistic infectious disease forecasting through coherence"],"prefix":"10.1371","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0370-9846","authenticated-orcid":true,"given":"Graham Casey","family":"Gibson","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3551-2885","authenticated-orcid":true,"given":"Kelly R.","family":"Moran","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3503-9899","authenticated-orcid":true,"given":"Nicholas G.","family":"Reich","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4681-091X","authenticated-orcid":true,"given":"Dave","family":"Osthus","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2021,1,6]]},"reference":[{"issue":"3","key":"pcbi.1007623.ref001","doi-asserted-by":"crossref","first-page":"e1001977","DOI":"10.1371\/journal.pmed.1001977","article-title":"Global role and burden of influenza in pediatric respiratory hospitalizations, 1982\u20132012: a systematic analysis","volume":"13","author":"KE Lafond","year":"2016","journal-title":"PLoS medicine"},{"issue":"3","key":"pcbi.1007623.ref002","doi-asserted-by":"crossref","first-page":"e0118369","DOI":"10.1371\/journal.pone.0118369","article-title":"Estimating influenza disease burden from population-based surveillance data in the United States","volume":"10","author":"C Reed","year":"2015","journal-title":"PLOS one"},{"issue":"1","key":"pcbi.1007623.ref003","doi-asserted-by":"crossref","first-page":"683","DOI":"10.1038\/s41598-018-36361-9","article-title":"Collaborative efforts to forecast seasonal influenza in the United States, 2015\u20132016","volume":"9","author":"CJ McGowan","year":"2019","journal-title":"Scientific reports"},{"key":"pcbi.1007623.ref004","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1016\/j.epidem.2018.02.003","article-title":"Results from the second year of a collaborative effort to forecast influenza seasons in the United States","volume":"24","author":"CJ McGowan","year":"2018","journal-title":"Epidemics"},{"issue":"33","key":"pcbi.1007623.ref005","first-page":"1057","article-title":"Estimates of deaths associated with seasonal influenza-United States, 1976-2007","volume":"59","author":"M Thompson","year":"2010","journal-title":"Morbidity and Mortality Weekly Report"},{"issue":"2","key":"pcbi.1007623.ref006","first-page":"4151","article-title":"Near-term forecasts of influenza-like illness: An evaluation of autoregressive time series approaches","volume":"27","author":"S Kandula","year":"2019","journal-title":"Epidemics"},{"issue":"1","key":"pcbi.1007623.ref007","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1214\/16-AOAS1000","article-title":"Forecasting seasonal influenza with a state-space SIR model","volume":"11","author":"D Osthus","year":"2017","journal-title":"The annals of applied statistics"},{"issue":"1","key":"pcbi.1007623.ref008","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1214\/18-BA1117","article-title":"Dynamic Bayesian Influenza Forecasting in the United States with Hierarchical Discrepancy (with Discussion)","volume":"14","author":"D Osthus","year":"2019","journal-title":"Bayesian Analysis"},{"issue":"6","key":"pcbi.1007623.ref009","doi-asserted-by":"crossref","first-page":"e1006134","DOI":"10.1371\/journal.pcbi.1006134","article-title":"Nonmechanistic forecasts of seasonal influenza with iterative one-week-ahead distributions","volume":"14","author":"LC Brooks","year":"2018","journal-title":"PLoS computational biology"},{"issue":"144","key":"pcbi.1007623.ref010","doi-asserted-by":"crossref","first-page":"20180174","DOI":"10.1098\/rsif.2018.0174","article-title":"Evaluation of mechanistic and statistical methods in forecasting influenza-like illness","volume":"15","author":"S Kandula","year":"2018","journal-title":"Journal of The Royal Society Interface"},{"key":"pcbi.1007623.ref011","doi-asserted-by":"crossref","unstructured":"Adhikari B, Xu X, Ramakrishnan N, Prakash BA. EpiDeep: Exploiting Embeddings for Epidemic Forecasting. In: Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. ACM; 2019. p. 577\u2013586.","DOI":"10.1145\/3292500.3330917"},{"issue":"11","key":"pcbi.1007623.ref012","doi-asserted-by":"crossref","first-page":"e1007486","DOI":"10.1371\/journal.pcbi.1007486","article-title":"Accuracy of real-time multi-model ensemble forecasts for seasonal influenza in the US","volume":"15","author":"NG Reich","year":"2019","journal-title":"PLoS computational biology"},{"issue":"2","key":"pcbi.1007623.ref013","doi-asserted-by":"crossref","first-page":"e56176","DOI":"10.1371\/journal.pone.0056176","article-title":"Influenza forecasting with Google flu trends","volume":"8","author":"AF Dugas","year":"2013","journal-title":"PLOS one"},{"issue":"9","key":"pcbi.1007623.ref014","doi-asserted-by":"crossref","first-page":"1016","DOI":"10.1016\/j.ajem.2014.05.052","article-title":"Using Google Flu Trends data in forecasting influenza-like\u2013illness related ED visits in Omaha, Nebraska","volume":"32","author":"OM Araz","year":"2014","journal-title":"The American Journal of Emergency Medicine"},{"issue":"12","key":"pcbi.1007623.ref015","doi-asserted-by":"crossref","first-page":"e0188941","DOI":"10.1371\/journal.pone.0188941","article-title":"Forecasting influenza-like illness dynamics for military populations using neural networks and social media","volume":"12","author":"S Volkova","year":"2017","journal-title":"PLOS one"},{"issue":"2","key":"pcbi.1007623.ref016","doi-asserted-by":"crossref","first-page":"e1006599","DOI":"10.1371\/journal.pcbi.1006599","article-title":"Even a good influenza forecasting model can benefit from internet-based nowcasts, but those benefits are limited","volume":"15","author":"D Osthus","year":"2019","journal-title":"PLoS computational biology"},{"key":"pcbi.1007623.ref017","unstructured":"CDC. Forecasts; 2019. https:\/\/github.com\/cdcepi\/FluSight-forecasts."},{"key":"pcbi.1007623.ref018","unstructured":"Taieb SB, Taylor JW, Hyndman RJ. Coherent probabilistic forecasts for hierarchical time series. In: Proceedings of the 34th International Conference on Machine Learning-Volume 70. JMLR. org; 2017. p. 3348\u20133357."},{"key":"pcbi.1007623.ref019","unstructured":"Wickramasuriya SL, Athanasopoulos G, Hyndman RJ. Forecasting hierarchical and grouped time series through trace minimization. Department of Econometrics and Business Statistics, Monash University. 2015;."},{"key":"pcbi.1007623.ref020","unstructured":"of Health NMD. Indicator-Based Information System for Public Health Web; 2018. https:\/\/ibis.health.state.nm.us\/resource\/MMWRWeekCalendar.html."},{"key":"pcbi.1007623.ref021","unstructured":"Census Bureau US. United States Census Bureau. 2010;."},{"key":"pcbi.1007623.ref022","unstructured":"Gamakumara P, Panagiotelis A, Athanasopoulos G, Hyndman RJ. Probabilistic Forecasts in Hierarchical Time Series. 2018;."},{"issue":"42","key":"pcbi.1007623.ref023","doi-asserted-by":"crossref","first-page":"20809","DOI":"10.1073\/pnas.1912147116","article-title":"On the multibin logarithmic score used in the FluSight competitions","volume":"116","author":"J Bracher","year":"2019","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"42","key":"pcbi.1007623.ref024","doi-asserted-by":"crossref","first-page":"20811","DOI":"10.1073\/pnas.1912694116","article-title":"Reply to Bracher: Scoring probabilistic forecasts to maximize public health interpretability","volume":"116","author":"NG Reich","year":"2019","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"issue":"1","key":"pcbi.1007623.ref025","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1175\/1525-7541(2004)005<0243:TSSAMF>2.0.CO;2","article-title":"The Schaake Shuffle: A Method for Reconstructing Space?Time Variability in Forecasted Precipitation and Temperature Fields","volume":"5","author":"M Clark","year":"2004","journal-title":"Journal of Hydrometeorology"},{"key":"pcbi.1007623.ref026","unstructured":"Dahlgren S; Internal Communication. 2019."},{"key":"pcbi.1007623.ref027","doi-asserted-by":"crossref","unstructured":"Bracher, Johannes and Ray, Evan L and Gneiting, Tilmann and Reich, Nicholas G. Evaluating epidemic forecasts in an interval format. arXiv preprint arXiv:2005.12881. 2020","DOI":"10.1371\/journal.pcbi.1008618"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1007623","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2021,1,26]],"date-time":"2021-01-26T00:00:00Z","timestamp":1611619200000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1007623","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,4,18]],"date-time":"2021-04-18T18:57:47Z","timestamp":1618772267000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1007623"}},"subtitle":[],"editor":[{"given":"Benjamin Muir","family":"Althouse","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2021,1,6]]},"references-count":27,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,1,6]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1007623","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2019.12.27.889212","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,6]]}}}