{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T21:35:24Z","timestamp":1772228124606,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1008651","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2022,2,10]],"date-time":"2022-02-10T00:00:00Z","timestamp":1644451200000}}],"reference-count":40,"publisher":"Public Library of Science (PLoS)","issue":"1","license":[{"start":{"date-parts":[[2022,1,31]],"date-time":"2022-01-31T00:00:00Z","timestamp":1643587200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/publicdomain\/zero\/1.0\/"}],"funder":[{"DOI":"10.13039\/100008902","name":"Los Alamos National Laboratory","doi-asserted-by":"publisher","award":["20190546ECR"],"award-info":[{"award-number":["20190546ECR"]}],"id":[{"id":"10.13039\/100008902","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Infectious disease forecasting is an emerging field and has the potential to improve public health through anticipatory resource allocation, situational awareness, and mitigation planning. By way of exploring and operationalizing disease forecasting, the U.S. Centers for Disease Control and Prevention (CDC) has hosted FluSight since the 2013\/14 flu season, an annual flu forecasting challenge. Since FluSight\u2019s onset, forecasters have developed and improved forecasting models in an effort to provide more timely, reliable, and accurate information about the likely progression of the outbreak. While improving the predictive performance of these forecasting models is often the primary objective, it is also important for a forecasting model to run quickly, facilitating further model development and improvement while providing flexibility when deployed in a real-time setting. In this vein I introduce Inferno, a fast and accurate flu forecasting model inspired by Dante, the top performing model in the 2018\/19 FluSight challenge. When pseudoprospectively compared to all models that participated in FluSight 2018\/19, Inferno would have placed 2nd in the national and regional challenge as well as the state challenge, behind only Dante. Inferno, however, runs in minutes and is trivially parallelizable, while Dante takes hours to run, representing a significant operational improvement with minimal impact to performance. Forecasting challenges like FluSight should continue to monitor and evaluate how they can be modified and expanded to incentivize the development of forecasting models that benefit public health.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1008651","type":"journal-article","created":{"date-parts":[[2022,1,31]],"date-time":"2022-01-31T13:38:12Z","timestamp":1643636292000},"page":"e1008651","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":12,"title":["Fast and accurate influenza forecasting in the United States with Inferno"],"prefix":"10.1371","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4681-091X","authenticated-orcid":true,"given":"Dave","family":"Osthus","sequence":"first","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2022,1,31]]},"reference":[{"issue":"5","key":"pcbi.1008651.ref001","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1016\/S1473-3099(20)30120-1","article-title":"An interactive web-based dashboard to track COVID-19 in real time","volume":"20","author":"E Dong","year":"2020","journal-title":"The Lancet Infectious Diseases"},{"key":"pcbi.1008651.ref002","unstructured":"The United States Centers for Disease Control and Prevention. Disease Burden of Influenza; 2020. Available from: https:\/\/www.cdc.gov\/flu\/about\/burden\/index.html."},{"issue":"1","key":"pcbi.1008651.ref003","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1186\/s12879-018-3124-7","article-title":"Summary Results of the 2014-2015 DARPA Chikungunya Challenge","volume":"18","author":"SY Del Valle","year":"2018","journal-title":"BMC Infectious Diseases"},{"issue":"48","key":"pcbi.1008651.ref004","doi-asserted-by":"crossref","first-page":"24268","DOI":"10.1073\/pnas.1909865116","article-title":"An Open Challenge to Advance Probabilistic Forecasting for Dengue Epidemics","volume":"116","author":"MA Johansson","year":"2019","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1008651.ref005","unstructured":"The Epidemic Prediction Initiative. West Nile Virus Forecasting 2020; 2020. Available from: https:\/\/predict.cdc.gov\/post\/5e18a08677851c0489cf10b8."},{"key":"pcbi.1008651.ref006","unstructured":"The Epidemic Prediction Initiative. Aedes Forecasting 2019; 2019. Available from: https:\/\/predict.cdc.gov\/post\/5c4f6d687620e103b6dcd015."},{"key":"pcbi.1008651.ref007","unstructured":"Wattanachit N, Wang S, Reich N, Ray E, Niemi J, Le K, et al. COVID-19 Forecast Hub; 2020. Available from: https:\/\/github.com\/reichlab\/covid19-forecast-hub."},{"issue":"1","key":"pcbi.1008651.ref008","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1186\/s12879-016-1669-x","article-title":"Results from the Centers for Disease Control and Prevention\u2019s Predict the 2013\u20132014 Influenza Season Challenge","volume":"16","author":"M Biggerstaff","year":"2016","journal-title":"BMC Infectious Diseases"},{"key":"pcbi.1008651.ref009","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1016\/j.epidem.2018.02.003","article-title":"Results from the second year of a collaborative effort to forecast influenza seasons in the United States","volume":"24","author":"M Biggerstaff","year":"2018","journal-title":"Epidemics"},{"issue":"1","key":"pcbi.1008651.ref010","doi-asserted-by":"crossref","first-page":"683","DOI":"10.1038\/s41598-018-36361-9","article-title":"Collaborative efforts to forecast seasonal influenza in the United States, 2015\u20132016","volume":"9","author":"CJ McGowan","year":"2019","journal-title":"Scientific Reports"},{"issue":"1","key":"pcbi.1008651.ref011","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1214\/16-AOAS1000","article-title":"Forecasting Seasonal Influenza with a State-space SIR Model","volume":"11","author":"D Osthus","year":"2017","journal-title":"The Annals of Applied Statistics"},{"issue":"11","key":"pcbi.1008651.ref012","doi-asserted-by":"crossref","first-page":"2752","DOI":"10.1073\/pnas.1708856115","article-title":"Forecasting the Spatial Transmission of Influenza in the United States","volume":"115","author":"S Pei","year":"2018","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"5","key":"pcbi.1008651.ref013","doi-asserted-by":"crossref","first-page":"e1007013","DOI":"10.1371\/journal.pcbi.1007013","article-title":"Forecasting National and Regional Influenza-like Illness for the USA","volume":"15","author":"M Ben-Nun","year":"2019","journal-title":"PLoS Computational Biology"},{"issue":"1","key":"pcbi.1008651.ref014","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41467-021-23234-5","article-title":"Multiscale influenza forecasting","volume":"12","author":"D Osthus","year":"2021","journal-title":"Nature Communications"},{"issue":"2","key":"pcbi.1008651.ref015","doi-asserted-by":"crossref","first-page":"e1005910","DOI":"10.1371\/journal.pcbi.1005910","article-title":"Prediction of Infectious Disease Epidemics via Weighted Density Ensembles","volume":"14","author":"EL Ray","year":"2018","journal-title":"PLoS Computational Biology"},{"issue":"6","key":"pcbi.1008651.ref016","doi-asserted-by":"crossref","first-page":"e1006134","DOI":"10.1371\/journal.pcbi.1006134","article-title":"Nonmechanistic Forecasts of Seasonal Influenza with Iterative One-week-ahead Distributions","volume":"14","author":"LC Brooks","year":"2018","journal-title":"PLoS Computational Biology"},{"key":"pcbi.1008651.ref017","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.epidem.2019.01.002","article-title":"Near-term Forecasts of Influenza-like Illness: An Evaluation of Autoregressive Time Series Approaches","volume":"27","author":"S Kandula","year":"2019","journal-title":"Epidemics"},{"issue":"47","key":"pcbi.1008651.ref018","doi-asserted-by":"crossref","first-page":"14473","DOI":"10.1073\/pnas.1515373112","article-title":"Accurate Estimation of Influenza Epidemics using Google Search Data via ARGO","volume":"112","author":"S Yang","year":"2015","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"1","key":"pcbi.1008651.ref019","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1214\/18-BA1117","article-title":"Dynamic Bayesian Influenza Forecasting in the United States with Hierarchical Discrepancy (with Discussion)","volume":"14","author":"D Osthus","year":"2019","journal-title":"Bayesian Analysis"},{"issue":"2","key":"pcbi.1008651.ref020","doi-asserted-by":"crossref","first-page":"e1006599","DOI":"10.1371\/journal.pcbi.1006599","article-title":"Even a Good Influenza Forecasting Model can Benefit from Internet-based Nowcasts, but those Benefits are Limited","volume":"15","author":"D Osthus","year":"2019","journal-title":"PLoS Computational Biology"},{"issue":"8","key":"pcbi.1008651.ref021","doi-asserted-by":"crossref","first-page":"e1004382","DOI":"10.1371\/journal.pcbi.1004382","article-title":"Flexible Modeling of Epidemics with an Empirical Bayes Framework","volume":"11","author":"LC Brooks","year":"2015","journal-title":"PLoS Computational Biology"},{"issue":"8","key":"pcbi.1008651.ref022","doi-asserted-by":"crossref","first-page":"3146","DOI":"10.1073\/pnas.1812594116","article-title":"A Collaborative Multiyear, Multimodel Assessment of Seasonal Influenza Forecasting in the United States","volume":"116","author":"NG Reich","year":"2019","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1008651.ref023","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.epidem.2017.02.010","article-title":"Using Data-driven Agent-based Models for Forecasting Emerging Infectious Diseases","volume":"22","author":"S Venkatramanan","year":"2018","journal-title":"Epidemics"},{"issue":"42","key":"pcbi.1008651.ref024","doi-asserted-by":"crossref","first-page":"20809","DOI":"10.1073\/pnas.1912147116","article-title":"On the multibin logarithmic score used in the FluSight competitions","volume":"116","author":"J Bracher","year":"2019","journal-title":"Proceedings of the National Academy of Sciences"},{"issue":"42","key":"pcbi.1008651.ref025","doi-asserted-by":"crossref","DOI":"10.1073\/pnas.1912694116","article-title":"Reply to Bracher: Scoring Probabilistic Forecasts to Maximize Public Health Interpretability","volume":"116","author":"NG Reich","year":"2019","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"pcbi.1008651.ref026","unstructured":"The Epidemic Prediction Initiative. FluSight 2018\u20132019 Guidance Documents; 2018. Available from: https:\/\/predict.cdc.gov\/post\/5ba1504e5619f003acb7e18f."},{"key":"pcbi.1008651.ref027","unstructured":"Strauss A. Florida or Ohio? Forecasting presidential state outcomes using reverse random walks. In: Princeton University Political Methodology Seminar. Citeseer; 2007. p. 1\u201326."},{"issue":"501","key":"pcbi.1008651.ref028","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1080\/01621459.2012.737735","article-title":"Dynamic Bayesian forecasting of presidential elections in the states","volume":"108","author":"DA Linzer","year":"2013","journal-title":"Journal of the American Statistical Association"},{"key":"pcbi.1008651.ref029","doi-asserted-by":"crossref","unstructured":"Wahba G. Spline models for observational data. SIAM; 1990.","DOI":"10.1137\/1.9781611970128"},{"key":"pcbi.1008651.ref030","unstructured":"van Wieringen WN. Lecture notes on ridge regression. arXiv preprint arXiv:150909169. 2015."},{"issue":"Series D","key":"pcbi.1008651.ref031","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1115\/1.3662552","article-title":"A New Approach to Linear Filtering and Prediction Problems","volume":"82","author":"RE Kalman","year":"1960","journal-title":"Transactions of the ASME\u2013Journal of Basic Engineering"},{"key":"pcbi.1008651.ref032","unstructured":"Plummer M. JAGS: A Program for Analysis of Bayesian Graphical Models Using Gibbs Sampling. In: Proceedings of the 3rd international workshop on distributed statistical computing. vol. 124. Vienna, Austria.; 2003. p. 10."},{"key":"pcbi.1008651.ref033","unstructured":"Plummer M. rjags: Bayesian Graphical Models using MCMC; 2018. Available from: https:\/\/CRAN.R-project.org\/package=rjags."},{"key":"pcbi.1008651.ref034","unstructured":"R Core Team. R: A Language and Environment for Statistical Computing; 2018. Available from: https:\/\/www.R-project.org\/."},{"issue":"477","key":"pcbi.1008651.ref035","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1198\/016214506000001437","article-title":"Strictly proper scoring rules, prediction, and estimation","volume":"102","author":"T Gneiting","year":"2007","journal-title":"Journal of the American statistical Association"},{"key":"pcbi.1008651.ref036","unstructured":"Farrow DC, Brooks LC, Rumack A, Tibshirani RJ, Rosenfeld R. Delphi Epidata API; 2015. Available from: https:\/\/github.com\/cmu-delphi\/delphi-epidata."},{"key":"pcbi.1008651.ref037","article-title":"Improving Probabilistic Infectious Disease Forecasting Through Coherence","author":"G Gibson","year":"2019","journal-title":"bioRxiv"},{"key":"pcbi.1008651.ref038","unstructured":"Jahja M, Farrow D, Rosenfeld R, Tibshirani RJ. Kalman Filter, Sensor Fusion, and Constrained Regression: Equivalences and Insights. In: Wallach H, Larochelle H, Beygelzimer A, d\u2019Alch\u00e9-Buc F, Fox E, Garnett R, editors. Advances in Neural Information Processing Systems. vol. 32. Curran Associates, Inc.; 2019. p. 1\u201310. Available from: https:\/\/proceedings.neurips.cc\/paper\/2019\/file\/b522259710151f8cc7870b970b4e0930-Paper.pdf."},{"key":"pcbi.1008651.ref039","unstructured":"Farrow D. Modeling the past, present, and future of influenza. Carnegie Mellon University; 2016."},{"key":"pcbi.1008651.ref040","unstructured":"United States Center for Disease Control and Prevention. CDC Stands Up New Disease Forecasting Center; 2021. Available from: https:\/\/www.cdc.gov\/media\/releases\/2021\/p0818-disease-forecasting-center.html."}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1008651","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2022,2,10]],"date-time":"2022-02-10T00:00:00Z","timestamp":1644451200000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1008651","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,2,10]],"date-time":"2022-02-10T13:58:37Z","timestamp":1644501517000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1008651"}},"subtitle":[],"editor":[{"given":"Sebastian","family":"Funk","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2022,1,31]]},"references-count":40,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1,31]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1008651","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2021.01.06.425546","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,31]]}}}