{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T20:09:12Z","timestamp":1772136552119,"version":"3.50.1"},"reference-count":118,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,10,8]],"date-time":"2021-10-08T00:00:00Z","timestamp":1633651200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,10,8]],"date-time":"2021-10-08T00:00:00Z","timestamp":1633651200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The COVID-19 pandemic has highlighted the global need for reliable models of disease spread. We propose an AI-augmented forecast modeling framework that provides daily predictions of the expected number of confirmed COVID-19 deaths, cases, and hospitalizations during the following 4 weeks. We present an international, prospective evaluation of our models\u2019 performance across all states and counties in the USA and prefectures in Japan. Nationally, incident mean absolute percentage error (MAPE) for predicting COVID-19 associated deaths during prospective deployment remained consistently &lt;8% (US) and &lt;29% (Japan), while cumulative MAPE remained &lt;2% (US) and &lt;10% (Japan). We show that our models perform well even during periods of considerable change in population behavior, and are robust to demographic differences across different geographic locations. We further demonstrate that our framework provides meaningful explanatory insights with the models accurately adapting to local and national policy interventions. Our framework enables counterfactual simulations, which indicate continuing Non-Pharmaceutical Interventions alongside vaccinations is essential for faster recovery from the pandemic, delaying the application of interventions has a detrimental effect, and allow exploration of the consequences of different vaccination strategies. The COVID-19 pandemic remains a global emergency. In the face of substantial challenges ahead, the approach presented here has the potential to inform critical decisions.<\/jats:p>","DOI":"10.1038\/s41746-021-00511-7","type":"journal-article","created":{"date-parts":[[2021,10,9]],"date-time":"2021-10-09T03:03:53Z","timestamp":1633748633000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":31,"title":["A prospective evaluation of AI-augmented epidemiology to forecast COVID-19 in the USA and Japan"],"prefix":"10.1038","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6333-1729","authenticated-orcid":false,"given":"Sercan \u00d6.","family":"Ar\u0131k","sequence":"first","affiliation":[]},{"given":"Joel","family":"Shor","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9157-674X","authenticated-orcid":false,"given":"Rajarishi","family":"Sinha","sequence":"additional","affiliation":[]},{"given":"Jinsung","family":"Yoon","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9917-7196","authenticated-orcid":false,"given":"Joseph R.","family":"Ledsam","sequence":"additional","affiliation":[]},{"given":"Long T.","family":"Le","sequence":"additional","affiliation":[]},{"given":"Michael W.","family":"Dusenberry","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4153-4722","authenticated-orcid":false,"given":"Nathanael C.","family":"Yoder","sequence":"additional","affiliation":[]},{"given":"Kris","family":"Popendorf","sequence":"additional","affiliation":[]},{"given":"Arkady","family":"Epshteyn","sequence":"additional","affiliation":[]},{"given":"Johan","family":"Euphrosine","sequence":"additional","affiliation":[]},{"given":"Elli","family":"Kanal","sequence":"additional","affiliation":[]},{"given":"Isaac","family":"Jones","sequence":"additional","affiliation":[]},{"given":"Chun-Liang","family":"Li","sequence":"additional","affiliation":[]},{"given":"Beth","family":"Luan","sequence":"additional","affiliation":[]},{"given":"Joe","family":"Mckenna","sequence":"additional","affiliation":[]},{"given":"Vikas","family":"Menon","sequence":"additional","affiliation":[]},{"given":"Shashank","family":"Singh","sequence":"additional","affiliation":[]},{"given":"Mimi","family":"Sun","sequence":"additional","affiliation":[]},{"given":"Ashwin Sura","family":"Ravi","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2454-0082","authenticated-orcid":false,"given":"Leyou","family":"Zhang","sequence":"additional","affiliation":[]},{"given":"Dario","family":"Sava","sequence":"additional","affiliation":[]},{"given":"Kane","family":"Cunningham","sequence":"additional","affiliation":[]},{"given":"Hiroki","family":"Kayama","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9183-016X","authenticated-orcid":false,"given":"Thomas","family":"Tsai","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3525-5092","authenticated-orcid":false,"given":"Daisuke","family":"Yoneoka","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2963-7297","authenticated-orcid":false,"given":"Shuhei","family":"Nomura","sequence":"additional","affiliation":[]},{"given":"Hiroaki","family":"Miyata","sequence":"additional","affiliation":[]},{"given":"Tomas","family":"Pfister","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,10,8]]},"reference":[{"key":"511_CR1","doi-asserted-by":"publisher","first-page":"20425","DOI":"10.1073\/pnas.1208772109","volume":"109","author":"J Shaman","year":"2012","unstructured":"Shaman, J. & Karspeck, A. Forecasting seasonal outbreaks of influenza. Proc. Natl Acad. Sci. USA 109, 20425\u201320430 (2012).","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"511_CR2","unstructured":"Wendlandt, M., Colabella, J. M., Krishnamurthy, A. & Cobb, L. Mathematical modelling of the west African ebola virus epidemic. URSCA Proc. 3, (2017)."},{"key":"511_CR3","unstructured":"Ray, E. L. et al. Ensemble forecasts of coronavirus disease 2019 (COVID-19) in the U.S. Preprint at https:\/\/www.medrxiv.org\/content\/10.1101\/2020.08.19.20177493v1 (2020)."},{"key":"511_CR4","doi-asserted-by":"crossref","unstructured":"Reiner, R. C. et al. Modeling COVID-19 scenarios for the united states. Nat. Med. 27, 94\u2013105 (2020).","DOI":"10.1038\/s41591-020-1132-9"},{"key":"511_CR5","doi-asserted-by":"publisher","first-page":"1015","DOI":"10.1016\/S0140-6736(20)30673-5","volume":"395","author":"J Bedford","year":"2020","unstructured":"Bedford, J. et al. COVID-19: towards controlling of a pandemic. Lancet 395, 1015\u20131018 (2020).","journal-title":"Lancet"},{"key":"511_CR6","doi-asserted-by":"publisher","first-page":"100343","DOI":"10.1016\/j.eclinm.2020.100343","volume":"22","author":"AJ Sinclair","year":"2020","unstructured":"Sinclair, A. J. & Abdelhafiz, A. H. Age, frailty and diabetes\u2014triple jeopardy for vulnerability to COVID-19 infection. EClinicalMedicine 22, 100343\u2013100343 (2020).","journal-title":"EClinicalMedicine"},{"key":"511_CR7","doi-asserted-by":"publisher","first-page":"e480","DOI":"10.1016\/S2214-109X(20)30068-1","volume":"8","author":"Y Ji","year":"2020","unstructured":"Ji, Y., Ma, Z., Peppelenbosch, M. P. & Pan, Q. Potential association between COVID-19 mortality and health-care resource availability. Lancet Global Health 8, e480 (2020).","journal-title":"Lancet Global Health"},{"key":"511_CR8","doi-asserted-by":"publisher","first-page":"15530","DOI":"10.1073\/pnas.2007658117","volume":"117","author":"G Bonaccorsi","year":"2020","unstructured":"Bonaccorsi, G. et al. Economic and social consequences of human mobility restrictions under COVID-19. Proc. Natl Acad. Sci. USA 117, 15530\u201315535 (2020).","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"511_CR9","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1057\/s11369-020-00184-2","volume":"55","author":"C Borio","year":"2020","unstructured":"Borio, C. The COVID-19 economic crisis: dangerously unique. Business Econ. 55, 181\u2013190 (2020).","journal-title":"Business Econ."},{"key":"511_CR10","doi-asserted-by":"publisher","first-page":"949","DOI":"10.2105\/AJPH.2020.305708","volume":"110","author":"N Pearce","year":"2020","unstructured":"Pearce, N., Vandenbroucke, J. P., VanderWeele, T. J. & Greenland, S. Accurate statistics on COVID-19 are essential for policy guidance and decisions. Am. J. Public Health 110, 949\u2013951 (2020).","journal-title":"Am. J. Public Health"},{"key":"511_CR11","doi-asserted-by":"crossref","unstructured":"Fenton, N., Hitman, G. A., Neil, M., Osman, M. & McLachlan, S. Causal explanations, error rates, and human judgment biases missing from the COVID-19 narrative and statistics. Preprint at https:\/\/psyarxiv.com\/p39a4\/ (2020).","DOI":"10.31234\/osf.io\/p39a4"},{"key":"511_CR12","doi-asserted-by":"publisher","first-page":"1303","DOI":"10.1038\/s41562-020-01009-0","volume":"4","author":"N Haug","year":"2020","unstructured":"Haug, N. et al. Ranking the effectiveness of worldwide COVID-19 government interventions. Nat. Hum. Behav. 4, 1303\u20131312 (2020).","journal-title":"Nat. Hum. Behav."},{"key":"511_CR13","doi-asserted-by":"crossref","unstructured":"Amuedo-Dorantes, C., Kaushal, N. & Muchow, A. N. Is the cure worse than the disease? County-level evidence from the COVID-19 pandemic in the united states. NBER Working Papers 27759, (National Bureau of Economic Research, Inc., 2020).","DOI":"10.3386\/w27759"},{"key":"511_CR14","doi-asserted-by":"publisher","unstructured":"Ahmad, M. A., Eckert, C. & Teredesai, A. Interpretable machine learning in healthcare. in Proceedings of the 2018 ACM International Conference on Bioinformatics, Computational Biology, and Health Informatics. 559\u2013560 (Association for Computing Machinery, 2018). https:\/\/doi.org\/10.1145\/3233547.3233667.","DOI":"10.1145\/3233547.3233667"},{"key":"511_CR15","doi-asserted-by":"publisher","unstructured":"Long, C., Fu, X. M. & Fu, Z. F. Global analysis of daily new COVID-19 cases reveals many static-phase countries including the United States potentially with unstoppable epidemic. World J Clin Cases 8, 4431\u20134442. https:\/\/doi.org\/10.12998\/wjcc.v8.i19.4431 (2020).","DOI":"10.12998\/wjcc.v8.i19.4431"},{"key":"511_CR16","unstructured":"Long, Y.-S. et al. Quantitative assessment of the role of undocumented infection in the 2019 novel coronavirus (COVID-19) pandemic. Preprint at https:\/\/arxiv.org\/abs\/2003.12028 (2020)."},{"key":"511_CR17","doi-asserted-by":"crossref","unstructured":"Chang, S. et al. Mobility network models of COVID-19 explain inequities and inform reopening. Nature 589, 82\u201387 (2020).","DOI":"10.1038\/s41586-020-2923-3"},{"key":"511_CR18","doi-asserted-by":"crossref","unstructured":"Rodr\u00edguez, A. et al. DeepCOVID: An Operational Deep Learning-driven Framework for Explainable Real-time COVID-19 Forecasting. Proceedings of the AAAI Conference on Artificial Intelligence, 35, 15393\u201315400 (2021).","DOI":"10.1609\/aaai.v35i17.17808"},{"key":"511_CR19","doi-asserted-by":"crossref","unstructured":"Subramanian, R., He, Q. & Pascual, M. Quantifying asymptomatic infection and transmission of covid-19 in new york city using observed cases, serology, and testing capacity. Proc. Natl Acad. Sci. 118, e2019716118 (2021).","DOI":"10.1073\/pnas.2019716118"},{"key":"511_CR20","unstructured":"Johnson & johnson announces single-shot Janssen COVID-19 vaccine candidate met primary endpoints in interim analysis of its phase 3 ensemble trial. https:\/\/www.jnj.com\/johnson-johnson-announces-single-shot-janssen-COVID-19-vaccine-candidate-met-primary-endpoints-in-interim-analysis-of-its-phase-3-ensemble-trial (2021)."},{"key":"511_CR21","unstructured":"Japanese association of infectious diseases: recommendations for COVID-19 vaccine. https:\/\/www.kansensho.or.jp\/modules\/guidelines\/index.php?content_id=43 (2021)."},{"key":"511_CR22","unstructured":"Arik, S. O. et al. Interpretable sequence learning for COVID-19 forecasting. Proceedings of the 34th Conference on Neural Information Processing Systems, (NeurIPS, 2020)."},{"key":"511_CR23","doi-asserted-by":"publisher","first-page":"195","DOI":"10.30707\/LiB5.1Blackwood","volume":"5","author":"JC Blackwood","year":"2018","unstructured":"Blackwood, J. C. & Childs, L. M. An introduction to compartmental modeling for the budding infectious disease modeler. Lett. Biomathematics 5, 195\u2013221 (2018).","journal-title":"Lett. Biomathematics"},{"key":"511_CR24","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pone.0246772","volume":"16","author":"J Noh","year":"2021","unstructured":"Noh, J. & Danuser, G. Estimation of the fraction of covid-19 infected people in u.s. states and countries worldwide. PLoS ONE 16, 1\u201310 (2021).","journal-title":"PLoS ONE"},{"key":"511_CR25","doi-asserted-by":"publisher","first-page":"1335","DOI":"10.1016\/S0140-6736(20)32009-2","volume":"396","author":"S Anand","year":"2020","unstructured":"Anand, S. et al. Prevalence of sars-cov-2 antibodies in a large nationwide sample of patients on dialysis in the USA: a cross-sectional study. Lancet 396, 1335\u20131344 (2020).","journal-title":"Lancet"},{"key":"511_CR26","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1016\/j.pulmoe.2020.05.015","volume":"27","author":"H Lau","year":"2021","unstructured":"Lau, H. et al. Evaluating the massive underreporting and undertesting of covid-19 cases in multiple global epicenters. Pulmonology 27, 110\u2013115 (2021).","journal-title":"Pulmonology"},{"key":"511_CR27","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-18272-4","volume":"11","author":"SL Wu","year":"2020","unstructured":"Wu, S. L. et al. Substantial underestimation of sars-cov-2 infection in the united states. Nat. Commun. 11, 4507 (2020).","journal-title":"Nat. Commun."},{"key":"511_CR28","doi-asserted-by":"publisher","first-page":"410","DOI":"10.1093\/ije\/dyab010","volume":"50","author":"E Bendavid","year":"2021","unstructured":"Bendavid, E. et al. COVID-19 antibody seroprevalence in Santa Clara County, California. Int. J. Epidemiol. 50, 410\u2013419 (2021).","journal-title":"Int. J. Epidemiol."},{"key":"511_CR29","doi-asserted-by":"publisher","DOI":"10.1186\/s40779-020-00245-9","volume":"7","author":"Y-Y Wang","year":"2020","unstructured":"Wang, Y.-Y. et al. Updating the diagnostic criteria of covid-19 \"suspected case\u201d and \"confirmed case\u201d is necessary. Military Med. Res. 7, 17 (2020).","journal-title":"Military Med. Res."},{"key":"511_CR30","unstructured":"Region data notes. https:\/\/coronavirus.jhu.edu\/region-data-notes."},{"key":"511_CR31","doi-asserted-by":"publisher","unstructured":"Bracher, J., Ray, E. L., Gneiting, T. & Reich, N. G. Evaluating epidemic forecasts in an interval format. Bracher, J., Ray, E.L., Gneiting, T. & Reich N.G. Evaluating epidemic forecasts in an interval format. PLoS Comput Biol 17, e1008618 (2021). https:\/\/doi.org\/10.1371\/journal.pcbi.1008618. Preprint at https:\/\/arxiv.org\/abs\/2005.12881 (2020).","DOI":"10.1371\/journal.pcbi.1008618"},{"key":"511_CR32","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1198\/016214506000001437","volume":"102","author":"T Gneiting","year":"2007","unstructured":"Gneiting, T. & Raftery, A. E. Strictly proper scoring rules, prediction, and estimation. J. Am. Stat. Assoc. 102, 359\u2013378 (2007).","journal-title":"J. Am. Stat. Assoc."},{"key":"511_CR33","doi-asserted-by":"publisher","first-page":"1891","DOI":"10.1001\/jama.2020.6548","volume":"323","author":"CW Yancy","year":"2020","unstructured":"Yancy, C. W. COVID-19 and African Americans. J. Am. Med. Assoc. 323, 1891\u20131892 (2020).","journal-title":"J. Am. Med. Assoc."},{"key":"511_CR34","doi-asserted-by":"publisher","first-page":"2466","DOI":"10.1001\/jama.2020.8598","volume":"323","author":"M Webb Hooper","year":"2020","unstructured":"Webb Hooper, M., N\u00e1poles, A. M. & P\u00e9rez-Stable, E. J. COVID-19 and racial\/ethnic disparities. J. Am. Med. Assoc. 323, 2466\u20132467 (2020).","journal-title":"J. Am. Med. Assoc."},{"key":"511_CR35","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1056\/NEJMp2012910","volume":"383","author":"M Chowkwanyun","year":"2020","unstructured":"Chowkwanyun, M. & Reed, A. L. Racial health disparities and COVID-19\u2014caution and context. New Engl. J. Med. 383, 201\u2013203 (2020).","journal-title":"New Engl. J. Med."},{"key":"511_CR36","doi-asserted-by":"publisher","first-page":"1673","DOI":"10.1016\/S0140-6736(20)31102-8","volume":"395","author":"N Bhala","year":"2020","unstructured":"Bhala, N., Curry, G., Martineau, A. R., Agyemang, C. & Bhopal, R. Sharpening the global focus on ethnicity and race in the time of COVID-19. Lancet 395, 1673\u20131676 (2020).","journal-title":"Lancet"},{"key":"511_CR37","doi-asserted-by":"publisher","unstructured":"Henning-Smith, C., Tuttle, M. & Kozhimannil, K. B. Unequal distribution of COVID-19 risk among rural residents by race and ethnicity. J. Rural Health https:\/\/doi.org\/10.1111\/jrh.12463 (2020).","DOI":"10.1111\/jrh.12463"},{"key":"511_CR38","unstructured":"Non-pharmaceutical interventions. https:\/\/www.cdc.gov\/nonpharmaceutical-interventions\/index.html (2020)."},{"key":"511_CR39","volume-title":"The Health and Economic Impacts of Nonpharmaceutical Interventions to Address COVID-19: A Decision Support Tool for State and Local Policymakers","author":"R Vardavas","year":"2020","unstructured":"Vardavas, R. et al. The Health and Economic Impacts of Nonpharmaceutical Interventions to Address COVID-19: A Decision Support Tool for State and Local Policymakers. (RAND Corporation, 2020)."},{"key":"511_CR40","unstructured":"COVID-19 public forecasts. https:\/\/pantheon.corp.google.com\/marketplace\/product\/bigquery-public-datasets\/covid19-public-forecasts (2021)."},{"key":"511_CR41","doi-asserted-by":"crossref","unstructured":"Demirguc-Kunt, A., Lokshin, M. & Torre, I. The sooner, the better: The early economic impact of non-pharmaceutical interventions during the COVID-19 pandemic. World Bank Policy Research Working Paper (2020).","DOI":"10.1596\/1813-9450-9257"},{"key":"511_CR42","unstructured":"Wahltinez, O. et al. COVID-19 open-data: curating a fine-grained, global-scale data repository for sars-cov-2 (2020). https:\/\/goo.gle\/COVID-19-open-data (2020)."},{"key":"511_CR43","doi-asserted-by":"crossref","unstructured":"Capasso, V. In Proceedings of the Second European Symposium on Mathematics in Industry (ed. Neunzert, H.) Vol. 3, 181\u2013194 (Springer, 1988).","DOI":"10.1007\/978-94-009-2979-1_11"},{"key":"511_CR44","doi-asserted-by":"crossref","unstructured":"Hunter, E., Namee, B. M. & Kelleher, J. An open-data-driven agent-based model to simulate infectious disease outbreaks. PLoS ONE 13, e0208775 (2018).","DOI":"10.1371\/journal.pone.0208775"},{"key":"511_CR45","unstructured":"Murray, C. J. Forecasting COVID-19 impact on hospital bed-days, icu-days, ventilator-days and deaths by us state in the next 4 months. Preprint at https:\/\/www.medrxiv.org\/content\/10.1101\/2020.03.27.20043752v1 (2020)."},{"key":"511_CR46","unstructured":"GrowthRate model from Los Alamos National Laboratory.https:\/\/COVID-19.bsvgateway.org\/#link%20to%20forecasting%20site (2020)."},{"key":"511_CR47","first-page":"193","volume":"186","author":"SH White","year":"2006","unstructured":"White, S. H., del Rey, A. M. & S\u00e1nchez, G. R. Modeling epidemics using cellular automata. Appl. Mathematics Comput. 186, 193\u2013202 (2006).","journal-title":"Appl. Mathematics Comput."},{"key":"511_CR48","unstructured":"Smith, D. & Moore, L. The SIR Model for Spread of Disease - The Differential Equation Model. Convergence (December 2004)."},{"key":"511_CR49","first-page":"700","volume":"115A","author":"WO Kermack","year":"1927","unstructured":"Kermack, W. O. & McKendrick, A. G. Contributions to the mathematical theory of epidemics-i. Proc. Royal Soc. 115A, 700\u2013721 (1927).","journal-title":"Proc. Royal Soc."},{"key":"511_CR50","unstructured":"Grand Rounds. COVID-19 forecasting: fit to a curve or model the disease in real-time? https:\/\/grandrounds.com\/blog\/COVID-19-forecasting-fit-to-a-curve-or-model-the-disease-in-real-time\/. (2020)."},{"key":"511_CR51","doi-asserted-by":"publisher","first-page":"489","DOI":"10.1126\/science.abb3221","volume":"368","author":"R Li","year":"2020","unstructured":"Li, R. et al. Substantial undocumented infection facilitates the rapid dissemination of novel coronavirus (sars-cov-2). Science 368, 489\u2013493 (2020).","journal-title":"Science"},{"key":"511_CR52","unstructured":"Koller, D. & Friedman, N. Probabilistic Graphical Models: Principles and Techniques (MIT Press, 2009)."},{"key":"511_CR53","doi-asserted-by":"publisher","first-page":"202","DOI":"10.1214\/16-AOAS1000","volume":"11","author":"D Osthus","year":"2017","unstructured":"Osthus, D., Hickmann, K. S., Caragea, P. C., Higdon, D. & Del Valle, S. Y. Forecasting seasonal influenza with a state-space SIR model. Ann. Appl. Stat. 11, 202 (2017).","journal-title":"Ann. Appl. Stat."},{"key":"511_CR54","doi-asserted-by":"crossref","unstructured":"Bret\u00f3, C., He, D., Ionides, E. L. & King, A. A. Time series analysis via mechanistic models. Ann. Appl. Stat. 3, 319\u2013348 (2009).","DOI":"10.1214\/08-AOAS201"},{"key":"511_CR55","unstructured":"Greydanus, S., Dzamba, M. & Yosinski, J. Hamiltonian Neural Networks. Proceedings of the 33rd Conference on Neural Information Processing Systems, (NeurIPS, 2019)."},{"key":"511_CR56","unstructured":"Cranmer, M. et al. Lagrangian Neural Networks. Workshop on Deep Differential Equations at the 8th International Conference on Learning Representations, ICLR (2020)."},{"key":"511_CR57","unstructured":"Lutter, M., Ritter, C. & Peters, J. Deep lagrangian networks: using physics as model prior for deep learning. Proceedings of the 7th International Conference on Learning Representations (ICLR). (2019)."},{"key":"511_CR58","doi-asserted-by":"crossref","unstructured":"Lim, B., Arik, S. O., Loeff, N. & Pfister, T. Temporal fusion transformers for interpretable multi-horizon time series forecasting. International Journal of Forecasting, 37, 1748\u20131764 (2021).","DOI":"10.1016\/j.ijforecast.2021.03.012"},{"key":"511_CR59","doi-asserted-by":"publisher","first-page":"270","DOI":"10.1162\/neco.1989.1.2.270","volume":"1","author":"RJ Williams","year":"1989","unstructured":"Williams, R. J. & Zipser, D. A learning algorithm for continually running fully recurrent neural networks. Neural Comput. 1, 270\u2013280 (1989).","journal-title":"Neural Comput."},{"key":"511_CR60","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1126\/science.aba9757","volume":"368","author":"M Chinazzi","year":"2020","unstructured":"Chinazzi, M. et al. The effect of travel restrictions on the spread of the 2019 novel coronavirus (COVID-19) outbreak. Science 368, 395\u2013400 (2020).","journal-title":"Science"},{"key":"511_CR61","doi-asserted-by":"crossref","unstructured":"Pei, S., Kandula, S. & Shaman, J. Differential effects of intervention timing on COVID-19 spread in the united states. Sci. Adv. 6, eabd6370 (2020).","DOI":"10.1126\/sciadv.abd6370"},{"key":"511_CR62","unstructured":"Flaxman, S. et al. Report 13\u2014estimating the number of infections and the impact of non-pharmaceutical interventions on COVID-19 in 11 European countries. (2020)."},{"key":"511_CR63","doi-asserted-by":"publisher","first-page":"7691","DOI":"10.1109\/ACCESS.2018.2888585","volume":"7","author":"SR Venna","year":"2019","unstructured":"Venna, S. R. et al. A novel data-driven model for real-time influenza forecasting. IEEE Access 7, 7691\u20137701 (2019).","journal-title":"IEEE Access"},{"key":"511_CR64","doi-asserted-by":"publisher","first-page":"165","DOI":"10.21037\/jtd.2020.02.64","volume":"12","author":"Z Yang","year":"2020","unstructured":"Yang, Z. et al. Modified seir and ai prediction of the epidemics trend of COVID-19 in china under public health interventions. J. Thoracic Dis. 12, 165\u2013174 (2020).","journal-title":"J. Thoracic Dis."},{"key":"511_CR65","doi-asserted-by":"crossref","unstructured":"Wang, L., Chen, J. & Marathe, M. Tdefsi: theory guided deep learning based epidemic forecasting with synthetic information. ACM Transact. Spatial Algorithms Syst. (TSAS) 6.3, 1\u201339 (2020)..","DOI":"10.1145\/3380971"},{"key":"511_CR66","doi-asserted-by":"publisher","first-page":"533","DOI":"10.1016\/S1473-3099(20)30120-1","volume":"20","author":"H Ensheng Dong","year":"2020","unstructured":"Ensheng Dong, H. & Du Gardner, L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Infect. Dis. 20, 533\u2013534 (2020).","journal-title":"Lancet Infect. Dis."},{"key":"511_CR67","unstructured":"Covid-Tracking. The covid tracking project. https:\/\/covidtracking.com\/ (2020)."},{"key":"511_CR68","doi-asserted-by":"crossref","unstructured":"Bryant, P. & Elofsson, A. Estimating the impact of mobility patterns on COVID-19 infection rates in 11 European countries. Preprint at https:\/\/www.medrxiv.org\/content\/10.1101\/2020.04.13.20063644v2 (2020).","DOI":"10.1101\/2020.04.13.20063644"},{"key":"511_CR69","unstructured":"Warren, M. S. & Skillman, S. W. Mobility changes in response to COVID-19. Preprint at https:\/\/arxiv.org\/abs\/2003.14228 (2020)."},{"key":"511_CR70","unstructured":"Realtime tracking of state-wide npi implementations. https:\/\/c19hcc.org\/resources\/npi-dashboard\/ (2020)."},{"key":"511_CR71","doi-asserted-by":"crossref","unstructured":"Wu, X., Nethery, R. C., Sabath, B. M., Braun, D. & Dominici, F. Exposure to air pollution and COVID-19 mortality in the united states: a nationwide cross-sectional study. Preprint at https:\/\/www.medrxiv.org\/content\/10.1101\/2020.04.05.20054502v2 (2020).","DOI":"10.1101\/2020.04.05.20054502"},{"key":"511_CR72","unstructured":"Bigquery public datasets. https:\/\/cloud.google.com\/bigquery\/public-data (2020)."},{"key":"511_CR73","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1016\/j.chest.2017.08.001","volume":"153","author":"E Biddison","year":"2018","unstructured":"Biddison, E. et al. Scarce resource allocation during disasters: a mixed-method community engagement study. Chest 153, 187\u2013195 (2018).","journal-title":"Chest"},{"key":"511_CR74","unstructured":"COVID-19 search trends symptoms dataset. https:\/\/pantheon.corp.google.com\/marketplace\/product\/bigquery-public-datasets\/covid19-search-trends?project=covid-forecasting-272503&folder=&organizationId= (2021)."},{"key":"511_CR75","unstructured":"Nunan, D. et al. Covid-19 symptoms tracke. https:\/\/www.cebm.net\/covid-19\/covid-19-signs-and-symptoms-tracker\/ (2020)."},{"key":"511_CR76","unstructured":"Covid-19 community mobility reports. https:\/\/www.google.com\/covid19\/mobility\/ (2020)."},{"key":"511_CR77","unstructured":"Aktay, A. et al. Google COVID-19 community mobility reports: anonymization process description (version 1.1). https:\/\/europepmc.org\/article\/PPR\/PPR272259 (2020)."},{"key":"511_CR78","unstructured":"Policies of the office of the prime minister of japan and his cabinet. https:\/\/japan.kantei.go.jp\/ongoingtopics\/index.html (2021)."},{"key":"511_CR79","unstructured":"Gillam, M. Japan\u2019s response to the coronavirus pandemic. https:\/\/www.jlgc.org\/04-28-2020\/8414\/ (2020)."},{"key":"511_CR80","unstructured":"Barkay, N. et al. Weights and methodology brief for the COVID-19 symptom survey by University of Maryland and Carnegie Mellon University, in partnership with Facebook. Preprint at https:\/\/arxiv.org\/abs\/2009.14675 (2020)."},{"key":"511_CR81","unstructured":"The Statistics Bureau of Japan. Natl Census http:\/\/www.stat.go.jp\/data\/kokusei\/2015\/ (2015)."},{"key":"511_CR82","unstructured":"The Statistics Bureau of Japan. The 66th Japan statistical yearbook 2017. http:\/\/www.stat.go.jp\/data\/nenkan\/66nenkan\/02.html (2015)."},{"key":"511_CR83","unstructured":"Organisation for Economic Cooperation and Development. OECD.stat https:\/\/stats.oecd.org\/ (2000)."},{"key":"511_CR84","unstructured":"Ministry of Health, Labor, and Welfare. Handbook of health and welfare statistics. https:\/\/www.mhlw.go.jp\/english\/database\/db-hh\/2-2.html (2019)."},{"key":"511_CR85","unstructured":"Ministry of Health, Labor, and Welfare. Survey on medical treatment status and number of beds accepted by inpatients. https:\/\/www.mhlw.go.jp\/stf\/seisakunitsuite\/newpage_00023.html (2020)."},{"key":"511_CR86","unstructured":"Ministry of Health, Labor, and Welfare. 2012 national health and nutrition survey report. https:\/\/www.mhlw.go.jp\/bunya\/kenkou\/eiyou\/h24-houkoku.html (2012)."},{"key":"511_CR87","unstructured":"National Tax Agency. Statistics on imposition of liquor tax 2016. https:\/\/www.nta.go.jp\/taxes\/sake\/tokei\/mokuji.htm (2016)."},{"key":"511_CR88","unstructured":"Infectious Disease Surveillence Center. Statistics on imposition of liquor tax 2016. http:\/\/idsc.nih.go.jp\/idwr\/sokuho\/index.html (2010)."},{"key":"511_CR89","unstructured":"Ministry of Health, Labor, and Welfare. Comprehensive survey of living conditions. https:\/\/www.mhlw.go.jp\/toukei\/list\/20-21.html (2007)."},{"key":"511_CR90","doi-asserted-by":"crossref","unstructured":"Kirkcaldy, R. D., King, B. A. & Brooks, J. T. COVID-19 and postinfection immunity: limited evidence, many remaining questions. J. Am. Med. Assoc. 323, 2245\u20132246 (2020).","DOI":"10.1001\/jama.2020.7869"},{"key":"511_CR91","first-page":"582 \u2013 597","volume":"197","author":"X Meng","year":"2008","unstructured":"Meng, X. & Chen, L. The dynamics of a new sir epidemic model concerning pulse vaccination strategy. Appl. Mathematics Comput. 197, 582 \u2013 597 (2008).","journal-title":"Appl. Mathematics Comput."},{"key":"511_CR92","unstructured":"Different COVID-19 vaccines. https:\/\/www.cdc.gov\/coronavirus\/2019-ncov\/vaccines\/different-vaccines.html (2021)."},{"key":"511_CR93","doi-asserted-by":"publisher","first-page":"802","DOI":"10.1017\/S0950268809990781","volume":"1386","author":"N Hens","year":"2010","unstructured":"Hens, N. et al. Seventy-five years of estimating the force of infection from current status data. Epidemiol. Infect. 1386, 802\u201312 (2010).","journal-title":"Epidemiol. Infect."},{"key":"511_CR94","doi-asserted-by":"crossref","unstructured":"van den Driessche, P. & Watmough, J. Further notes on the basic reproduction number. in Lecture Notes in Mathematics, LNM Chapter 6, Vol. 1945, 159\u2013178, Eds. F. Brauer, P. van den Driessche & J. Wu (Springer, 2008).","DOI":"10.1007\/978-3-540-78911-6_6"},{"key":"511_CR95","unstructured":"Fda briefing document moderna covid-19 vaccine. https:\/\/www.fda.gov\/media\/144434\/download\/ (2021)."},{"key":"511_CR96","first-page":"297","volume":"1","author":"T Hastie","year":"1986","unstructured":"Hastie, T. & Tibshirani, R. Generalized additive models. Statist. Sci. 1, 297\u2013310 (1986).","journal-title":"Statist. Sci."},{"key":"511_CR97","doi-asserted-by":"crossref","unstructured":"Chen, T. & Guestrin, C. Xgboost: a scalable tree boosting system. in Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 785\u2013794 (Association for Computing Machinery, 2016).","DOI":"10.1145\/2939672.2939785"},{"key":"511_CR98","unstructured":"Bengio, S., Vinyals, O., Jaitly, N. & Shazeer, N. Scheduled sampling for sequence prediction with recurrent neural networks. In Proceedings of the 28th International Conference on Neural Information Processing Systems - Volume 1 (NIPS\u201915, 2015)."},{"key":"511_CR99","doi-asserted-by":"crossref","unstructured":"Golovin, D. et al. Google vizier: a service for black-box optimization. in Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 1487\u20131495 (ACM, 2017).","DOI":"10.1145\/3097983.3098043"},{"key":"511_CR100","unstructured":"Wen, R., Torkkola, K., Narayanaswamy, B. & Madeka, D. A multi-horizon quantile recurrent forecaster. Proceedings of the 31st Conference on Neural Information Processing Systems, (NeurIPS, 2017)."},{"key":"511_CR101","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1080\/07350015.1995.10524599","volume":"13","author":"RS Mariano","year":"1995","unstructured":"Mariano, R. S. & Diebold, F. X. Comparing predictive accuracy. J. Bus. Econ. Stat. 13, 253 (1995).","journal-title":"J. Bus. Econ. Stat."},{"key":"511_CR102","unstructured":"Holm, S. A simple sequentially rejective multiple test procedure. Scand. J. Stat. 6, 65\u201370 (1979)."},{"key":"511_CR103","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1016\/0304-4076(92)90104-Y","volume":"54","author":"D Kwiatkowski","year":"1992","unstructured":"Kwiatkowski, D., Phillips, P. C., Schmidt, P. & Shin, Y. Testing the null hypothesis of stationarity against the alternative of a unit root: How sure are we that economic time series have a unit root? J. Econometrics 54, 159\u2013178 (1992).","journal-title":"J. Econometrics"},{"key":"511_CR104","doi-asserted-by":"crossref","unstructured":"Labgold, K. et al. Widening the gap: greater racial and ethnic disparities in COVID-19 burden after accounting for missing race\/ethnicity data. Preprint at https:\/\/www.medrxiv.org\/content\/10.1101\/2020.09.30.20203315v1.full (2020).","DOI":"10.1101\/2020.09.30.20203315"},{"key":"511_CR105","doi-asserted-by":"publisher","first-page":"e1018","DOI":"10.1016\/S2214-109X(20)30285-0","volume":"8","author":"P Baqui","year":"2020","unstructured":"Baqui, P., Bica, I., Marra, V., Ercole, A. & van Der Schaar, M. Ethnic and regional variations in hospital mortality from COVID-19 in brazil: a cross-sectional observational study. Lancet Global Health 8, e1018\u2013e1026 (2020).","journal-title":"Lancet Global Health"},{"key":"511_CR106","doi-asserted-by":"crossref","unstructured":"Aldridge, R. W. et al. Black, Asian and minority ethnic groups in England are at increased risk of death from COVID-19: indirect standardisation of NHS mortality data. Wellcome Open Res. 5, 88 (2020).","DOI":"10.12688\/wellcomeopenres.15922.2"},{"key":"511_CR107","doi-asserted-by":"crossref","unstructured":"Tai, D. B. G., Shah, A., Doubeni, C. A., Sia, I. G. & Wieland, M. L. The disproportionate impact of COVID-19 on racial and ethnic minorities in the united states. Clin. Infect. Dis. 16, 703\u2013706 (2020).","DOI":"10.1093\/cid\/ciaa815"},{"key":"511_CR108","doi-asserted-by":"publisher","first-page":"398","DOI":"10.1007\/s40615-020-00756-0","volume":"7","author":"CT Laurencin","year":"2020","unstructured":"Laurencin, C. T. & McClinton, A. The COVID-19 pandemic: a call to action to identify and address racial and ethnic disparities. J. Racial Ethnic Health Disparities 7, 398\u2013402 (2020).","journal-title":"J. Racial Ethnic Health Disparities"},{"key":"511_CR109","doi-asserted-by":"publisher","first-page":"1330","DOI":"10.3390\/ijerph7041330","volume":"7","author":"C Murata","year":"2010","unstructured":"Murata, C. et al. Barriers to health care among the elderly in Japan. Int. J. of Env. Res. Pub. Health 7, 1330\u20131341 (2010).","journal-title":"Int. J. of Env. Res. Pub. Health"},{"key":"511_CR110","doi-asserted-by":"publisher","first-page":"1379","DOI":"10.1080\/01621459.1968.10480934","volume":"63","author":"PK Sen","year":"1968","unstructured":"Sen, P. K. Estimates of the regression coefficient based on Kendall\u2019s tau. J. Am. Stat. Assoc. 63, 1379\u20131389 (1968).","journal-title":"J. Am. Stat. Assoc."},{"key":"511_CR111","unstructured":"Lakshminarayanan, B., Pritzel, A. & Blundell, C. Simple and scalable predictive uncertainty estimation using deep ensembles. In Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS\u201917, 2017)."},{"key":"511_CR112","unstructured":"Kendall, A & Gal, Y. What uncertainties do we need in Bayesian deep learning for computer vision? In Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS\u201917, 2017)."},{"key":"511_CR113","unstructured":"Malinin, A. & Gales, M. Predictive uncertainty estimation via prior networks. In Proceedings of the 32nd International Conference on Neural Information Processing Systems (NIPS\u201918, 2018)."},{"key":"511_CR114","unstructured":"Ovadia, Y. et al. Can you trust your model\u2019s uncertainty? Evaluating predictive uncertainty under dataset shift. Proceedings of the 33rd International Conference on Neural Information Processing Systems, (2019)."},{"key":"511_CR115","doi-asserted-by":"publisher","unstructured":"Dusenberry, M. W. et al. Analyzing the role of model uncertainty for electronic health records. In Proc. of the ACM Conference on Health, Inference, and Learning (CHIL \u201920) 204\u2013213 (Association for Computing Machinery, NewYork, NY, USA, 2020). https:\/\/doi.org\/10.1145\/3368555.3384457.","DOI":"10.1145\/3368555.3384457"},{"key":"511_CR116","unstructured":"Filos, A. et al. Benchmarking Bayesian deep learning with diabetic retinopathy diagnosis. Preprint at https:\/\/arxiv.org\/abs\/1912.10481 (2019)."},{"key":"511_CR117","unstructured":"van Amersfoort, J., Smith, L., Teh, Y. W. & Gal, Y. Uncertainty estimation using a single deep deterministic neural network. Int. Conf. Mach. Learn. (2020)."},{"key":"511_CR118","doi-asserted-by":"crossref","unstructured":"Brauer, F., Castillo-Chavez, C. & Feng, Z. Mathematical Models in Epidemiology, Vol. 69 (Springer, 2019).","DOI":"10.1007\/978-1-4939-9828-9"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00511-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00511-7","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00511-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,9]],"date-time":"2024-09-09T12:23:01Z","timestamp":1725884581000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00511-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,8]]},"references-count":118,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["511"],"URL":"https:\/\/doi.org\/10.1038\/s41746-021-00511-7","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-312419\/v1","asserted-by":"object"}]},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,8]]},"assertion":[{"value":"9 June 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 August 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 October 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"H.M. and S.N. are recipients of a Google.org Fellowship grant. The remaining authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"146"}}