{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,16]],"date-time":"2026-05-16T01:50:05Z","timestamp":1778896205313,"version":"3.51.4"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1011453","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2023,9,22]],"date-time":"2023-09-22T00:00:00Z","timestamp":1695340800000}}],"reference-count":47,"publisher":"Public Library of Science (PLoS)","issue":"9","license":[{"start":{"date-parts":[[2023,9,12]],"date-time":"2023-09-12T00:00:00Z","timestamp":1694476800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100018517","name":"Office for National Statistics","doi-asserted-by":"publisher","award":["PU-20-0205(c)"],"award-info":[{"award-number":["PU-20-0205(c)"]}],"id":[{"id":"10.13039\/100018517","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010269","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["210758\/Z\/18\/Z"],"award-info":[{"award-number":["210758\/Z\/18\/Z"]}],"id":[{"id":"10.13039\/100010269","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010269","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["210758\/Z\/18\/Z"],"award-info":[{"award-number":["210758\/Z\/18\/Z"]}],"id":[{"id":"10.13039\/100010269","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010269","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["210758\/Z\/18\/Z"],"award-info":[{"award-number":["210758\/Z\/18\/Z"]}],"id":[{"id":"10.13039\/100010269","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010269","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["210758\/Z\/18\/Z"],"award-info":[{"award-number":["210758\/Z\/18\/Z"]}],"id":[{"id":"10.13039\/100010269","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Mathematical and statistical models can be used to make predictions of how epidemics may progress in the near future and form a central part of outbreak mitigation and control. Renewal equation based models allow inference of epidemiological parameters from historical data and forecast future epidemic dynamics without requiring complex mechanistic assumptions. However, these models typically ignore interaction between age groups, partly due to challenges in parameterising a time varying interaction matrix. Social contact data collected regularly during the COVID-19 epidemic provide a means to inform interaction between age groups in real-time. We developed an age-specific forecasting framework and applied it to two age-stratified time-series: incidence of SARS-CoV-2 infection, estimated from a national infection and antibody prevalence survey; and, reported cases according to the UK national COVID-19 dashboard. Jointly fitting our model to social contact data from the CoMix study, we inferred a time-varying next generation matrix which we used to project infections and cases in the four weeks following each of 29 forecast dates between October 2020 and November 2021. We evaluated the forecasts using proper scoring rules and compared performance with three other models with alternative data and specifications alongside two naive baseline models. Overall, incorporating age interaction improved forecasts of infections and the CoMix-data-informed model was the best performing model at time horizons between two and four weeks. However, this was not true when forecasting cases. We found that age group interaction was most important for predicting cases in children and older adults. The contact-data-informed models performed best during the winter months of 2020\u20132021, but performed comparatively poorly in other periods. We highlight challenges regarding the incorporation of contact data in forecasting and offer proposals as to how to extend and adapt our approach, which may lead to more successful forecasts in future.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1011453","type":"journal-article","created":{"date-parts":[[2023,9,12]],"date-time":"2023-09-12T17:30:35Z","timestamp":1694539835000},"page":"e1011453","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":15,"title":["Evaluating the use of social contact data to produce age-specific short-term forecasts of SARS-CoV-2 incidence in England"],"prefix":"10.1371","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6206-7134","authenticated-orcid":true,"given":"James D.","family":"Munday","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sam","family":"Abbott","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sophie","family":"Meakin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2842-3406","authenticated-orcid":true,"given":"Sebastian","family":"Funk","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2023,9,12]]},"reference":[{"key":"pcbi.1011453.ref001","doi-asserted-by":"crossref","first-page":"1181","DOI":"10.1001\/jama.1983.03330330059036","article-title":"The surveillance of infectious diseases","volume":"249","author":"SB Thacker","year":"1983","journal-title":"JAMA"},{"key":"pcbi.1011453.ref002","doi-asserted-by":"crossref","first-page":"e758","DOI":"10.1371\/journal.pone.0000758","article-title":"Estimating individual and household reproduction numbers in an emerging epidemic","volume":"2","author":"C. Fraser","year":"2007","journal-title":"PLoS One"},{"key":"pcbi.1011453.ref003","doi-asserted-by":"crossref","first-page":"1505","DOI":"10.1093\/aje\/kwt133","article-title":"A new framework and software to estimate time-varying reproduction numbers during epidemics","volume":"178","author":"A Cori","year":"2013","journal-title":"Am J Epidemiol"},{"key":"pcbi.1011453.ref004","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1016\/j.epidem.2016.11.003","article-title":"Real-time forecasting of infectious disease dynamics with a stochastic semi-mechanistic model.","volume":"22","author":"S Funk","year":"2018","journal-title":"Epidemics."},{"key":"pcbi.1011453.ref005","article-title":"Predictive performance of multi-model ensemble forecasts of COVID-19 across European nations.","author":"K Sherratt","year":"2022","journal-title":"medRxiv"},{"key":"pcbi.1011453.ref006","doi-asserted-by":"crossref","first-page":"e2113561119","DOI":"10.1073\/pnas.2113561119","article-title":"Evaluation of individual and ensemble probabilistic forecasts of COVID-19 mortality in the United States","volume":"119","author":"EY Cramer","year":"2022","journal-title":"Proc Natl Acad Sci U S A"},{"key":"pcbi.1011453.ref007","doi-asserted-by":"crossref","first-page":"1205","DOI":"10.1038\/s41591-020-0962-9","article-title":"Age-dependent effects in the transmission and control of COVID-19 epidemics","volume":"26","author":"NG Davies","year":"2020","journal-title":"Nat Med"},{"key":"pcbi.1011453.ref008","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1001\/jamapediatrics.2020.4573","article-title":"Susceptibility to SARS-CoV-2 Infection Among Children and Adolescents Compared With Adults: A Systematic Review and Meta-analysis","volume":"175","author":"RM Viner","year":"2021","journal-title":"JAMA Pediatr"},{"key":"pcbi.1011453.ref009","doi-asserted-by":"crossref","first-page":"1469","DOI":"10.1016\/S0140-6736(21)02867-1","article-title":"Variation in the COVID-19 infection-fatality ratio by age, time, and geography during the pre-vaccine era: a systematic analysis.","volume":"399","author":"COVID-19 Forecasting Team","year":"2022","journal-title":"Lancet"},{"key":"pcbi.1011453.ref010","doi-asserted-by":"crossref","first-page":"1123","DOI":"10.1007\/s10654-020-00698-1","article-title":"Assessing the age specificity of infection fatality rates for COVID-19: systematic review, meta-analysis, and public policy implications","volume":"35","author":"AT Levin","year":"2020","journal-title":"Eur J Epidemiol"},{"key":"pcbi.1011453.ref011","doi-asserted-by":"crossref","first-page":"e044640","DOI":"10.1136\/bmjopen-2020-044640","article-title":"Demographic risk factors for COVID-19 infection, severity, ICU admission and death: a meta-analysis of 59 studies","volume":"11","author":"BG Pijls","year":"2021","journal-title":"BMJ Open"},{"key":"pcbi.1011453.ref012","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1017\/S002217240006160X","article-title":"Age-related changes in the rate of disease transmission: implications for the design of vaccination programmes","volume":"94","author":"RM Anderson","year":"1985","journal-title":"J Hyg"},{"key":"pcbi.1011453.ref013","doi-asserted-by":"crossref","first-page":"936","DOI":"10.1093\/aje\/kwj317","article-title":"Using data on social contacts to estimate age-specific transmission parameters for respiratory-spread infectious agents","volume":"164","author":"J Wallinga","year":"2006","journal-title":"Am J Epidemiol"},{"key":"pcbi.1011453.ref014","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1016\/j.epidem.2015.04.003","article-title":"On the relative role of different age groups in influenza epidemics.","volume":"13","author":"CJ Worby","year":"2015","journal-title":"Epidemics."},{"key":"pcbi.1011453.ref015","doi-asserted-by":"crossref","first-page":"723","DOI":"10.1097\/EDE.0000000000001047","article-title":"A Systematic Review of Social Contact Surveys to Inform Transmission Models of Close-contact Infections.","volume":"30","author":"T Hoang","year":"2019","journal-title":"Epidemiology"},{"key":"pcbi.1011453.ref016","article-title":"Inferring Risks of Coronavirus Transmission from Community Household Data.","author":"T House","year":"2021","journal-title":"arXiv:2104.04605."},{"key":"pcbi.1011453.ref017","doi-asserted-by":"crossref","first-page":"949","DOI":"10.1098\/rspb.1997.0131","article-title":"\u2019Callaghan CJ, Nokes DJ. Who mixes with whom? A method to determine the contact patterns of adults that may lead to the spread of airborne infections","volume":"264","author":"O Edmunds WJ","year":"1997","journal-title":"Proc Biol Sci"},{"key":"pcbi.1011453.ref018","doi-asserted-by":"crossref","first-page":"e74","DOI":"10.1371\/journal.pmed.0050074","article-title":"Social contacts and mixing patterns relevant to the spread of infectious diseases.","volume":"5","author":"J Mossong","year":"2008","journal-title":"PLoS Med"},{"key":"pcbi.1011453.ref019","article-title":"CoMix: Changes in social contacts as measured by the contact survey during the COVID-19 pandemic in England between March 2020 and March 2021.","author":"A Gimma","journal-title":"medRxiv"},{"key":"pcbi.1011453.ref020","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1186\/s12916-021-02107-0","article-title":"Estimating the impact of reopening schools on the reproduction number of SARS-CoV-2 in England, using weekly contact survey data.","volume":"19","author":"CMMID COVID-19 Working Group","year":"2021","journal-title":"BMC Med"},{"key":"pcbi.1011453.ref021","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1186\/s12916-021-01924-7","article-title":"Edmunds WJ. The impact of local and national restrictions in response to COVID-19 on social contacts in England: a longitudinal natural experiment.","volume":"19","author":"CMMID COVID-19 working group","year":"2021","journal-title":"BMC Med."},{"key":"pcbi.1011453.ref022","doi-asserted-by":"crossref","DOI":"10.1186\/s12916-021-02133-y","article-title":"SOCRATES-CoMix: a platform for timely and open-source contact mixing data during and in between COVID-19 surges and interventions in over 20 European countries.","volume":"19","author":"F Verelst","year":"2021","journal-title":"BMC Med."},{"key":"pcbi.1011453.ref023","doi-asserted-by":"crossref","first-page":"e1006785","DOI":"10.1371\/journal.pcbi.1006785","article-title":"Assessing the performance of real-time epidemic forecasts: A case study of Ebola in the Western Area region of Sierra Leone, 2014\u201315.","volume":"15","author":"S Funk","year":"2019","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1011453.ref024","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1198\/016214506000001437","article-title":"Strictly Proper Scoring Rules, Prediction, and Estimation","volume":"102","author":"T Gneiting","year":"2007","journal-title":"J Am Stat Assoc"},{"key":"pcbi.1011453.ref025","doi-asserted-by":"crossref","first-page":"3443","DOI":"10.1002\/sim.7363","article-title":"Probabilistic forecasting in infectious disease epidemiology: the 13th Armitage lecture.","volume":"36","author":"L Held","year":"2017","journal-title":"Stat Med"},{"key":"pcbi.1011453.ref026","article-title":"Estimating epidemiological quantities from repeated cross-sectional prevalence measurements.","author":"S Abbott","year":"2022","journal-title":"bioRxiv"},{"key":"pcbi.1011453.ref027","unstructured":"Coronavirus (COVID-19) Infection Survey, UK Statistical bulletins. [cited 29 Mar 2022]. Available: https:\/\/www.ons.gov.uk\/peoplepopulationandcommunity\/healthandsocialcare\/conditionsanddiseases\/bulletins\/coronaviruscovid19infectionsurveypilot\/previousReleases"},{"key":"pcbi.1011453.ref028","doi-asserted-by":"crossref","first-page":"4363","DOI":"10.1002\/sim.8303","article-title":"A modelling approach for correcting reporting delays in disease surveillance data.","volume":"38","author":"LS Bastos","year":"2019","journal-title":"Stat Med"},{"key":"pcbi.1011453.ref029","unstructured":"HM Government UK. Official Coronavirus (COVID-19) disease situation dashboard. [cited 25 May 2022]. Available: https:\/\/coronavirus.data.gov.uk\/"},{"key":"pcbi.1011453.ref030","unstructured":"inc2prev: Estimate incidence from ONS prevalence estimates. Github; Available: https:\/\/github.com\/epiforecasts\/inc2prev"},{"key":"pcbi.1011453.ref031","unstructured":"The CoMix study. In: uHasselt [Internet]. [cited 29 Mar 2022]. Available: https:\/\/www.uhasselt.be\/en\/aparte-sites-partner-en\/epipose\/the-comix-study"},{"key":"pcbi.1011453.ref032","author":"Stan Team","year":"2012","journal-title":"Stan Modeling Language User\u2019s Guide and Reference Manual"},{"key":"pcbi.1011453.ref033","doi-asserted-by":"crossref","first-page":"e229317","DOI":"10.1001\/jamanetworkopen.2022.9317","article-title":"Household Secondary Attack Rates of SARS-CoV-2 by Variant and Vaccination Status: An Updated Systematic Review and Meta-analysis","volume":"5","author":"ZJ Madewell","year":"2022","journal-title":"JAMA Netw Open"},{"key":"pcbi.1011453.ref034","first-page":"25","article-title":"Estimating the generation interval for coronavirus disease (COVID-19) based on symptom onset data, March 2020.","author":"T Ganyani","year":"2020","journal-title":"Euro Surveill."},{"key":"pcbi.1011453.ref035","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1016\/S1473-3099(22)00001-9","article-title":"Generation time of the alpha and delta SARS-CoV-2 variants: an epidemiological analysis","volume":"22","author":"WS Hart","year":"2022","journal-title":"Lancet Infect Dis"},{"key":"pcbi.1011453.ref036","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1186\/s12879-021-05950-x","article-title":"Serial interval and incubation period of COVID-19: a systematic review and meta-analysis.","volume":"21","author":"M Alene","year":"2021","journal-title":"BMC Infect Dis"},{"key":"pcbi.1011453.ref037","article-title":"Estimation of the test to test distribution as a proxy for generation interval distribution for the Omicron variant in England.","author":"S Abbott","year":"2022","journal-title":"bioRxiv"},{"key":"pcbi.1011453.ref038","doi-asserted-by":"crossref","first-page":"e039652","DOI":"10.1136\/bmjopen-2020-039652","article-title":"Incubation period of COVID-19: a rapid systematic review and meta-analysis of observational research","volume":"10","author":"C McAloon","year":"2020","journal-title":"BMJ Open"},{"key":"pcbi.1011453.ref039","unstructured":"Report 49\u2014Growth, population distribution and immune escape of Omicron in England. In: Imperial College London [Internet]. [cited 29 Mar 2022]. Available: https:\/\/www.imperial.ac.uk\/mrc-global-infectious-disease-analysis\/covid-19\/report-49-Omicron\/"},{"key":"pcbi.1011453.ref040","author":"NI Bosse","year":"2020","journal-title":"Utilities for Scoring and Assessing Predictions"},{"key":"pcbi.1011453.ref041","year":"2022","journal-title":"Institute for Government. Timeline of UK government coronavirus lockdowns and restrictions"},{"key":"pcbi.1011453.ref042","first-page":"371","article-title":"Age groups that sustain resurging COVID-19 epidemics in the United States","author":"M Monod","year":"2021","journal-title":"Science"},{"key":"pcbi.1011453.ref043","year":"2020","journal-title":"Internet]"},{"key":"pcbi.1011453.ref044","doi-asserted-by":"crossref","first-page":"e1009965","DOI":"10.1371\/journal.pcbi.1009965","article-title":"Inferring age-specific differences in susceptibility to and infectiousness upon SARS-CoV-2 infection based on Belgian social contact data.","volume":"18","author":"N Franco","year":"2022","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1011453.ref045","doi-asserted-by":"crossref","first-page":"e1008409","DOI":"10.1371\/journal.pcbi.1008409","article-title":"Practical considerations for measuring the effective reproductive number, Rt.","volume":"16","author":"KM Gostic","year":"2020","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1011453.ref046","author":"S Abbott","year":"2022","journal-title":"Flexible hierarchical nowcasting. Zenodo"},{"key":"pcbi.1011453.ref047","author":"S Abbott","year":"2021","journal-title":"EpiNow2: Estimate Real-Time Case Counts and Time-Varying Epidemiological Parameters"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1011453","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2023,9,22]],"date-time":"2023-09-22T00:00:00Z","timestamp":1695340800000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1011453","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,22]],"date-time":"2023-09-22T17:30:24Z","timestamp":1695403824000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1011453"}},"subtitle":[],"editor":[{"given":"Claudio Jos\u00e9","family":"Struchiner","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2023,9,12]]},"references-count":47,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2023,9,12]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1011453","relation":{"new_version":[{"id-type":"doi","id":"10.1371\/journal.pcbi.1011453","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,12]]}}}