{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T16:50:39Z","timestamp":1790268639137,"version":"4.1.0"},"reference-count":24,"publisher":"eLife Sciences Publications, Ltd","license":[{"start":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T00:00:00Z","timestamp":1760054400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T00:00:00Z","timestamp":1760054400000},"content-version":"am","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T00:00:00Z","timestamp":1760054400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100010269","name":"Wellcome Trust","doi-asserted-by":"crossref","award":["10.35802\/210758"],"award-info":[{"award-number":["10.35802\/210758"],"id":[{"id":"10.35802\/210758","id-type":"DOI","asserted-by":"publisher"}]}],"id":[{"id":"10.13039\/100010269","id-type":"DOI","asserted-by":"crossref"}]},{"award":["10.35802\/210758"],"award-info":[{"award-number":["10.35802\/210758"],"id":[{"id":"10.35802\/210758","id-type":"DOI","asserted-by":"publisher"}]}],"id":[{"id":"https:\/\/ror.org\/029chgv08","id-type":"ROR","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000272","name":"National Institute for Health and Care Research","doi-asserted-by":"crossref","award":["VEEPED: PR-OD-1017-20002"],"award-info":[{"award-number":["VEEPED: PR-OD-1017-20002"]}],"id":[{"id":"10.13039\/501100000272","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["elifesciences.org"],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:sec id=\"abs1\">\n                    <jats:title>Background:<\/jats:title>\n                    <jats:p>Ebola virus disease outbreaks can often be controlled, but require rapid response efforts frequently with profound operational complexities. Mathematical models can be used to support response planning, but it is unclear if models improve the prior understanding of experts.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"abs2\">\n                    <jats:title>Methods:<\/jats:title>\n                    <jats:p>We performed repeated surveys of Ebola response experts during an outbreak. From each expert, we elicited the probability of cases exceeding four thresholds between 2 and 20 cases in a set of small geographical areas in the following calendar month. We compared the predictive performance of these forecasts to those of two mathematical models with different spatial interaction components.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"abs3\">\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>An ensemble combining the forecasts of all experts performed similarly to the two models. Experts showed stronger bias than models forecasting two-case threshold exceedance. Experts and models both performed better when predicting exceedance of higher thresholds. The models also tended to be better at risk-ranking areas than experts.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"abs4\">\n                    <jats:title>Conclusions:<\/jats:title>\n                    <jats:p>Our results support the use of models in outbreak contexts, offering a convenient and scalable route to a quantified situational awareness, which can provide confidence in or to call into question existing advice of experts. There could be value in combining expert opinion and modelled forecasts to support the response to future outbreaks.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"abs5\">\n                    <jats:title>Funding:<\/jats:title>\n                    <jats:p>This study was partly funded by the Department of Health and Social Care using UK Aid funding 47 and is managed by the National Institute for Health and Care Research (VEEPED: PR-OD-1017- 48 20002; AR and WJE). This study was partly funded by the Wellcome Trust (210758\/Z\/18\/Z : JDM 49 and SF). The views expressed in this publication are those of the authors and not necessarily 50 those of the funders.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.7554\/elife.98005","type":"journal-article","created":{"date-parts":[[2024,8,6]],"date-time":"2024-08-06T13:42:44Z","timestamp":1722951764000},"update-policy":"https:\/\/doi.org\/10.7554\/elife.98005","source":"Crossref","is-referenced-by-count":5,"title":["Forecasting the spatial spread of an Ebola epidemic in real time: Comparing predictions of mathematical models and experts"],"prefix":"10.7554","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6206-7134","authenticated-orcid":true,"given":"James D","family":"Munday","sequence":"first","affiliation":[{"id":[{"id":"https:\/\/ror.org\/00a0jsq62","id-type":"ROR","asserted-by":"publisher"}],"name":"Centre for Mathematical Modelling of Infectious Diseases, London School of Hygiene and Tropical Medicine","place":["London, United Kingdom"]},{"id":[{"id":"https:\/\/ror.org\/00a0jsq62","id-type":"ROR","asserted-by":"publisher"}],"name":"Department of Infectious Disease Epidemiology, London School of Hygiene and Tropical Medicine","place":["London, United Kingdom"]},{"id":[{"id":"https:\/\/ror.org\/05a28rw58","id-type":"ROR","asserted-by":"publisher"}],"name":"Department of Biosystems Science and Engineering, ETH Z\u00fcrich","place":["Z\u00fcrich, Switzerland"]}],"role":[{"role":"author","vocabulary":"crossref"},{"role":"corresponding-author","vocabulary":"crossref"},{"role":"conceptualization","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"formal-analysis","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"project-administration","vocabulary":"credit"},{"role":"software","vocabulary":"credit"},{"role":"validation","vocabulary":"credit"},{"role":"visualization","vocabulary":"credit"},{"role":"writing-original-draft","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0737-5679","authenticated-orcid":true,"given":"Alicia","family":"Rosello","sequence":"first","affiliation":[{"id":[{"id":"https:\/\/ror.org\/00a0jsq62","id-type":"ROR","asserted-by":"publisher"}],"name":"Centre for Mathematical Modelling of Infectious Diseases, London School of Hygiene and Tropical Medicine","place":["London, United Kingdom"]},{"id":[{"id":"https:\/\/ror.org\/00a0jsq62","id-type":"ROR","asserted-by":"publisher"}],"name":"Department of Infectious Disease Epidemiology, London School of Hygiene and Tropical Medicine","place":["London, United Kingdom"]}],"role":[{"role":"author","vocabulary":"crossref"},{"role":"conceptualization","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"formal-analysis","vocabulary":"credit"},{"role":"investigation","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"project-administration","vocabulary":"credit"},{"role":"software","vocabulary":"credit"},{"role":"validation","vocabulary":"credit"},{"role":"visualization","vocabulary":"credit"},{"role":"writing-original-draft","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"}]},{"given":"W John","family":"Edmunds","sequence":"first","affiliation":[{"id":[{"id":"https:\/\/ror.org\/00a0jsq62","id-type":"ROR","asserted-by":"publisher"}],"name":"Centre for Mathematical Modelling of Infectious Diseases, London School of Hygiene and Tropical Medicine","place":["London, United Kingdom"]},{"id":[{"id":"https:\/\/ror.org\/00a0jsq62","id-type":"ROR","asserted-by":"publisher"}],"name":"Department of Infectious Disease Epidemiology, London School of Hygiene and Tropical Medicine","place":["London, United Kingdom"]}],"role":[{"role":"author","vocabulary":"crossref"},{"role":"conceptualization","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"funding-acquisition","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"project-administration","vocabulary":"credit"},{"role":"supervision","vocabulary":"credit"},{"role":"validation","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2842-3406","authenticated-orcid":true,"given":"Sebastian","family":"Funk","sequence":"first","affiliation":[{"id":[{"id":"https:\/\/ror.org\/00a0jsq62","id-type":"ROR","asserted-by":"publisher"}],"name":"Centre for Mathematical Modelling of Infectious Diseases, London School of Hygiene and Tropical Medicine","place":["London, United Kingdom"]},{"id":[{"id":"https:\/\/ror.org\/00a0jsq62","id-type":"ROR","asserted-by":"publisher"}],"name":"Department of Infectious Disease Epidemiology, London School of Hygiene and Tropical Medicine","place":["London, United Kingdom"]}],"role":[{"role":"author","vocabulary":"crossref"},{"role":"conceptualization","vocabulary":"credit"},{"role":"data-curation","vocabulary":"credit"},{"role":"funding-acquisition","vocabulary":"credit"},{"role":"methodology","vocabulary":"credit"},{"role":"project-administration","vocabulary":"credit"},{"role":"supervision","vocabulary":"credit"},{"role":"validation","vocabulary":"credit"},{"role":"writing-original-draft","vocabulary":"credit"},{"role":"writing-review-editing","vocabulary":"credit"}]}],"member":"4374","published-online":{"date-parts":[[2025,10,10]]},"reference":[{"key":"bib1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pntd.0004852","type":"journal-article","article-title":"Preparing towards preventing and containing an ebola virus disease outbreak: What socio-cultural practices may affect containment efforts in ghana?","volume":"10","author":"Adongo","year":"2016","journal-title":"PLOS Neglected Tropical Diseases"},{"key":"bib2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1010405","type":"journal-article","article-title":"Comparing human and model-based forecasts of COVID-19 in Germany and Poland","volume":"18","author":"Bosse","year":"2022","journal-title":"PLOS Computational Biology"},{"key":"bib3","doi-asserted-by":"publisher","DOI":"10.12688\/wellcomeopenres.19380.2","type":"journal-article","article-title":"Human judgement forecasting of COVID-19 in the UK","volume":"8","author":"Bosse","year":"2023","journal-title":"Wellcome Open Research"},{"key":"bib4","doi-asserted-by":"publisher","DOI":"10.1186\/s12916-017-0811-y","type":"journal-article","article-title":"Perspectives on model forecasts of the 2014-2015 Ebola epidemic in West Africa: lessons and the way forward","volume":"15","author":"Chowell","year":"2017","journal-title":"BMC Medicine"},{"key":"bib5","type":"software","article-title":"Ebola-expert-interviews","volume-title":"Software Heritage","author":"Epiforecasts","year":"2025","unstructured":"Epiforecasts. 2025a. Ebola-expert-interviews. Software Heritage. swh:1:rev:d7ffd0b965b14046063d88635395a559a76c0875. https:\/\/archive.softwareheritage.org\/swh:1:dir:e3f98bbcbb88dca687c4adce57d0d8b63c6208ed;origin=https:\/\/github.com\/epiforecasts\/Ebola-Expert-Interviews;visit=swh:1:snp:027c8d2bca138b3fb73f34a653cac8d9a4cc34ec;anchor=swh:1:rev:d7ffd0b965b14046063d88635395a559a76c0875."},{"key":"bib6","type":"software","article-title":"EpiCastR","volume-title":"Software Heritage","author":"Epiforecasts","year":"2025","unstructured":"Epiforecasts. 2025b. EpiCastR. Software Heritage. swh:1:rev:355d2da00396379c9432d8e7d2a06ea6c71b29e0. https:\/\/archive.softwareheritage.org\/swh:1:dir:c2e6b31a6945506333be8d30475b6971aa3093f3;origin=https:\/\/github.com\/epiforecasts\/EpiCastR;visit=swh:1:snp:d70653001712e08cbbabd5bc83d9750410bad516;anchor=swh:1:rev:355d2da00396379c9432d8e7d2a06ea6c71b29e0."},{"key":"bib7","type":"software","article-title":"Ebola-expert-elicitation","volume-title":"Software Heritage","author":"Epiforecasts","year":"2025","unstructured":"Epiforecasts. 2025c. Ebola-expert-elicitation. Software Heritage. swh:1:rev:c939519e45576b2ca9bf659b010f1aa8b437790a. https:\/\/archive.softwareheritage.org\/swh:1:dir:2dcea8ee9fc79b3399dd4a29f73222c4a62b6a69;origin=https:\/\/github.com\/epiforecasts\/Ebola-Expert-Elicitation;visit=swh:1:snp:ec7e7192368942ed03b81be6655a5e2baed8f89c;anchor=swh:1:rev:c939519e45576b2ca9bf659b010f1aa8b437790a."},{"key":"bib8","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1005248","type":"journal-article","article-title":"A human judgment approach to epidemiological forecasting","volume":"13","author":"Farrow","year":"2017","journal-title":"PLOS Computational Biology"},{"key":"bib9","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2016.0302","type":"journal-article","article-title":"The impact of control strategies and behavioural changes on the elimination of Ebola from Lofa County, Liberia","volume":"372","author":"Funk","year":"2017","journal-title":"Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences"},{"key":"bib10","type":"web-resource","article-title":"WHO prequalifies Ebola vaccine, paving the way for its use in high-risk countries","author":"In press","year":"2023","unstructured":"In press. 2023a. WHO prequalifies Ebola vaccine, paving the way for its use in high-risk countries. https:\/\/www.who.int\/news\/item\/12-11-2019-who-prequalifies-ebola-vaccine-paving-the-way-for-its-use-in-high-risk-countries [Accessed December 20, 2023]."},{"key":"bib11","type":"web-resource","article-title":"Ebola virus disease","author":"In press","year":"2023","unstructured":"In press. 2023b. Ebola virus disease. https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/ebola-virus-disease [Accessed December 19, 2023]."},{"key":"bib12","doi-asserted-by":"publisher","first-page":"14366","DOI":"10.1073\/pnas.1508814112","type":"journal-article","article-title":"Measuring the impact of Ebola control measures in Sierra Leone","volume":"112","author":"Kucharski","year":"2015","journal-title":"PNAS"},{"key":"bib13","doi-asserted-by":"publisher","first-page":"e569","DOI":"10.1016\/S2589-7500(22)00127-3","type":"journal-article","article-title":"Early human judgment forecasts of human monkeypox, May 2022","volume":"4","author":"McAndrew","year":"2022","journal-title":"The Lancet. Digital Health"},{"key":"bib14","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1010485","type":"journal-article","article-title":"An expert judgment model to predict early stages of the COVID-19 pandemic in the United States","volume":"18","author":"McAndrew","year":"2022","journal-title":"PLOS Computational Biology"},{"key":"bib15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.envsoft.2013.10.010","type":"journal-article","article-title":"A web-based tool for eliciting probability distributions from experts","volume":"52","author":"Morris","year":"2014","journal-title":"Environmental Modelling & Software"},{"key":"bib16","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0250935","type":"journal-article","article-title":"How well did experts and laypeople forecast the size of the COVID-19 pandemic?","volume":"16","author":"Recchia","year":"2021","journal-title":"PLOS ONE"},{"key":"bib17","first-page":"271","type":"journal-article","article-title":"Ebola haemorrhagic fever in Zaire","volume":"56","author":"Report of an International Commission","year":"1978","journal-title":"Bulletin of the World Health Organization"},{"key":"bib18","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.09015","type":"journal-article","article-title":"Ebola virus disease in the Democratic Republic of the Congo, 1976-2014","volume":"4","author":"Rosello","year":"2015","journal-title":"eLife"},{"key":"bib19","volume-title":"Stan Modeling Language User\u2019s Guide and Reference Manual","author":"Stan Team","year":"2012","type":"book"},{"key":"bib20","doi-asserted-by":"publisher","DOI":"10.1016\/j.epidem.2019.100353","type":"journal-article","article-title":"Estimating the impact of violent events on transmission in Ebola virus disease outbreak, Democratic Republic of the Congo, 2018\u20132019","volume":"28","author":"Wannier","year":"2019","journal-title":"Epidemics"},{"key":"bib21","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2021-055596","type":"journal-article","article-title":"Protocol for a phase 3 trial to evaluate the effectiveness and safety of a heterologous, two-dose vaccine for Ebola virus disease in the Democratic Republic of the Congo","volume":"12","author":"Watson-Jones","year":"2022","journal-title":"BMJ Open"},{"key":"bib22","type":"web-resource","article-title":"Outbreaks and Emergencies Bulletin","author":"WHO Regional Office for Africa","year":"2020","unstructured":"WHO Regional Office for Africa. 2020. Outbreaks and Emergencies Bulletin. https:\/\/www.afro.who.int\/health-topics\/disease-outbreaks\/outbreaks-and-other-emergencies-updates [Accessed January 27, 2020]."},{"key":"bib23","doi-asserted-by":"publisher","DOI":"10.1371\/journal.ppat.1010078","type":"journal-article","article-title":"Current state of Ebola virus vaccines: A snapshot","volume":"17","author":"Woolsey","year":"2021","journal-title":"PLOS Pathogens"},{"key":"dataset1","type":"dataset","article-title":"DRC Health Data Ebola 2018","volume-title":"Humanitarian Data Exchange (HDX)","author":"World Health Organization","year":"2019","unstructured":"World Health Organization. 2019. DRC Health Data Ebola 2018. Humanitarian Data Exchange (HDX). https:\/\/data.humdata.org\/dataset\/ebola-cases-and-deaths-drc-north-kivu. ebola-cases-and-deaths-drc-north-kivu."}],"container-title":["eLife"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/cdn.elifesciences.org\/articles\/98005\/elife-98005-v2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/cdn.elifesciences.org\/articles\/98005\/elife-98005-v2.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/elifesciences.org\/articles\/98005","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,24]],"date-time":"2026-08-24T09:22:39Z","timestamp":1787563359000},"score":1,"resource":{"primary":{"URL":"https:\/\/elifesciences.org\/articles\/98005"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,10]]},"references-count":24,"alternative-id":["10.7554\/eLife.98005"],"URL":"https:\/\/doi.org\/10.7554\/elife.98005","archive":["CLOCKSS"],"relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2024.03.14.24304285","asserted-by":"subject"}],"references":[{"id-type":"accession","id":"ebola-cases-and-deaths-drc-north-kivu","asserted-by":"subject"}],"is-same-as":[{"id-type":"doi","id":"10.7554\/eLife.98005.3","asserted-by":"subject"}],"is-version-of":[{"id-type":"doi","id":"10.7554\/eLife.98005.1","asserted-by":"subject"},{"id-type":"doi","id":"10.7554\/eLife.98005.2","asserted-by":"subject"}],"is-financed-by":[{"id-type":"doi","id":"10.35802\/210758","asserted-by":"subject"},{"id-type":"doi","id":"10.35802\/210758","asserted-by":"object"}],"is-supplemented-by":[{"id-type":"uri","id":"https:\/\/archive.softwareheritage.org\/swh:1:dir:e3f98bbcbb88dca687c4adce57d0d8b63c6208ed;origin=https:\/\/github.com\/epiforecasts\/Ebola-Expert-Interviews;visit=swh:1:snp:027c8d2bca138b3fb73f34a653cac8d9a4cc34ec;anchor=swh:1:rev:d7ffd0b965b14046063d88635395a559a76c0875","asserted-by":"subject"},{"id-type":"uri","id":"https:\/\/archive.softwareheritage.org\/swh:1:dir:c2e6b31a6945506333be8d30475b6971aa3093f3;origin=https:\/\/github.com\/epiforecasts\/EpiCastR;visit=swh:1:snp:d70653001712e08cbbabd5bc83d9750410bad516;anchor=swh:1:rev:355d2da00396379c9432d8e7d2a06ea6c71b29e0","asserted-by":"subject"},{"id-type":"uri","id":"https:\/\/archive.softwareheritage.org\/swh:1:dir:2dcea8ee9fc79b3399dd4a29f73222c4a62b6a69;origin=https:\/\/github.com\/epiforecasts\/Ebola-Expert-Elicitation;visit=swh:1:snp:ec7e7192368942ed03b81be6655a5e2baed8f89c;anchor=swh:1:rev:c939519e45576b2ca9bf659b010f1aa8b437790a","asserted-by":"subject"}]},"ISSN":["2050-084X"],"issn-type":[{"value":"2050-084X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,10]]},"assertion":[{"value":"single anonymised","name":"peer_review_transparency","label":"Peer review transparency","group":{"name":"peer_review_taxonomy"}},{"value":"other reviewer(s), editor","name":"peer_review_interaction","label":"Peer review interaction","group":{"name":"peer_review_taxonomy"}},{"value":"review summaries, review reports, author\/editor communication, reviewer identities reviewer opt in, editor identities","name":"peer_review_published","label":"Peer review published","group":{"name":"peer_review_taxonomy"}},{"value":"open (sign in with ORCID iD required)","name":"post_publication_commenting","label":"Post publication commenting","group":{"name":"post_publication_commenting"}}],"article-number":"RP98005"}}