{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,27]],"date-time":"2026-02-27T04:13:21Z","timestamp":1772165601584,"version":"3.50.1"},"reference-count":60,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,2,14]],"date-time":"2021-02-14T00:00:00Z","timestamp":1613260800000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2021,2,14]],"date-time":"2021-02-14T00:00:00Z","timestamp":1613260800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Res Methodol"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Ensemble modeling aims to boost the forecasting performance by systematically integrating the predictive accuracy across individual models. Here we introduce a simple-yet-powerful ensemble methodology for forecasting the trajectory of dynamic growth processes that are defined by a system of non-linear differential equations with applications to infectious disease spread.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>\n                      We propose and assess the performance of two ensemble modeling schemes with different parametric bootstrapping procedures for trajectory forecasting and uncertainty quantification. Specifically, we conduct sequential probabilistic forecasts to evaluate their forecasting performance using simple dynamical growth models with good track records including the Richards model, the generalized-logistic growth model, and the Gompertz model. We first test and verify the functionality of the method using simulated data from phenomenological models and a mechanistic transmission model. Next, the performance of the method is demonstrated using a diversity of epidemic datasets including scenario outbreak data of the\n                      <jats:italic>Ebola Forecasting Challenge<\/jats:italic>\n                      and real-world epidemic data outbreaks of including influenza, plague, Zika, and COVID-19.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We found that the ensemble method that randomly selects a model from the set of individual models for each time point of the trajectory of the epidemic frequently outcompeted the individual models as well as an alternative ensemble method based on the weighted combination of the individual models and yields broader and more realistic uncertainty bounds for the trajectory envelope, achieving not only better coverage rate of the 95% prediction interval but also improved mean interval scores across a diversity of epidemic datasets.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Our new methodology for ensemble forecasting outcompete component models and an alternative ensemble model that differ in how the variance is evaluated for the generation of the prediction intervals of the forecasts.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12874-021-01226-9","type":"journal-article","created":{"date-parts":[[2021,2,14]],"date-time":"2021-02-14T19:06:42Z","timestamp":1613329602000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Ensemble bootstrap methodology for forecasting dynamic growth processes using differential equations: application to epidemic outbreaks"],"prefix":"10.1186","volume":"21","author":[{"given":"Gerardo","family":"Chowell","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ruiyan","family":"Luo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,2,14]]},"reference":[{"issue":"1","key":"1226_CR1","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1186\/s12879-018-3124-7","volume":"18","author":"SY Del Valle","year":"2018","unstructured":"Del Valle SY, McMahon BH, Asher J, Hatchett R, Lega JC, Brown HE, Leany ME, Pantazis Y, Roberts DJ, Moore S, et al. Summary results of the 2014-2015 DARPA Chikungunya challenge. BMC Infect Dis. 2018;18(1):245.","journal-title":"BMC Infect Dis"},{"issue":"1","key":"1226_CR2","doi-asserted-by":"publisher","first-page":"683","DOI":"10.1038\/s41598-018-36361-9","volume":"9","author":"CJ McGowan","year":"2019","unstructured":"McGowan CJ, Biggerstaff M, Johansson M, Apfeldorf KM, Ben-Nun M, Brooks L, Convertino M, Erraguntla M, Farrow DC, Freeze J, et al. Collaborative efforts to forecast seasonal influenza in the United States, 2015-2016. Sci Rep. 2019;9(1):683.","journal-title":"Sci Rep"},{"issue":"48","key":"1226_CR3","doi-asserted-by":"publisher","first-page":"24268","DOI":"10.1073\/pnas.1909865116","volume":"116","author":"MA Johansson","year":"2019","unstructured":"Johansson MA, Apfeldorf KM, Dobson S, Devita J, Buczak AL, Baugher B, Moniz LJ, Bagley T, Babin SM, Guven E, et al. An open challenge to advance probabilistic forecasting for dengue epidemics. Proc Natl Acad Sci U S A. 2019;116(48):24268\u201374.","journal-title":"Proc Natl Acad Sci U S A"},{"key":"1226_CR4","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1016\/j.epidem.2017.08.002","volume":"22","author":"C Viboud","year":"2018","unstructured":"Viboud C, Sun K, Gaffey R, Ajelli M, Fumanelli L, Merler S, Zhang Q, Chowell G, Simonsen L, Vespignani A, et al. The RAPIDD ebola forecasting challenge: synthesis and lessons learnt. Epidemics. 2018;22:13\u201321.","journal-title":"Epidemics"},{"key":"1226_CR5","doi-asserted-by":"publisher","first-page":"e09186","DOI":"10.7554\/eLife.09186","volume":"4","author":"JP Chretien","year":"2015","unstructured":"Chretien JP, Riley S, George DB. Mathematical modeling of the West Africa Ebola epidemic. eLife. 2015;4:e09186.","journal-title":"eLife"},{"key":"1226_CR6","doi-asserted-by":"crossref","unstructured":"Chowell G, Simonsen L, Viboud C, Kuang Y. Is West Africa Approaching a Catastrophic Phase or is the 2014 Ebola epidemic slowing down? Different models yield different answers for Liberia. PLoS Curr. 2014;6.","DOI":"10.1371\/currents.outbreaks.b4690859d91684da963dc40e00f3da81"},{"issue":"169","key":"1226_CR7","doi-asserted-by":"publisher","first-page":"20200447","DOI":"10.1098\/rsif.2020.0447","volume":"17","author":"K Roosa","year":"2020","unstructured":"Roosa K, Tariq A, Yan P, Hyman JM, Chowell G. Multi-model forecasts of the ongoing Ebola epidemic in the Democratic Republic of Congo, March\u2013October 2019. J R Soc Interface. 2020;17(169):20200447.","journal-title":"J R Soc Interface"},{"key":"1226_CR8","first-page":"256","volume":"5","author":"K Roosa","year":"2020","unstructured":"Roosa K, Lee Y, Luo R, Kirpich A, Rothenberg R, Hyman JM, Yan P, Chowell G. Real-time forecasts of the COVID-19 epidemic in China from February 5th to February 24th, 2020. Infect Dis Model. 2020;5:256\u201363.","journal-title":"Infect Dis Model"},{"key":"1226_CR9","doi-asserted-by":"crossref","unstructured":"Roosa K, Lee Y, Luo R, Kirpich A, Rothenberg R, Hyman JM, Yan P, Chowell G. Short-term Forecasts of the COVID-19 Epidemic in Guangdong and Zhejiang, China: February 13-23, 2020. J Clin Med. 2020;9(2).","DOI":"10.3390\/jcm9020596"},{"key":"1226_CR10","unstructured":"Influenza Forecasting Center of Excellence. COVID-19 Forecast Hub [https:\/\/github.com\/reichlab\/covid19-forecast-hub]. Accessed 5 Aug 2020."},{"key":"1226_CR11","unstructured":"COVID-19 mortality projections [https:\/\/covid19.healthdata.org\/global?view=total-deaths&tab=trend]. Accessed 5 Aug 2020."},{"key":"1226_CR12","doi-asserted-by":"crossref","unstructured":"Ray EL, Wattanachit N, Niemi J, Kanji AH, House K, Cramer EY, Bracher J, Zheng A, Yamana TK, Xiong X. Ensemble Forecasts of Coronavirus Disease 2019 (COVID-19) in the U.S. medRxiv. 2020.","DOI":"10.1101\/2020.08.19.20177493"},{"issue":"2","key":"1226_CR13","doi-asserted-by":"publisher","first-page":"e1006785","DOI":"10.1371\/journal.pcbi.1006785","volume":"15","author":"S Funk","year":"2019","unstructured":"Funk S, Camacho A, Kucharski AJ, Lowe R, Eggo RM, Edmunds WJ. Assessing the performance of real-time epidemic forecasts: a case study of Ebola in the Western area region of Sierra Leone, 2014-15. PLoS Comput Biol. 2019;15(2):e1006785.","journal-title":"PLoS Comput Biol"},{"issue":"2","key":"1226_CR14","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1111\/j.1467-9868.2007.00587.x","volume":"69","author":"TBF Gneiting","year":"2007","unstructured":"Gneiting TBF, Raftery AE. Probabilistic forecasts, calibration and sharpness. J Royal Stat Soc. 2007;69(2):243\u201368. https:\/\/doi.org\/10.1111\/j.1467-9868.2007.00587.x.","journal-title":"J Royal Stat Soc"},{"key":"1226_CR15","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.epidem.2017.02.014","volume":"18","author":"TD Hollingsworth","year":"2017","unstructured":"Hollingsworth TD, Medley GF. Learning from multi-model comparisons: collaboration leads to insights, but limitations remain. Epidemics. 2017;18:1\u20133.","journal-title":"Epidemics"},{"issue":"1857","key":"1226_CR16","first-page":"2053","volume":"365","author":"C Tebaldi","year":"2007","unstructured":"Tebaldi C, Knutti R. The use of the multi-model ensemble in probabilistic climate projections. Philos Trans A Math Phys Eng Sci. 2007;365(1857):2053\u201375.","journal-title":"Philos Trans A Math Phys Eng Sci"},{"issue":"5","key":"1226_CR17","doi-asserted-by":"publisher","first-page":"1155","DOI":"10.1175\/MWR2906.1","volume":"133","author":"AE Raftery","year":"2005","unstructured":"Raftery AE, Gneiting T, Balabdaoui F, Polakowski M. Using Bayesian model averaging to calibrate forecast ensembles. Mon Weather Rev. 2005;133(5):1155\u201374.","journal-title":"Mon Weather Rev"},{"key":"1226_CR18","volume-title":"Uncertainty quantification: theory, implementation, and applications","author":"RC Smith","year":"2014","unstructured":"Smith RC. Uncertainty quantification: theory, implementation, and applications. Philadelphia: SIAM; 2014."},{"key":"1226_CR19","volume-title":"The Elements of Statistical Learning : Data Mining, Inference, and Prediction","author":"J Friedman","year":"2009","unstructured":"Friedman J, Hastie T, Tibshirani R. The Elements of Statistical Learning : Data Mining, Inference, and Prediction. New York: Springer-Verlag New York; 2009."},{"issue":"8","key":"1226_CR20","doi-asserted-by":"publisher","first-page":"3146","DOI":"10.1073\/pnas.1812594116","volume":"116","author":"NG Reich","year":"2019","unstructured":"Reich NG, Brooks LC, Fox SJ, Kandula S, McGowan CJ, Moore E, Osthus D, Ray EL, Tushar A, Yamana TK, et al. A collaborative multiyear, multimodel assessment of seasonal influenza forecasting in the United States. Proc Natl Acad Sci U S A. 2019;116(8):3146\u201354.","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"11","key":"1226_CR21","doi-asserted-by":"publisher","first-page":"2313","DOI":"10.1017\/S0950268817001078","volume":"145","author":"CR Sebrango-Rodriguez","year":"2017","unstructured":"Sebrango-Rodriguez CR, Martinez-Bello DA, Sanchez-Valdes L, Thilakarathne PJ, Del Fava E, van der Stuyft P, Lopez-Quilez A, Shkedy Z. Real-time parameter estimation of Zika outbreaks using model averaging. Epidemiol Infect. 2017;145(11):2313\u201323.","journal-title":"Epidemiol Infect"},{"key":"1226_CR22","doi-asserted-by":"crossref","unstructured":"Vrugt JA, ter Braak CJF, Clark MP, Hyman JM, Robinson BA. Treatment of input uncertainty in hydrologic modeling: doing hydrology backward with Markov chain Monte Carlo simulation. Water Resour Res. 2008;44.","DOI":"10.1029\/2007WR006720"},{"issue":"5","key":"1226_CR23","doi-asserted-by":"publisher","first-page":"1371","DOI":"10.1016\/j.advwatres.2006.11.014","volume":"30","author":"QY Duan","year":"2007","unstructured":"Duan QY, Ajami NK, Gao XG, Sorooshian S. Multi-model ensemble hydrologic prediction using Bayesian model averaging. Adv Water Resour. 2007;30(5):1371\u201386.","journal-title":"Adv Water Resour"},{"issue":"15","key":"1226_CR24","doi-asserted-by":"publisher","first-page":"4202","DOI":"10.1175\/2010JCLI3208.1","volume":"23","author":"AE Jones","year":"2010","unstructured":"Jones AE, Morse AP. Application and validation of a seasonal ensemble prediction system using a dynamic malaria model. J Clim. 2010;23(15):4202\u201315.","journal-title":"J Clim"},{"issue":"4","key":"1226_CR25","doi-asserted-by":"publisher","first-page":"e1004187","DOI":"10.1371\/journal.pcbi.1004187","volume":"11","author":"T Lindstrom","year":"2015","unstructured":"Lindstrom T, Tildesley M, Webb C. A Bayesian ensemble approach for epidemiological projections. PLoS Comput Biol. 2015;11(4):e1004187.","journal-title":"PLoS Comput Biol"},{"issue":"50","key":"1226_CR26","doi-asserted-by":"publisher","first-page":"20425","DOI":"10.1073\/pnas.1208772109","volume":"109","author":"J Shaman","year":"2012","unstructured":"Shaman J, Karspeck A. Forecasting seasonal outbreaks of influenza. Proc Natl Acad Sci U S A. 2012;109(50):20425\u201330.","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"123","key":"1226_CR27","doi-asserted-by":"publisher","first-page":"20160410","DOI":"10.1098\/rsif.2016.0410","volume":"13","author":"TK Yamana","year":"2016","unstructured":"Yamana TK, Kandula S, Shaman J. Superensemble forecasts of dengue outbreaks. J R Soc Interface. 2016;13(123):20160410.","journal-title":"J R Soc Interface"},{"issue":"6","key":"1226_CR28","doi-asserted-by":"publisher","first-page":"e1006134","DOI":"10.1371\/journal.pcbi.1006134","volume":"14","author":"LC Brooks","year":"2018","unstructured":"Brooks LC, Farrow DC, Hyun S, Tibshirani RJ, Rosenfeld R. Nonmechanistic forecasts of seasonal influenza with iterative one-week-ahead distributions. PLoS Comput Biol. 2018;14(6):e1006134.","journal-title":"PLoS Comput Biol"},{"issue":"1","key":"1226_CR29","doi-asserted-by":"publisher","first-page":"e1001157","DOI":"10.1371\/journal.pmed.1001157","volume":"9","author":"T Smith","year":"2012","unstructured":"Smith T, Ross A, Maire N, Chitnis N, Studer A, Hardy D, Brooks A, Penny M, Tanner M. Ensemble modeling of the likely public health impact of a pre-erythrocytic malaria vaccine. PLoS Med. 2012;9(1):e1001157.","journal-title":"PLoS Med"},{"key":"1226_CR30","doi-asserted-by":"publisher","first-page":"100379","DOI":"10.1016\/j.epidem.2019.100379","volume":"30","author":"G Chowell","year":"2019","unstructured":"Chowell G, Luo R, Sun K, Roosa K, Tariq A, Viboud C. Real-time forecasting of epidemic trajectories using computational dynamic ensembles. Epidemics. 2019;30:100379.","journal-title":"Epidemics"},{"key":"1226_CR31","doi-asserted-by":"crossref","unstructured":"Novaes de Amorim A, Deardon R, Saini V. A stacked ensemble method for forecasting influenza-like illness visit volumes at emergency departments. BioRxiv. 2020.","DOI":"10.1101\/2020.10.21.348417"},{"key":"1226_CR32","doi-asserted-by":"crossref","unstructured":"Kim J-S, Kavak H, Z\u00fcfle A, Anderson T. COVID-19 ensemble models using representative clustering. SIGSPATIAL Special. 2020;12(2).","DOI":"10.1145\/3431843.3431848"},{"issue":"2","key":"1226_CR33","doi-asserted-by":"publisher","first-page":"e1005910","DOI":"10.1371\/journal.pcbi.1005910","volume":"14","author":"EL Ray","year":"2018","unstructured":"Ray EL, Reich NG. Prediction of infectious disease epidemics via weighted density ensembles. PLoS Comput Biol. 2018;14(2):e1005910.","journal-title":"PLoS Comput Biol"},{"issue":"3","key":"1226_CR34","first-page":"379","volume":"2","author":"G Chowell","year":"2017","unstructured":"Chowell G. Fitting dynamic models to epidemic outbreaks with quantified uncertainty: a primer for parameter uncertainty, identifiability, and forecasts. Infect Dis Model. 2017;2(3):379\u201398.","journal-title":"Infect Dis Model"},{"key":"1226_CR35","doi-asserted-by":"publisher","DOI":"10.1201\/b16760","volume-title":"Modeling and inverse problems in the presence of uncertainty: CRC Press","author":"HT Banks","year":"2014","unstructured":"Banks HT, Hu S, Thompson WC. Modeling and inverse problems in the presence of uncertainty: CRC Press; 2014."},{"issue":"5","key":"1226_CR36","doi-asserted-by":"publisher","first-page":"4299","DOI":"10.3934\/mbe.2019214","volume":"16","author":"K Roosa","year":"2019","unstructured":"Roosa K, Luo R, Chowell G. Comparative assessment of parameter estimation methods in the presence of overdispersion: a simulation study. Math Biosci Eng. 2019;16(5):4299\u2013313.","journal-title":"Math Biosci Eng"},{"key":"1226_CR37","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1016\/S0022-2496(02)00028-7","volume":"47","author":"IJ Myung","year":"2003","unstructured":"Myung IJ. Tutorial on maximum likelihood estimation. J Math Pyschol. 2003;47:90\u2013100.","journal-title":"J Math Pyschol"},{"key":"1226_CR38","volume-title":"Statistical Inference: Maximum Likelihood Estimation","author":"K Kashin","year":"2014","unstructured":"Kashin K. Statistical Inference: Maximum Likelihood Estimation; 2014."},{"key":"1226_CR39","doi-asserted-by":"crossref","unstructured":"Chowell G, Hincapie-Palacio D, Ospina J, Pell B, Tariq A, Dahal S, Moghadas S, Smirnova A, Simonsen L, Viboud C. Using phenomenological models to characterize transmissibility and forecast patterns and final burden of Zika epidemics. PLoS Curr. 2016;8.","DOI":"10.1371\/currents.outbreaks.f14b2217c902f453d9320a43a35b9583"},{"issue":"1","key":"1226_CR40","doi-asserted-by":"publisher","first-page":"344","DOI":"10.1186\/s13071-019-3602-9","volume":"12","author":"S Zhao","year":"2019","unstructured":"Zhao S, Musa SS, Fu H, He D, Qin J. Simple framework for real-time forecast in a data-limited situation: the Zika virus (ZIKV) outbreaks in Brazil from 2015 to 2016 as an example. Parasit Vectors. 2019;12(1):344.","journal-title":"Parasit Vectors"},{"key":"1226_CR41","doi-asserted-by":"publisher","DOI":"10.6084\/m9.figshare.8867882","volume-title":"A novel sub-epidemic modeling framework for short-term forecasting epidemic waves: Datasets and fitting code. figshare","author":"G Chowell","year":"2019","unstructured":"Chowell G, Tariq A, Hyman JM. A novel sub-epidemic modeling framework for short-term forecasting epidemic waves: Datasets and fitting code. figshare; 2019. Available from. https:\/\/doi.org\/10.6084\/m9.figshare.8867882."},{"issue":"1","key":"1226_CR42","doi-asserted-by":"publisher","first-page":"164","DOI":"10.1186\/s12916-019-1406-6","volume":"17","author":"G Chowell","year":"2019","unstructured":"Chowell G, Tariq A, Hyman JM. A novel sub-epidemic modeling framework for short-term forecasting epidemic waves. BMC Med. 2019;17(1):164.","journal-title":"BMC Med"},{"key":"1226_CR43","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1016\/j.epidem.2016.11.002","volume":"22","author":"B Pell","year":"2018","unstructured":"Pell B, Kuang Y, Viboud C, Chowell G. Using phenomenological models for forecasting the 2015 Ebola challenge. Epidemics. 2018;22:62\u201370.","journal-title":"Epidemics"},{"key":"1226_CR44","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.jtbi.2012.07.024","volume":"313","author":"XS Wang","year":"2012","unstructured":"Wang XS, Wu J, Yang Y. Richards model revisited: validation by and application to infection dynamics. J Theor Biol. 2012;313:12\u20139.","journal-title":"J Theor Biol"},{"issue":"2","key":"1226_CR45","doi-asserted-by":"publisher","first-page":"290","DOI":"10.1093\/jxb\/10.2.290","volume":"10","author":"FJ Richards","year":"1959","unstructured":"Richards FJ. A flexible growth function for empirical use. J Exp Bot. 1959;10(2):290\u2013301.","journal-title":"J Exp Bot"},{"issue":"1","key":"1226_CR46","doi-asserted-by":"publisher","first-page":"122","DOI":"10.3201\/eid1201.050396","volume":"12","author":"YH Hsieh","year":"2006","unstructured":"Hsieh YH, Cheng YS. Real-time forecast of multiphase outbreak. Emerg Infect Dis. 2006;12(1):122\u20137.","journal-title":"Emerg Infect Dis"},{"key":"1226_CR47","doi-asserted-by":"crossref","unstructured":"Harvey A, Kattuman P. Time series models based on growth curves with applications to forecasting coronavirus. Harvard Data Sci Rev. 2020. Retrieved from https:\/\/hdsr.mitpress.mit.edu\/pub\/ozgjx0yn.","DOI":"10.1162\/99608f92.828f40de"},{"key":"1226_CR48","doi-asserted-by":"publisher","first-page":"109946","DOI":"10.1016\/j.chaos.2020.109946","volume":"138","author":"O Torrealba-Rodriguez","year":"2020","unstructured":"Torrealba-Rodriguez O, Conde-Gutierrez RA, Hernandez-Javier AL. Modeling and prediction of COVID-19 in Mexico applying mathematical and computational models. Chaos Solitons Fractals. 2020;138:109946.","journal-title":"Chaos Solitons Fractals"},{"issue":"477","key":"1226_CR49","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1198\/016214506000001437","volume":"102","author":"T Gneiting","year":"2007","unstructured":"Gneiting T, Raftery AE. Strictly proper scoring rules, prediction, and estimation. J Am Stat Assoc. 2007;102(477):359\u201378.","journal-title":"J Am Stat Assoc"},{"key":"1226_CR50","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-6849-3","volume-title":"Applied predictive modeling","author":"M Kuhn","year":"2013","unstructured":"Kuhn M, Johnson K. Applied predictive modeling, vol. 26. New York: Springer; 2013."},{"key":"1226_CR51","unstructured":"Competitor\u2019s Guide: Prizes and Rules. [https:\/\/www.m4.unic.ac.cy\/wp-content\/uploads\/2018\/03\/M4-Competitors-Guide.pdf]. Accessed 5 Aug 2020."},{"key":"1226_CR52","unstructured":"M4Competition. Competitor\u2019s Guide: Prizes and Rules. Available from: https:\/\/www.m4.unic.ac.cy\/wp-content\/uploads\/2018\/03\/M4-Competitors-Guide.pdf (Accessed 04 Jan 2019)."},{"issue":"5","key":"1226_CR53","doi-asserted-by":"publisher","first-page":"4250","DOI":"10.3934\/mbe.2019212","volume":"16","author":"R Burger","year":"2019","unstructured":"Burger R, Chowell G, Lara-Diiaz LY. Comparative analysis of phenomenological growth models applied to epidemic outbreaks. Math Biosci Eng. 2019;16(5):4250\u201373.","journal-title":"Math Biosci Eng"},{"key":"1226_CR54","doi-asserted-by":"crossref","unstructured":"Ajelli M, Zhang Q, Sun K, Merler S, Fumanelli L, Chowell G, Simonsen L, Viboud C, Vespignani A. The RAPIDD Ebola forecasting challenge: model description and synthetic data generation. Epidemics. 2018;22:3\u201312.","DOI":"10.1016\/j.epidem.2017.09.001"},{"key":"1226_CR55","unstructured":"Outbreak datasets. GitHub Repository. Available from: https:\/\/github.com\/gchowell\/outbreak_datasets. Accessed 5 Aug 2020."},{"issue":"12","key":"1226_CR56","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1098\/rsif.2006.0161","volume":"4","author":"G Chowell","year":"2007","unstructured":"Chowell G, Nishiura H, Bettencourt LM. Comparative estimation of the reproduction number for pandemic influenza from daily case notification data. J R Soc Interface. 2007;4(12):155\u201366.","journal-title":"J R Soc Interface"},{"key":"1226_CR57","doi-asserted-by":"publisher","first-page":"537","DOI":"10.1186\/1756-0500-4-537","volume":"4","author":"LC Mostaco-Guidolin","year":"2011","unstructured":"Mostaco-Guidolin LC, Greer A, Sander B, Wu J, Moghadas SM. Variability in transmissibility of the 2009 H1N1 pandemic in Canadian communities. BMC Res Notes. 2011;4:537.","journal-title":"BMC Res Notes"},{"key":"1226_CR58","unstructured":"Plague \u2013 Madagascar [https:\/\/www.who.int\/csr\/don\/27-november-2017-plague-madagascar\/en\/]. Accessed 5 Aug 2020."},{"issue":"5","key":"1226_CR59","doi-asserted-by":"crossref","first-page":"301","DOI":"10.47102\/annals-acadmedsg.V35N5p301","volume":"35","author":"KT Goh","year":"2006","unstructured":"Goh KT, Cutter J, Heng BH, Ma S, Koh BK, Kwok C, Toh CM, Chew SK. Epidemiology and control of SARS in Singapore. Ann Acad Med Singap. 2006;35(5):301\u201316.","journal-title":"Ann Acad Med Singap"},{"key":"1226_CR60","unstructured":"Reported Cases of 2019-nCoV [https:\/\/ncov.dxy.cn\/ncovh5\/view\/pneumonia?from=groupmessage&isappinstalled=0]. Accessed 5 Aug 2020."}],"container-title":["BMC Medical Research Methodology"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-021-01226-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12874-021-01226-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-021-01226-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,21]],"date-time":"2023-10-21T02:10:58Z","timestamp":1697854258000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedresmethodol.biomedcentral.com\/articles\/10.1186\/s12874-021-01226-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,14]]},"references-count":60,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["1226"],"URL":"https:\/\/doi.org\/10.1186\/s12874-021-01226-9","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-117201\/v1","asserted-by":"object"}]},"ISSN":["1471-2288"],"issn-type":[{"value":"1471-2288","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,14]]},"assertion":[{"value":"27 November 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 January 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 February 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"Not applicable.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"None.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"34"}}