{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T17:02:40Z","timestamp":1778605360202,"version":"3.51.4"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1013647","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2025,11,11]],"date-time":"2025-11-11T00:00:00Z","timestamp":1762819200000}}],"reference-count":37,"publisher":"Public Library of Science (PLoS)","issue":"11","license":[{"start":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T00:00:00Z","timestamp":1762214400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000030","name":"Centers for Disease Control and Prevention","doi-asserted-by":"publisher","award":["200-2016-91779"],"award-info":[{"award-number":["200-2016-91779"]}],"id":[{"id":"10.13039\/100000030","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:sec id=\"sec001\">\n                    <jats:title>Objective\/Background<\/jats:title>\n                    <jats:p>Transmission-dynamic models are commonly used to study infectious disease epidemiology. Calibration involves identifying model parameter values that align model outputs with observed data or other evidence. Inaccurate calibration and inconsistent reporting produce inference errors and limit reproducibility, compromising confidence in the validity of modeled results. No standardized framework exists for reporting on calibration of infectious disease models, and an understanding of current calibration approaches is lacking.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec002\">\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We developed the Purpose-Inputs-Process-Outputs (PIPO) framework for reporting calibration practices and applied it in a scoping review to assess calibration approaches and evaluate reporting comprehensiveness in transmission-dynamic models of tuberculosis, HIV and malaria published between January 1, 2018, and January 16, 2024. We searched relevant databases and websites to identify eligible publications, including peer-reviewed studies where these models were calibrated to empirical data or published estimates.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec003\">\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We identified 411 eligible studies encompassing 419 models, with 74% (n\u2009=\u2009309) being compartmental models and 20% (n\u2009=\u200981) individual-based models (IBMs). The predominant analytical purpose was to evaluate interventions (71% of models, n\u2009=\u2009298). Parameters were calibrated mainly because they were unknown or ambiguous (40%, n\u2009=\u2009168), or because determining their value was relevant to the scientific question beyond being necessary to run the model (20%, n\u2009=\u200985). The choice of calibration method was significantly associated with model structure (p-value&lt;0.001) and stochasticity (p-value\u2009=\u20090.006), with approximate Bayesian computation more frequently used with IBMs and Markov-Chain Monte Carlo with compartmental models. Regarding reporting comprehensiveness, all PIPO framework items were reported in 4% (n\u2009=\u200918) of models; 11\u201314 items in 66% (n\u2009=\u2009277), and 10 or fewer items in 28% (n\u2009=\u2009124). Implementation code was the least reported, available in only 20% (n\u2009=\u200982) of models.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec id=\"sec004\">\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Reporting on calibration is heterogeneous in recent infectious disease modeling literature. Our proposed framework for reporting of calibration approaches could support improved reproducibility and credibility of modeled analyses.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1371\/journal.pcbi.1013647","type":"journal-article","created":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T18:37:31Z","timestamp":1762281451000},"page":"e1013647","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":1,"title":["Calibration of transmission-dynamic infectious disease models: A scoping review and reporting framework"],"prefix":"10.1371","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3084-5915","authenticated-orcid":true,"given":"Emmanuelle A.","family":"Dankwa","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"L\u00e9a","family":"Cavalli","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ruchita","family":"Balasubramanian","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6810-0356","authenticated-orcid":true,"given":"Melike Hazal","family":"Can","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5734-825X","authenticated-orcid":true,"given":"Hening","family":"Cui","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Katherine M.","family":"Jia","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yunfei","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sylvia K.","family":"Ofori","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicole A.","family":"Swartwood","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carrie G.","family":"Wade","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Caroline O.","family":"Buckee","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeffrey W.","family":"Imai-Eaton","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2571-016X","authenticated-orcid":true,"given":"Nicolas A.","family":"Menzies","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"340","published-online":{"date-parts":[[2025,11,4]]},"reference":[{"issue":"1829","key":"pcbi.1013647.ref001","doi-asserted-by":"crossref","first-page":"20210001","DOI":"10.1098\/rstb.2021.0001","article-title":"Modelling that shaped the early COVID-19 pandemic response in the UK","volume":"376","author":"E Brooks-Pollock","year":"2021","journal-title":"Philos Trans R Soc Lond B Biol Sci"},{"key":"pcbi.1013647.ref002","unstructured":"Centers for Disease Control and Prevention. COVID-19 Forecasting and Mathematical Modeling [WWW Document]. Centers for Disease Control and Prevention. 2020. Accessed 2023 December 15. URL https:\/\/www.cdc.gov\/coronavirus\/2019-ncov\/science\/forecasting\/forecasting-math-modeling.html"},{"issue":"5","key":"pcbi.1013647.ref003","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1177\/0272989X06290485","article-title":"Impact of model, methodological, and parameter uncertainty in the economic analysis of vaccination programs","volume":"26","author":"M Brisson","year":"2006","journal-title":"Med Decis Making"},{"key":"pcbi.1013647.ref004","doi-asserted-by":"crossref","first-page":"100643","DOI":"10.1016\/j.epidem.2022.100643","article-title":"Structural identifiability of compartmental models for infectious disease transmission is influenced by data type","volume":"41","author":"EA Dankwa","year":"2022","journal-title":"Epidemics"},{"key":"pcbi.1013647.ref005","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1016\/j.jtbi.2012.12.021","article-title":"Identifiability and estimation of multiple transmission pathways in cholera and waterborne disease","volume":"324","author":"MC Eisenberg","year":"2013","journal-title":"J Theor Biol"},{"key":"pcbi.1013647.ref006","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.epidem.2018.05.010","article-title":"Practical unidentifiability of a simple vector-borne disease model: Implications for parameter estimation and intervention assessment","volume":"25","author":"Y-H Kao","year":"2018","journal-title":"Epidemics"},{"key":"pcbi.1013647.ref007","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.mbs.2018.02.004","article-title":"Structural and practical identifiability analysis of outbreak models","volume":"299","author":"N Tuncer","year":"2018","journal-title":"Math Biosci"},{"issue":"3","key":"pcbi.1013647.ref008","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1010856","article-title":"An implementation framework to improve the transparency and reproducibility of computational models of infectious diseases","volume":"19","author":"D Pokutnaya","year":"2023","journal-title":"PLoS Comput Biol"},{"issue":"6","key":"pcbi.1013647.ref009","doi-asserted-by":"crossref","first-page":"835","DOI":"10.1016\/j.jval.2012.04.014","article-title":"Model parameter estimation and uncertainty: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force--6","volume":"15","author":"AH Briggs","year":"2012","journal-title":"Value Health"},{"issue":"3","key":"pcbi.1013647.ref010","first-page":"379","article-title":"Fitting dynamic models to epidemic outbreaks with quantified uncertainty: A Primer for parameter uncertainty, identifiability, and forecasts","volume":"2","author":"G Chowell","year":"2017","journal-title":"Infect Dis Model"},{"issue":"5","key":"pcbi.1013647.ref011","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1007893","article-title":"Calibration of individual-based models to epidemiological data: A systematic review","volume":"16","author":"CM Hazelbag","year":"2020","journal-title":"PLoS Comput Biol"},{"issue":"2","key":"pcbi.1013647.ref012","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1177\/0272989X13493143","article-title":"Calibration of complex models through Bayesian evidence synthesis: a demonstration and tutorial","volume":"35","author":"CH Jackson","year":"2015","journal-title":"Med Decis Making"},{"issue":"6","key":"pcbi.1013647.ref013","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1007\/s40273-017-0494-4","article-title":"Bayesian Methods for Calibrating Health Policy Models: A Tutorial","volume":"35","author":"NA Menzies","year":"2017","journal-title":"Pharmacoeconomics"},{"issue":"1","key":"pcbi.1013647.ref014","doi-asserted-by":"crossref","first-page":"35","DOI":"10.2165\/11584600-000000000-00000","article-title":"Calibrating models in economic evaluation: a seven-step approach","volume":"29","author":"T Vanni","year":"2011","journal-title":"Pharmacoeconomics"},{"issue":"5","key":"pcbi.1013647.ref015","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1177\/0272989X20938683","article-title":"Methods for Model Calibration under High Uncertainty: Modeling Cholera in Bangladesh","volume":"40","author":"T Ryckman","year":"2020","journal-title":"Med Decis Making"},{"issue":"7","key":"pcbi.1013647.ref016","doi-asserted-by":"crossref","first-page":"533","DOI":"10.2165\/11314830-000000000-00000","article-title":"Calibration methods used in cancer simulation models and suggested reporting guidelines","volume":"27","author":"NK Stout","year":"2009","journal-title":"Pharmacoeconomics"},{"key":"pcbi.1013647.ref017","article-title":"National HIV testing and diagnosis coverage in sub-Saharan Africa: a new modeling tool for estimating the \u201cfirst 90\u201d from program and survey data","author":"M Maheu-Giroux","year":"2019","journal-title":"AIDS"},{"issue":"7","key":"pcbi.1013647.ref018","doi-asserted-by":"crossref","first-page":"467","DOI":"10.7326\/M18-0850","article-title":"PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation","volume":"169","author":"AC Tricco","year":"2018","journal-title":"Ann Intern Med"},{"key":"pcbi.1013647.ref019","article-title":"Chapter 11: Scoping reviews (2020 version).","volume-title":"JBI Manual for Evidence Synthesis","author":"M Peters","year":"2020"},{"issue":"1","key":"pcbi.1013647.ref020","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1186\/s12874-017-0468-4","article-title":"What kind of systematic review should I conduct? A proposed typology and guidance for systematic reviewers in the medical and health sciences","volume":"18","author":"Z Munn","year":"2018","journal-title":"BMC Med Res Methodol"},{"issue":"6","key":"pcbi.1013647.ref021","doi-asserted-by":"crossref","first-page":"828","DOI":"10.1016\/j.jval.2012.06.011","article-title":"Dynamic transmission modeling: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force--5","volume":"15","author":"R Pitman","year":"2012","journal-title":"Value Health"},{"issue":"1","key":"pcbi.1013647.ref022","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1002\/jrsm.1333","article-title":"The use of mathematical modeling studies for evidence synthesis and guideline development: A glossary","volume":"10","author":"TV Porgo","year":"2019","journal-title":"Res Synth Methods"},{"issue":"61","key":"pcbi.1013647.ref023","doi-asserted-by":"crossref","first-page":"3167","DOI":"10.21105\/joss.03167","article-title":"Visualizations with statistical details: The \u201cggstatsplot\u201d approach","volume":"6","author":"I Patil","year":"2021","journal-title":"JOSS"},{"key":"pcbi.1013647.ref024","unstructured":"Veritas Health Innovation. Covidence systematic review software. 2024."},{"key":"pcbi.1013647.ref025","volume-title":"R: A Language and Environment for Statistical Computing","author":"R Core Team","year":"2024"},{"issue":"4","key":"pcbi.1013647.ref026","article-title":"Using Hawkes Processes to model imported and local malaria cases in near-elimination settings","volume":"17","author":"HJT Unwin","year":"2021","journal-title":"PLoS Comput Biol"},{"issue":"6","key":"pcbi.1013647.ref027","doi-asserted-by":"crossref","first-page":"1760","DOI":"10.1073\/pnas.0607208104","article-title":"Sequential Monte Carlo without likelihoods","volume":"104","author":"SA Sisson","year":"2007","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"9","key":"pcbi.1013647.ref028","doi-asserted-by":"crossref","first-page":"180887","DOI":"10.1098\/rsos.180887","article-title":"The role of geospatial hotspots in the spatial spread of tuberculosis in rural Ethiopia: a mathematical model","volume":"5","author":"D Shaweno","year":"2018","journal-title":"R Soc Open Sci"},{"issue":"1","key":"pcbi.1013647.ref029","article-title":"A mathematical model for assessing the effectiveness of controlling relapse in Plasmodium vivax malaria endemic in the Republic of Korea","volume":"15","author":"S Kim","year":"2020","journal-title":"PLoS One"},{"key":"pcbi.1013647.ref030","doi-asserted-by":"crossref","first-page":"4513854","DOI":"10.1155\/2020\/4513854","article-title":"Modelling the Transmission Dynamics of Tuberculosis in the Ashanti Region of Ghana","volume":"2020","author":"FO Mettle","year":"2020","journal-title":"Interdiscip Perspect Infect Dis"},{"key":"pcbi.1013647.ref031","first-page":"387","article-title":"Prevalence of HIV in Kazakhstan 2010-2020 and Its Forecasting for the Next 10 Years","volume":"15","author":"K Mussina","year":"2023","journal-title":"HIV AIDS (Auckl)"},{"issue":"3","key":"pcbi.1013647.ref032","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1007707","article-title":"Tracking progress towards malaria elimination in China: Individual-level estimates of transmission and its spatiotemporal variation using a diffusion network approach","volume":"16","author":"I Routledge","year":"2020","journal-title":"PLoS Comput Biol"},{"issue":"1","key":"pcbi.1013647.ref033","doi-asserted-by":"crossref","first-page":"733","DOI":"10.1186\/s12879-023-08729-4","article-title":"Inter-rater reliability of the infectious disease modeling reproducibility checklist (IDMRC) as applied to COVID-19 computational modeling research","volume":"23","author":"D Pokutnaya","year":"2023","journal-title":"BMC Infect Dis"},{"issue":"1","key":"pcbi.1013647.ref034","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1186\/s13742-016-0135-4","article-title":"Tools and techniques for computational reproducibility","volume":"5","author":"SR Piccolo","year":"2016","journal-title":"Gigascience"},{"issue":"9","key":"pcbi.1013647.ref035","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1012410","article-title":"Ten simple rules for training scientists to make better software","volume":"20","author":"K Gallagher","year":"2024","journal-title":"PLoS Comput Biol"},{"issue":"4","key":"pcbi.1013647.ref036","doi-asserted-by":"crossref","first-page":"2025","DOI":"10.1093\/genetics\/162.4.2025","article-title":"Approximate Bayesian computation in population genetics","volume":"162","author":"MA Beaumont","year":"2002","journal-title":"Genetics"},{"issue":"1","key":"pcbi.1013647.ref037","doi-asserted-by":"crossref","first-page":"612","DOI":"10.1186\/s12879-017-2699-8","article-title":"Lessons from a decade of individual-based models for infectious disease transmission: a systematic review (2006-2015)","volume":"17","author":"L Willem","year":"2017","journal-title":"BMC Infect Dis"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1013647","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2025,11,11]],"date-time":"2025-11-11T00:00:00Z","timestamp":1762819200000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1013647","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,11]],"date-time":"2025-11-11T18:43:37Z","timestamp":1762886617000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1013647"}},"subtitle":[],"editor":[{"given":"Joseph T.","family":"Wu,","sequence":"first","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2025,11,4]]},"references-count":37,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2025,11,4]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1013647","relation":{},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,4]]}}}