{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T21:23:07Z","timestamp":1771708987892,"version":"3.50.1"},"reference-count":52,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2021,9,14]],"date-time":"2021-09-14T00:00:00Z","timestamp":1631577600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002510","name":"Kongju National University","doi-asserted-by":"publisher","award":["the research grant of the Kongju National University in 2021"],"award-info":[{"award-number":["the research grant of the Kongju National University in 2021"]}],"id":[{"id":"10.13039\/501100002510","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IJGI"],"abstract":"<jats:p>(1) Background: The stochastic nature of agent-based models (ABMs) may be responsible for the variability of simulated outputs. Multiple simulation runs (i.e., replicates) need to be performed to have enough sample size for hypothesis testing and validating simulations. The simulation outputs in the early-stage of simulations from non-terminating ABMs may be underestimated (or overestimated). To avoid this initialization bias, the simulations need to be run for a burn-in period. This study proposes to use multiple scale space-time patterns to determine the number of required replicates and burn-in periods in spatially explicit ABMs, and develop an indicator for these purposes. (2) Methods: ABMs of vector-borne disease transmission were used as the case study. Particularly, we developed an index, D, which enables to take into consideration a successive coefficient of variance (CV) over replicates and simulation years. The comparison between the number of replicates and the burn-in periods determined by D and those chosen by CV was performed. (3) Results: When only a single pattern was used to determine the number of replicates and the burn-in periods, the results varied depending on the pattern. (4) Conclusions: As multiple scale space-time patterns were used for the purposes, the simulated outputs after the burn-in periods with a proper number of replicates would well reproduce multiple patterns of phenomena. The outputs may also be more useful for hypothesis testing and validation.<\/jats:p>","DOI":"10.3390\/ijgi10090604","type":"journal-article","created":{"date-parts":[[2021,9,14]],"date-time":"2021-09-14T21:47:21Z","timestamp":1631656041000},"page":"604","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Using Multiple Scale Space-Time Patterns to Determine the Number of Replicates and Burn-In Periods in Spatially Explicit Agent-Based Modeling of Vector-Borne Disease Transmission"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8754-2897","authenticated-orcid":false,"given":"Jeon-Young","family":"Kang","sequence":"first","affiliation":[{"name":"Department of Geography Education, Kongju National University, Gongju-si 314-701, Korea"}]},{"given":"Jared","family":"Aldstadt","sequence":"additional","affiliation":[{"name":"Department of Geography, State University of New York at Buffalo, Buffalo, NY 14261, USA"}]}],"member":"1968","published-online":{"date-parts":[[2021,9,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1764","DOI":"10.1080\/13658816.2013.782613","article-title":"Spatially-explicit sensitivity analysis of an agent-based model of land use change","volume":"27","year":"2013","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1111\/j.1467-8306.2005.00450.x","article-title":"Exploring Complexity in a Human\u2013Environment System: An Agent-Based Spatial Model for Multidisciplinary and Multiscale Integration","volume":"95","author":"An","year":"2005","journal-title":"Ann. Assoc. Am. Geogr."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.apgeog.2014.02.005","article-title":"Modeling triple-diffusions of infectious diseases, information, and preventive behaviors through a metropolitan social network\u2014An agent-based simulation","volume":"50","author":"Mao","year":"2014","journal-title":"Appl. Geogr."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1016\/j.envsoft.2014.08.027","article-title":"An agent-based modeling approach applied to the spread of cholera","volume":"62","author":"Crooks","year":"2014","journal-title":"Environ. Model. Softw."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.ecolmodel.2018.04.015","article-title":"A general approach to incorporating spatial and temporal variation in individual-based models of fish populations with application to Atlantic mackerel","volume":"382","author":"Boyd","year":"2018","journal-title":"Ecol. Model."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1016\/j.compenvurbsys.2012.04.003","article-title":"Analysis of crime patterns through the integration of an agent-based model and a population microsimulation","volume":"36","author":"Malleson","year":"2012","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1016\/j.compenvurbsys.2009.10.005","article-title":"Crime reduction through simulation: An agent-based model of burglary","volume":"34","author":"Malleson","year":"2010","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1016\/j.compenvurbsys.2008.09.004","article-title":"Key challenges in agent-based modelling for geo-spatial simulation","volume":"32","author":"Crooks","year":"2008","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"998","DOI":"10.1287\/mnsc.1070.0787","article-title":"Heterogeneity and network structure in the dynamics of diffusion: Comparing agent-based and differential equation models","volume":"54","author":"Rahmandad","year":"2008","journal-title":"Manag. Sci."},{"key":"ref_10","first-page":"1855","article-title":"A CyberGIS Approach to Spatiotemporally Explicit Uncertainty and Global Sensitivity Analysis for Agent-Based Modeling of Vector-Borne Disease Transmission","volume":"110","author":"Kang","year":"2020","journal-title":"Ann. Am. Assoc. Geogr."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Ligmann-Zielinska, A., Kramer, D.B., Cheruvelil, K.S., and Soranno, P.A. (2014). Using uncertainty and sensitivity analyses in socioecological agent-based models to improve their analytical performance and policy relevance. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0109779"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1016\/j.envsoft.2014.03.007","article-title":"Spatially-explicit integrated uncertainty and sensitivity analysis of criteria weights in multicriteria land suitability evaluation","volume":"57","author":"Jankowski","year":"2014","journal-title":"Environ. Model. Softw."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1080\/00045608.2014.892342","article-title":"Global sensitivity analysis of a large agent-based model of spatial opinion exchange: A heterogeneous multi-GPU acceleration approach","volume":"104","author":"Tang","year":"2014","journal-title":"Ann. Assoc. Am. Geogr."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/j.simpat.2016.12.013","article-title":"Model-independent comparison of simulation output","volume":"72","author":"Fachada","year":"2017","journal-title":"Simul. Model. Pract. Theory"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"4","DOI":"10.18564\/jasss.2897","article-title":"The complexities of agent-based modeling output analysis","volume":"18","author":"Lee","year":"2015","journal-title":"J. Artif. Soc. Soc. Simul."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Kelton, W.D. (1997, January 7\u201310). Statistical analysis of simulation output. Proceedings of the 29th Conference on Winter Simulation, Atlanta, GA, USA.","DOI":"10.1145\/268437.268443"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2","DOI":"10.18564\/jasss.3901","article-title":"Promoting Sustainable Food Consumption: An Agent-Based Model About Outcomes of Small Shop Openings","volume":"22","author":"Calisti","year":"2019","journal-title":"J. Artif. Soc. Soc. Simul."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"4","DOI":"10.18564\/jasss.3812","article-title":"An agent-based model of rural households\u2019 adaptation to climate change","volume":"21","author":"Hailegiorgis","year":"2018","journal-title":"J. Artif. Soc. Soc. Simul."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"9","DOI":"10.18564\/jasss.3784","article-title":"Streamlining simulation experiments with agent-based models in demography","volume":"21","author":"Reinhardt","year":"2018","journal-title":"J. Artif. Soc. Soc. Simul."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Dubbelboer, J., Nikolic, I., Jenkins, K., and Hall, J. (2017). An agent-based model of flood risk and insurance. J. Artif. Soc. Soc. Simul., 20.","DOI":"10.18564\/jasss.3135"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Moglia, M., Podkalicka, A., and McGregor, J. (2018). An agent-based model of residential energy efficiency adoption. J. Artif. Soc. Soc. Simul., 21.","DOI":"10.18564\/jasss.3729"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Gharakhanlou, N.M., Hooshangi, N., and Helbich, M. (2020). A Spatial Agent-Based Model to Assess the Spread of Malaria in Relation to Anti-Malaria Interventions in Southeast Iran. ISPRS Int. J. Geo-Inf., 9.","DOI":"10.3390\/ijgi9090549"},{"key":"ref_23","unstructured":"Sanchez, S.M. (2001, January 9\u201312). Output modeling: Abc\u2019s of output analysis. Proceedings of the 33nd Conference on Winter Simulation, WSC 2001, Arlington, VA, USA."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Law, A.M. (2015, January 14\u201318). Statistical analysis of simulation output data: The practical state of the art. Proceedings of the 2015 Winter Simulation Conference (WSC), Orlando, FL, USA.","DOI":"10.1109\/WSC.2015.7408297"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"848","DOI":"10.1016\/j.jbusres.2007.02.007","article-title":"Validating agent-based marketing models through conjoint analysis","volume":"60","author":"Garcia","year":"2007","journal-title":"J. Bus. Res."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"170","DOI":"10.1016\/j.compenvurbsys.2019.02.006","article-title":"Using multiple scale space-time patterns in variance-based global sensitivity analysis for spatially explicit agent-based models","volume":"75","author":"Kang","year":"2019","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_27","first-page":"8","article-title":"Empirical validation of agent-based models: Alternatives and prospects","volume":"10","author":"Windrum","year":"2007","journal-title":"J. Artif. Soc. Soc. Simul."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"153","DOI":"10.1080\/13658810410001713399","article-title":"Path dependence and the validation of agent-based spatial models of land use","volume":"19","author":"Brown","year":"2005","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"987","DOI":"10.1126\/science.1116681","article-title":"Pattern-oriented modeling of agent-based complex systems: Lessons from ecology","volume":"310","author":"Grimm","year":"2005","journal-title":"Science"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1080\/13658816.2018.1535121","article-title":"Using multiple scale spatio-temporal patterns for validating spatially explicit agent-based models","volume":"33","author":"Kang","year":"2019","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1371","DOI":"10.1080\/13658816.2011.556121","article-title":"Agent-based simulation for a dual-diffusion process of influenza and human preventive behavior","volume":"25","author":"Mao","year":"2011","journal-title":"Int. J. Geogr. Inf. Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1007\/s00477-007-0132-3","article-title":"An incremental Knox test for the determination of the serial interval between successive cases of an infectious disease","volume":"21","author":"Aldstadt","year":"2007","journal-title":"Stoch. Environ. Res. Risk Assess."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1007\/s10588-011-9097-3","article-title":"Opening the \u2018black box\u2019of simulations: Increased transparency and effective communication through the systematic design of experiments","volume":"18","author":"Lorscheid","year":"2012","journal-title":"Comput. Math. Organ. Theory"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Chao, D., Halstead, S.B., Halloran, M.E., and Longini, I.M. (2012). Controlling dengue with vaccines in Thailand. PLoS Negl. Trop. Dis., 6.","DOI":"10.1371\/journal.pntd.0001876"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1007\/s11069-005-0263-0","article-title":"Agent-based modeling and analysis of hurricane evacuation procedures for the Florida Keys","volume":"38","author":"Chen","year":"2006","journal-title":"Nat. Hazards"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"186","DOI":"10.3390\/ijgi1020186","article-title":"Using crowdsourced geodata for agent-based indoor evacuation simulations","volume":"1","author":"Goetz","year":"2012","journal-title":"ISPRS Int. J. Geo-Inf."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Vandewalle, R., Kang, J.Y., Yin, D., and Wang, S. (2019, January 5). Integrating CyberGIS-Jupyter and spatial agent-based modelling to evaluate emergency evacuation time. Proceedings of the 2nd ACM SIGSPATIAL International Workshop on GeoSpatial Simulation, Chicago, IL, USA.","DOI":"10.1145\/3356470.3365530"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1186\/1476-072X-8-50","article-title":"An agent-based approach for modeling dynamics of contagious disease spread","volume":"8","author":"Perez","year":"2009","journal-title":"Int. J. Health Geogr."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1093\/aje\/kwf005","article-title":"Epidemiology of inapparent and symptomatic acute dengue virus infection: A prospective study of primary school children in Kamphaeng Phet, Thailand","volume":"156","author":"Endy","year":"2002","journal-title":"Am. J. Epidemiol."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Kang, J.-Y., and Aldstadt, J. (2017). The Influence of Spatial Configuration of Residential Area and Vector Populations on Dengue Incidence Patterns in an Individual-Level Transmission Model. Int. J. Environ. Res. Public Health, 14.","DOI":"10.3390\/ijerph14070792"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Yoon, I.-K., Getis, A., Aldstadt, J., Rothman, A.L., Tannitisupawong, D., Koenraadt, C.J.M., Fansiri, T., Jones, J.W., Morrison, A.C., and Jarman, R.G. (2012). Fine scale spatiotemporal clustering of dengue virus transmission in children and Aedes aegypti in rural Thai villages. PLoS Negl. Trop. Dis., 6.","DOI":"10.1371\/journal.pntd.0001730"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"2760","DOI":"10.1016\/j.ecolmodel.2010.08.019","article-title":"The ODD protocol: A review and first update","volume":"221","author":"Grimm","year":"2010","journal-title":"Ecol. Model."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"910","DOI":"10.4269\/ajtmh.2007.77.910","article-title":"Analysis of repeat hospital admissions for dengue to estimate the frequency of third or fourth dengue infections resulting in admissions and dengue hemorrhagic fever, and serotype sequences","volume":"77","author":"Gibbons","year":"2007","journal-title":"Am. J. Trop. Med. Hyg."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1086\/315215","article-title":"Dengue viremia titer, antibody response pattern, and virus serotype correlate with disease severity","volume":"181","author":"Vaughn","year":"2000","journal-title":"J. Infect. Dis."},{"key":"ref_45","first-page":"307","article-title":"Age-dependent survival of the dengue vector Aedes aegypti (Diptera: Culicidae) demonstrated by simultaneous release\u2013recapture of different age cohorts","volume":"45","author":"Harrington","year":"2008","journal-title":"J. Med. Entomol."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1603\/0022-2585-38.4.537","article-title":"Analysis of survival of young and old Aedes aegypti (Diptera: Culicidae) from Puerto Rico and Thailand","volume":"38","author":"Harrington","year":"2001","journal-title":"J. Med. Entomol."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"209","DOI":"10.4269\/ajtmh.2005.72.209","article-title":"Dispersal of the dengue vector Aedes aegypti within and between rural communities","volume":"72","author":"Harrington","year":"2005","journal-title":"Am. J. Trop. Med. Hyg."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"24","DOI":"10.4269\/ajtmh.14-0242","article-title":"Improving dengue virus capture rates in humans and vectors in Kamphaeng Phet Province, Thailand, using an enhanced spatiotemporal surveillance strategy","volume":"93","author":"Thomas","year":"2015","journal-title":"Am. J. Trop. Med. Hyg."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"222","DOI":"10.2307\/3543712","article-title":"A comparison of three diversity indices based on their components of richness and evenness","volume":"26","author":"DeJong","year":"1975","journal-title":"Oikos"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"298","DOI":"10.1098\/rstb.2011.0180","article-title":"Pattern-oriented modelling: A \u2018multi-scope\u2019 for predictive systems ecology","volume":"367","author":"Grimm","year":"2012","journal-title":"Philos. Trans. R. Soc. B"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"682","DOI":"10.1111\/j.1749-8198.2010.00337.x","article-title":"Agent-based modeling of animal movement: A review","volume":"4","author":"Tang","year":"2010","journal-title":"Geogr. Compass"},{"key":"ref_52","first-page":"1","article-title":"Agent-based models and industrial organization theory. A price-competition algorithm for agent-based models based on Game Theory","volume":"6","year":"2018","journal-title":"Complex Adapt. Syst. Model."}],"container-title":["ISPRS International Journal of Geo-Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2220-9964\/10\/9\/604\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:02:25Z","timestamp":1760166145000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2220-9964\/10\/9\/604"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,14]]},"references-count":52,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2021,9]]}},"alternative-id":["ijgi10090604"],"URL":"https:\/\/doi.org\/10.3390\/ijgi10090604","relation":{},"ISSN":["2220-9964"],"issn-type":[{"value":"2220-9964","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,14]]}}}