{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,24]],"date-time":"2025-10-24T07:30:24Z","timestamp":1761291024594,"version":"3.38.0"},"reference-count":42,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2016,8,11]],"date-time":"2016-08-11T00:00:00Z","timestamp":1470873600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["SIMULATION"],"published-print":{"date-parts":[[2017,4]]},"abstract":"<jats:p> The verification and validation (V&amp;V) of agent-based models (ABMs) is challenging. The underlying structure of the model and the agents can change over time. Furthermore, the theoretical context of the model is often very different from established models of the same phenomenon. In an effort to overcome these issues, trace validation is becoming a common V&amp;V mechanism within the agent-based modeling community. In trace validation, characteristics of agents and the model are tracked over time and then analyzed by subject matter experts (SMEs) to gain insight into unexpected and potentially invalid output. Here, we present our tool, the V&amp;V Calculator, which applies predicates employed in the field of software engineering. The result is a structured trace validation approach with quantifiable measures that facilitates SME exploration and insight into the causes of unexpected output within ABMs. <\/jats:p>","DOI":"10.1177\/0037549716659707","type":"journal-article","created":{"date-parts":[[2016,8,3]],"date-time":"2016-08-03T00:44:20Z","timestamp":1470185060000},"page":"273-284","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":15,"title":["Applying statistical debugging for enhanced trace validation of agent-based models"],"prefix":"10.1177","volume":"93","author":[{"given":"Ross J","family":"Gore","sequence":"first","affiliation":[{"name":"Virginia Modeling, Analysis, and Simulation Center, Old Dominion University, Suffolk, VA, USA"}]},{"given":"Christopher J","family":"Lynch","sequence":"additional","affiliation":[{"name":"Virginia Modeling, Analysis, and Simulation Center, Old Dominion University, Suffolk, VA, USA"},{"name":"Department of Modeling, Simulation & Visualization Engineering, Old Dominion University, Suffolk, VA, USA"}]},{"given":"Hamdi","family":"Kavak","sequence":"additional","affiliation":[{"name":"Department of Modeling, Simulation & Visualization Engineering, Old Dominion University, Suffolk, VA, USA"},{"name":"Department of Industrial and Systems Engineering, Turkish Military Academy, Turkey"}]}],"member":"179","published-online":{"date-parts":[[2016,8,11]]},"reference":[{"key":"bibr1-0037549716659707","doi-asserted-by":"publisher","DOI":"10.4135\/9781412983259"},{"key":"bibr2-0037549716659707","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.082080899"},{"key":"bibr3-0037549716659707","doi-asserted-by":"publisher","DOI":"10.1057\/jos.2010.3"},{"issue":"2","key":"bibr4-0037549716659707","first-page":"1","volume":"11","author":"Takadama K","year":"2008","journal-title":"J Artif Soc Soc Simul"},{"key":"bibr5-0037549716659707","doi-asserted-by":"publisher","DOI":"10.1002\/9780470172445.ch10"},{"first-page":"441","volume-title":"Proceedings of the winter simulation conference","author":"Bharathy GK","key":"bibr6-0037549716659707"},{"first-page":"118","volume-title":"Proceedings of the winter simulation conference","author":"Sargent RG","key":"bibr7-0037549716659707"},{"first-page":"47","volume-title":"Spring Simulation Multiconference (SpringSim\u201905)","author":"Xiang X","key":"bibr8-0037549716659707"},{"first-page":"492","volume-title":"Proceedings of the 26th IEEE\/ACM international conference on automated software engineering","author":"Gore R","key":"bibr9-0037549716659707"},{"first-page":"559","volume-title":"Proceedings of the winter simulation conference","author":"Whitner RB","key":"bibr10-0037549716659707"},{"first-page":"33","volume-title":"Proceedings of the winter simulation conference","author":"Sargent RG","key":"bibr11-0037549716659707"},{"key":"bibr12-0037549716659707","doi-asserted-by":"publisher","DOI":"10.1109\/WSC.2000.899697"},{"key":"bibr13-0037549716659707","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780195172119.001.0001"},{"issue":"2","key":"bibr14-0037549716659707","first-page":"1","volume":"10","author":"Windrum P","year":"2007","journal-title":"J Artif Soc Soc Simul"},{"issue":"3","key":"bibr15-0037549716659707","first-page":"1","volume":"5","author":"Bagni R","year":"2002","journal-title":"J Artif Soc Soc Simul"},{"key":"bibr16-0037549716659707","doi-asserted-by":"publisher","DOI":"10.1016\/j.ecolmodel.2004.12.009"},{"key":"bibr17-0037549716659707","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/3374.001.0001"},{"issue":"3","key":"bibr18-0037549716659707","first-page":"1","volume":"5","author":"Courdier R","year":"2002","journal-title":"J Artif Soc Soc Simul"},{"key":"bibr19-0037549716659707","doi-asserted-by":"publisher","DOI":"10.1145\/1064978.1065014"},{"first-page":"1257","volume-title":"Proceedings of the winter simulation conference","author":"Gore R","key":"bibr20-0037549716659707"},{"key":"bibr21-0037549716659707","doi-asserted-by":"publisher","DOI":"10.1145\/2699722"},{"first-page":"5","volume-title":"Proceedings of the 2007 international symposium on software testing and analysis","author":"Nainar PA","key":"bibr22-0037549716659707"},{"key":"bibr23-0037549716659707","doi-asserted-by":"publisher","DOI":"10.1016\/0025-5564(95)92756-5"},{"issue":"1","key":"bibr24-0037549716659707","first-page":"231","volume":"9","author":"Dunham JB.","year":"2005","journal-title":"J Artif Soc Soc Simul"},{"first-page":"712","volume-title":"Proceedings of the winter simulation conference","author":"Gore R","key":"bibr25-0037549716659707"},{"key":"bibr26-0037549716659707","doi-asserted-by":"publisher","DOI":"10.1198\/004017006000000453"},{"key":"bibr27-0037549716659707","doi-asserted-by":"publisher","DOI":"10.1145\/37402.37406"},{"issue":"25","key":"bibr28-0037549716659707","first-page":"1","volume":"9","author":"Gilbert N.","year":"2004","journal-title":"Complex Syst Netw Excell"},{"volume-title":"Generative social science: studies in agent-based computational modeling","year":"2006","author":"Epstein JM.","key":"bibr29-0037549716659707"},{"key":"bibr30-0037549716659707","doi-asserted-by":"publisher","DOI":"10.18564\/jasss.1699"},{"key":"bibr31-0037549716659707","doi-asserted-by":"publisher","DOI":"10.2466\/pms.105.3.977-987"},{"key":"bibr32-0037549716659707","doi-asserted-by":"publisher","DOI":"10.1080\/13873950600883485"},{"volume-title":"Micromotives and macrobehavior","year":"2006","author":"Schelling TC.","key":"bibr33-0037549716659707"},{"key":"bibr34-0037549716659707","doi-asserted-by":"publisher","DOI":"10.18564\/jasss.1873"},{"key":"bibr35-0037549716659707","doi-asserted-by":"publisher","DOI":"10.18564\/jasss.2146"},{"key":"bibr36-0037549716659707","doi-asserted-by":"publisher","DOI":"10.18564\/jasss.1590"},{"issue":"3","key":"bibr37-0037549716659707","first-page":"1","volume":"6","author":"Hammond RA.","year":"2009","journal-title":"Prev Chronic Dis"},{"key":"bibr38-0037549716659707","doi-asserted-by":"publisher","DOI":"10.1016\/j.physa.2006.05.016"},{"key":"bibr39-0037549716659707","doi-asserted-by":"publisher","DOI":"10.1126\/science.1161948"},{"key":"bibr40-0037549716659707","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.75.1226"},{"key":"bibr41-0037549716659707","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.92.168701"},{"first-page":"273","volume-title":"Proceedings of the 20th IEEE\/ACM international conference on automated software engineering","author":"Jones A","key":"bibr42-0037549716659707"}],"container-title":["SIMULATION"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0037549716659707","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/0037549716659707","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0037549716659707","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,2]],"date-time":"2025-03-02T03:04:04Z","timestamp":1740884644000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0037549716659707"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,8,11]]},"references-count":42,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2017,4]]}},"alternative-id":["10.1177\/0037549716659707"],"URL":"https:\/\/doi.org\/10.1177\/0037549716659707","relation":{},"ISSN":["0037-5497","1741-3133"],"issn-type":[{"type":"print","value":"0037-5497"},{"type":"electronic","value":"1741-3133"}],"subject":[],"published":{"date-parts":[[2016,8,11]]}}}