{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T16:39:42Z","timestamp":1783701582661,"version":"3.55.0"},"reference-count":79,"publisher":"World Scientific Pub Co Pte Ltd","issue":"02","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Int. J. Model. Simul. Sci. Comput."],"published-print":{"date-parts":[[2017,6]]},"abstract":"<jats:p>Modeling and simulation (M&amp;S) play a critical role in both engineering and basic research processes. Computer-based models have existed since the 1950s, and those early models have given way to the more complex computational and physics-based simulations used today. As such, a great deal of research has been done to establish what level of trust should be given to simulation outputs and how to verify and validate the models used in these simulations. This paper presents an overview of the theoretical work done to date defining formal definitions for, and methods of, verification and validation (V&amp;V) of computer models. Simulation models are broken down into three broad categories: analytical and simulation models, computational and physics-based models, and simulations of autonomous systems, and the unique theories and methods developed to address V&amp;V of these models are presented. This paper also presents the current problems in the theoretical field of V&amp;V for models as simulations move from single system models and simulations to more complex simulation tools. In particular, this paper highlights the lack of agreed-upon methods for V&amp;V of simulations of autonomous systems, such as an autonomous unmanned vehicles, and proposes some next steps needed to address this problem.<\/jats:p>","DOI":"10.1142\/s1793962317300011","type":"journal-article","created":{"date-parts":[[2017,1,10]],"date-time":"2017-01-10T07:15:11Z","timestamp":1484032511000},"page":"1730001","source":"Crossref","is-referenced-by-count":24,"title":["A historical review of the development of verification and validation theories for simulation models"],"prefix":"10.1142","volume":"08","author":[{"given":"Phillip J.","family":"Durst","sequence":"first","affiliation":[{"name":"U.S. Army Engineer Research and Development Center, 3909 Halls Ferry Road Vicksburg, MS 39180, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Derek T.","family":"Anderson","sequence":"additional","affiliation":[{"name":"Mississippi State University, Department of Electrical and Computer Engineering Mississippi State, MS 39759, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cindy L.","family":"Bethel","sequence":"additional","affiliation":[{"name":"Mississippi State University, Department of Computer, Science and Engineering Mississippi State, MS 39759, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"219","published-online":{"date-parts":[[2017,1,9]]},"reference":[{"key":"S1793962317300011BIB001","volume-title":"Simulation using digital computers","author":"Evans G. W.","year":"1967"},{"key":"S1793962317300011BIB002","volume-title":"Pattern Recognition: Theory, Experiment, Computer Simulations, and Dynamic Models of Form Perception and Discovery","author":"Uhr L. M.","year":"1966"},{"key":"S1793962317300011BIB003","volume-title":"Computer modeling and simulation","author":"Martin F. F.","year":"1968"},{"key":"S1793962317300011BIB004","doi-asserted-by":"publisher","DOI":"10.1145\/356571.356574"},{"key":"S1793962317300011BIB005","volume-title":"Simulation: The Dynamic Modeling of Ideas and Systems with Computers","author":"McLeod J.","year":"1968"},{"key":"S1793962317300011BIB006","volume-title":"The Nature of Modeling","volume":"3027","author":"Rothenberg J.","year":"1989"},{"key":"S1793962317300011BIB008","doi-asserted-by":"publisher","DOI":"10.1016\/0021-9290(68)90029-8"},{"key":"S1793962317300011BIB009","first-page":"126","volume-title":"Anaerobic Biological Treatment Processes","author":"Andrews J. F.","year":"1970"},{"key":"S1793962317300011BIB010","doi-asserted-by":"publisher","DOI":"10.1109\/JSSC.1968.1049902"},{"key":"S1793962317300011BIB011","doi-asserted-by":"publisher","DOI":"10.1137\/0719063"},{"key":"S1793962317300011BIB012","volume-title":"Improved Turbulence Models based on Large Eddy Simulation of Homogeneous, Incompressible Turbulent Flows","author":"Bardino J.","year":"1983"},{"key":"S1793962317300011BIB013","doi-asserted-by":"publisher","DOI":"10.1109\/TED.2003.810477"},{"issue":"3","key":"S1793962317300011BIB014","first-page":"163","volume":"2","author":"Engel J. H.","year":"1954","journal-title":"J. Oper. Res. Soc. Am."},{"key":"S1793962317300011BIB016","doi-asserted-by":"publisher","DOI":"10.1002\/9780470172445.ch10"},{"key":"S1793962317300011BIB017","doi-asserted-by":"publisher","DOI":"10.1002\/9780470403563.ch6"},{"key":"S1793962317300011BIB019","volume-title":"Computer applications in the behavioral sciences","author":"Borko H.","year":"1962"},{"issue":"1","key":"S1793962317300011BIB020","first-page":"3","volume":"42","author":"Anderson J. R.","year":"1974","journal-title":"Rev. Market. Agric. Econ."},{"key":"S1793962317300011BIB021","doi-asserted-by":"publisher","DOI":"10.1016\/0047-2727(78)90008-7"},{"key":"S1793962317300011BIB022","doi-asserted-by":"publisher","DOI":"10.1002\/bs.3830120306"},{"key":"S1793962317300011BIB023","doi-asserted-by":"publisher","DOI":"10.2307\/1054005"},{"key":"S1793962317300011BIB024","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.14.2.B92"},{"key":"S1793962317300011BIB026","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.17.5.247"},{"key":"S1793962317300011BIB027","doi-asserted-by":"publisher","DOI":"10.1057\/jors.1972.3"},{"key":"S1793962317300011BIB028","volume-title":"Simulation","author":"Mihram G. A.","year":"1972"},{"key":"S1793962317300011BIB029","series-title":"Number Monograph","volume-title":"Urban Operations Research","author":"Larson R. C.","year":"1981"},{"key":"S1793962317300011BIB030","volume-title":"Introduction to Operations Research Techniques","author":"Daellenbach H. G.","year":"1983"},{"key":"S1793962317300011BIB031","doi-asserted-by":"publisher","DOI":"10.1016\/0191-2607(85)90036-6"},{"key":"S1793962317300011BIB032","doi-asserted-by":"publisher","DOI":"10.1287\/opre.31.6.1030"},{"key":"S1793962317300011BIB033","doi-asserted-by":"publisher","DOI":"10.1287\/opre.26.2.237"},{"key":"S1793962317300011BIB034","doi-asserted-by":"publisher","DOI":"10.1177\/003754977803000404"},{"key":"S1793962317300011BIB035","doi-asserted-by":"publisher","DOI":"10.1111\/j.1540-5915.1974.tb00643.x"},{"key":"S1793962317300011BIB036","doi-asserted-by":"publisher","DOI":"10.1109\/TSMC.1979.4310155"},{"key":"S1793962317300011BIB037","doi-asserted-by":"publisher","DOI":"10.1177\/003754978504500306"},{"key":"S1793962317300011BIB038","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.14.2.B92"},{"key":"S1793962317300011BIB039","doi-asserted-by":"publisher","DOI":"10.1177\/003754977903200304"},{"key":"S1793962317300011BIB040","doi-asserted-by":"publisher","DOI":"10.1145\/358598.358605"},{"key":"S1793962317300011BIB041","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-82144-8_17"},{"key":"S1793962317300011BIB048","doi-asserted-by":"publisher","DOI":"10.1016\/0377-2217(93)90316-F"},{"key":"S1793962317300011BIB049","doi-asserted-by":"publisher","DOI":"10.1007\/BF02136828"},{"key":"S1793962317300011BIB051","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.44.8.1087"},{"key":"S1793962317300011BIB054","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-82144-8_17"},{"key":"S1793962317300011BIB056","doi-asserted-by":"publisher","DOI":"10.1177\/003754978203900602"},{"issue":"3","key":"S1793962317300011BIB057","first-page":"375","volume":"4","author":"Balci O.","year":"1984","journal-title":"Am. J. Math. Manag. Sci."},{"key":"S1793962317300011BIB058","doi-asserted-by":"publisher","DOI":"10.1177\/003754978504500204"},{"key":"S1793962317300011BIB060","doi-asserted-by":"publisher","DOI":"10.1057\/jos.2012.20"},{"key":"S1793962317300011BIB061","doi-asserted-by":"publisher","DOI":"10.1007\/BF02136828"},{"key":"S1793962317300011BIB064","doi-asserted-by":"publisher","DOI":"10.1057\/jos.2012.20"},{"key":"S1793962317300011BIB066","unstructured":"Peyret R., Taylor T. D., Computational Methods for Fluid Flow, Springer-Verlag, New York, p. 368, 1985."},{"key":"S1793962317300011BIB067","doi-asserted-by":"publisher","DOI":"10.1029\/WR022i09Sp0089S"},{"key":"S1793962317300011BIB068","doi-asserted-by":"publisher","DOI":"10.1016\/0021-9991(84)90142-6"},{"key":"S1793962317300011BIB069","doi-asserted-by":"publisher","DOI":"10.1126\/science.263.5147.641"},{"key":"S1793962317300011BIB070","doi-asserted-by":"publisher","DOI":"10.1086\/342267"},{"key":"S1793962317300011BIB074","volume-title":"Verification and Validation in Computational Science and Engineering","author":"Roache P. J.","year":"1998"},{"key":"S1793962317300011BIB075","doi-asserted-by":"publisher","DOI":"10.1016\/S0376-0421(02)00005-2"},{"key":"S1793962317300011BIB076","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2006.03.037"},{"key":"S1793962317300011BIB077","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2006.10.061"},{"key":"S1793962317300011BIB078","doi-asserted-by":"publisher","DOI":"10.1115\/1.1767847"},{"key":"S1793962317300011BIB080","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-77362-7_2"},{"key":"S1793962317300011BIB081","doi-asserted-by":"publisher","DOI":"10.1016\/j.nucengdes.2007.02.032"},{"key":"S1793962317300011BIB084","doi-asserted-by":"publisher","DOI":"10.1198\/004017007000000092"},{"key":"S1793962317300011BIB085","doi-asserted-by":"publisher","DOI":"10.1214\/009053607000000163"},{"key":"S1793962317300011BIB086","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2004.03.002"},{"key":"S1793962317300011BIB087","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0611677104"},{"key":"S1793962317300011BIB088","doi-asserted-by":"publisher","DOI":"10.1016\/j.pnucene.2010.03.009"},{"key":"S1793962317300011BIB090","doi-asserted-by":"publisher","DOI":"10.1115\/1.4004223"},{"key":"S1793962317300011BIB091","doi-asserted-by":"publisher","DOI":"10.1016\/j.ress.2012.11.011"},{"key":"S1793962317300011BIB093","author":"Bayarri M. J.","year":"2012","journal-title":"Technometrics"},{"key":"S1793962317300011BIB094","doi-asserted-by":"publisher","DOI":"10.1002\/9780470590621"},{"key":"S1793962317300011BIB095","volume-title":"Principles of Modeling and Simulation: A Multidisciplinary Approach","author":"Sokolowski J. A.","year":"2011"},{"key":"S1793962317300011BIB096","volume-title":"A Guide to Simulation","author":"Bratley P.","year":"2011"},{"key":"S1793962317300011BIB097","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2011.03.016"},{"key":"S1793962317300011BIB099","doi-asserted-by":"publisher","DOI":"10.1142\/S1793962315500142"},{"key":"S1793962317300011BIB101","doi-asserted-by":"publisher","DOI":"10.1016\/j.ress.2015.01.023"},{"key":"S1793962317300011BIB102","doi-asserted-by":"crossref","DOI":"10.1137\/1.9781611973228","volume-title":"Uncertainty Quantification: Theory, Implementation, and Applications","volume":"12","author":"Smith R. C.","year":"2013"},{"key":"S1793962317300011BIB103","doi-asserted-by":"publisher","DOI":"10.1002\/9780470590621.ch9"},{"key":"S1793962317300011BIB104","doi-asserted-by":"publisher","DOI":"10.1016\/0167-2681(80)90051-7"},{"key":"S1793962317300011BIB105","doi-asserted-by":"crossref","DOI":"10.2307\/j.ctvcm4j8j","volume-title":"Advances in Behavioral Economics","author":"Camerer C. F.","year":"2011"},{"key":"S1793962317300011BIB106","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-neuro-061010-113648"},{"key":"S1793962317300011BIB109","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-68686-X_24"}],"container-title":["International Journal of Modeling, Simulation, and Scientific Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S1793962317300011","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,6,21]],"date-time":"2024-06-21T18:08:57Z","timestamp":1718993337000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/abs\/10.1142\/S1793962317300011"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,1,9]]},"references-count":79,"journal-issue":{"issue":"02","published-online":{"date-parts":[[2017,1,9]]},"published-print":{"date-parts":[[2017,6]]}},"alternative-id":["10.1142\/S1793962317300011"],"URL":"https:\/\/doi.org\/10.1142\/s1793962317300011","relation":{},"ISSN":["1793-9623","1793-9615"],"issn-type":[{"value":"1793-9623","type":"print"},{"value":"1793-9615","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,1,9]]}}}