{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,4]],"date-time":"2026-05-04T13:43:25Z","timestamp":1777902205051,"version":"3.51.4"},"reference-count":42,"publisher":"SAGE Publications","issue":"7","license":[{"start":{"date-parts":[[2011,1,20]],"date-time":"2011-01-20T00:00:00Z","timestamp":1295481600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["SIMULATION"],"published-print":{"date-parts":[[2011,7]]},"abstract":"<jats:p>The Discrete Event System Specification (DEVS) formal modeling and simulation (M&amp;S) framework (which supports hierarchical and modular model composition) has been widely used to understand, analyze and develop a variety of systems. Numerous DEVS simulators have been developed; nevertheless, evaluating the performance of such simulators is a complex process and it has been usually done using ad hoc methods. DEVStone, instead, is a synthetic benchmark that can be used to automate the evaluation of the performance of DEVS-based simulators. DEVStone generates a suite of models with varied structure and behavior automatically. To do so, it uses a standardized mechanism that can be the basis for comparisons between simulation software tools. As a proof of the concept, we present various tests in which DEVStone was used to study the efficiency of five different simulation engines. In this case, we compared various versions of the CD++ simulator, and then compared its performance with the \u2018A Discrete Event System Simulator\u2019 (ADEVS) M&amp;S tool. This is the first effort in which these simulation tools have been thoroughly compared with a very demanding set of experiments. The use of DEVStone allowed a standardized and exhaustive method to compare different features of the simulation software. We show how the basic ideas used for DEVStone facilitates performance analysis for upgrades and updates of a given simulation engine, while also providing a common metric to compare different M&amp;S environments.<\/jats:p>","DOI":"10.1177\/0037549710395649","type":"journal-article","created":{"date-parts":[[2011,1,20]],"date-time":"2011-01-20T21:10:30Z","timestamp":1295557830000},"page":"555-580","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":19,"title":["Studying performance of DEVS modeling and simulation environments using the DEVStone benchmark"],"prefix":"10.1177","volume":"87","author":[{"given":"Gabriel","family":"Wainer","sequence":"first","affiliation":[{"name":"Department of Systems and Computer Engineering, Carleton University, Ottawa, ON, Canada,"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ezequiel","family":"Glinsky","sequence":"additional","affiliation":[{"name":"Department of Systems and Computer Engineering, Carleton University, Ottawa, ON, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marcelo","family":"Gutierrez-Alcaraz","sequence":"additional","affiliation":[{"name":"Department of Systems and Computer Engineering, Carleton University, Ottawa, ON, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2011,1,20]]},"reference":[{"key":"atypb1","volume-title":"Theory of Modeling and Simulation","author":"Zeigler B.","year":"2000","edition":"2"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCB.2002.1049613"},{"key":"atypb3","volume-title":"III International Conference on Forest Fire Research, III International Conference On Forest Fire Research, 14th Conference on Fire and Forest Meteorology","author":"Barros F."},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1177\/0037549707085084"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1177\/0037549709343117"},{"key":"atypb6","doi-asserted-by":"publisher","DOI":"10.1177\/0037549706073698"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1177\/003754979907200403"},{"key":"atypb8","volume-title":"Proceedings of the European Simulation Symposium","author":"Kim J-K."},{"key":"atypb9","doi-asserted-by":"publisher","DOI":"10.1177\/0037549705052234"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1002\/spe.809"},{"key":"atypb11","doi-asserted-by":"publisher","DOI":"10.1177\/003754979807100205"},{"key":"atypb12","doi-asserted-by":"publisher","DOI":"10.1177\/0037549709358294"},{"key":"atypb13","author":"Byon E.","year":"2010","journal-title":"SIMULATION"},{"key":"atypb14","first-page":"179","volume":"18","author":"Daicz S.","year":"2001","journal-title":"SIMULATION"},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1177\/0037549709346279"},{"key":"atypb16","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-60472-3_27"},{"key":"atypb17","volume-title":"Proceedings of the SCS Winter Simulation Conference","author":"Glinsky E."},{"key":"atypb18","doi-asserted-by":"publisher","DOI":"10.1002\/spe.482"},{"key":"atypb19","volume-title":"ADEVS website","author":"Nutaro J.","year":"2010"},{"key":"atypb20","doi-asserted-by":"crossref","unstructured":"Wainer G., Jafer S. and Liu Q. Advanced parallel simulation of DEVS models in CD++. In: Wainer G and Mosterman P (eds) Discrete-Event Modeling and Simulation: Theory and Applications. London: Taylor and Francis, 2010.","DOI":"10.1201\/b10412-12"},{"key":"atypb21","volume-title":"Proceedings of 2010 Symposium on Theory of Modeling and Simulation, DEVS\u201910","author":"Moallemi M."},{"key":"atypb22","volume-title":"Proceedings of the Annual Simulation Symposium","author":"D\u00edaz A."},{"key":"atypb23","volume-title":"Proceedings of the 34rd Annual Simulation Symposium","author":"Ameghino J."},{"key":"atypb24","volume-title":"Proceedings of the SCS Summer Computer Simulation Conference","author":"Ameghino J."},{"key":"atypb25","doi-asserted-by":"publisher","DOI":"10.1201\/9781420053371"},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1177\/0037549709340968"},{"key":"atypb27","volume-title":"Proceedings of the SCS International Conference on Web-based Modeling and Simulation","author":"Sarjoughian HS"},{"key":"atypb28","volume-title":"DEVSim++: C++ based simulation with hierarchical modular DEVS models. User\u2019s Manual CORE Lab","author":"Kim TG","year":"1994"},{"key":"atypb29","volume-title":"Proceedings of the Winter Simulation Conference","author":"Himmelspach J."},{"key":"atypb30","volume-title":"Proceedings of the the IEMSS\u201902 Conference on Integrated Assessment and Decision Support","author":"Filippi J-B."},{"key":"atypb31","doi-asserted-by":"crossref","unstructured":"Wainer G., Al-Zoubi K., Mittal S., Risco-Mart\u00edn JL, Sarjoughian H. and Zeigler BP An Introduction to DEVS standardization. In: Wainer G and Mosterman P (eds) Discrete-Event Modeling and Simulation: Theory and Applications. London: Taylor and Francis, 2010.","DOI":"10.1201\/b10412-21"},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1177\/0037549702078001198"},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1177\/0037549709102762"},{"key":"atypb34","volume-title":"The COST Simulation Benchmark. Description and Simulator Manual","author":"Copp JB"},{"key":"atypb35","volume-title":"The Huntsville Simulation Conference","author":"Knight P."},{"key":"atypb36","volume-title":"Proceedings of the SCS Summer Computer Simulation Conference","author":"Troccoli A."},{"key":"atypb37","volume-title":"First Asia International Conference on Modeling and Simulation","author":"Breitenecker F."},{"key":"atypb38","doi-asserted-by":"publisher","DOI":"10.1145\/358274.358283"},{"key":"atypb39","volume-title":"Proceedings of the SCS Winter Simulation Conference","author":"Chow A."},{"key":"atypb40","volume-title":"Time Warp Parallel Discrete Event Simulator","author":"Martin D.","year":"1997"},{"key":"atypb41","volume-title":"Proceedings of the 33rd Annual Simulation Symposium","author":"Kim K."},{"key":"atypb42","volume-title":"NJ","author":"Liu J.","year":"2000"}],"container-title":["SIMULATION"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0037549710395649","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0037549710395649","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T11:22:56Z","timestamp":1777634576000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0037549710395649"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,1,20]]},"references-count":42,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2011,7]]}},"alternative-id":["10.1177\/0037549710395649"],"URL":"https:\/\/doi.org\/10.1177\/0037549710395649","relation":{},"ISSN":["0037-5497","1741-3133"],"issn-type":[{"value":"0037-5497","type":"print"},{"value":"1741-3133","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,1,20]]}}}