{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T16:13:19Z","timestamp":1782317599719,"version":"3.54.5"},"reference-count":116,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2018,2,27]],"date-time":"2018-02-27T00:00:00Z","timestamp":1519689600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["SIMULATION"],"published-print":{"date-parts":[[2019,2]]},"abstract":"<jats:p>Research on the application of 3D visualization and virtual reality (VR) in discrete-event simulation (DES) has received increased attention in the past two decades. The increasing popularity of the 3D display in DES is mainly due to superior display capabilities and the associated benefits that it offers. However, the 2D display also continues to enjoy active use to date, thus provoking some fierce debates questioning the need for the 3D and VR if the 2D interface suffices. Several studies comparing the effectiveness of the different visualization methods also produce different conclusions. This paper undertakes a meta-analysis of the different positions and synthesizes the findings from 162 studies on the impacts of the 2D display versus 3D\/VR on user performance on various DES tasks. The results highlight four key findings. First, the perception that the 2D display is more effective for model development is misleading as 3D\/VR offers overall better performance and quality of models. Second, 3D\/VR enables more effective performance than 2D display for model verification and validation. Third, 3D\/VR decreases the time taken for verification, validation, experimentation, and analysis of results, but can increase model development time. Finally, the latent variables such as the application domains and nature of the problems tackled have no direct or indirect influence on the efficacy of the 3D display\/VR versus 2D on DES task performance.<\/jats:p>","DOI":"10.1177\/0037549718757039","type":"journal-article","created":{"date-parts":[[2018,2,27]],"date-time":"2018-02-27T04:52:22Z","timestamp":1519707142000},"page":"145-170","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":43,"title":["A comparative evaluation of the effectiveness of virtual reality, 3D visualization and 2D visual interactive simulation: an exploratory meta-analysis"],"prefix":"10.1177","volume":"95","author":[{"given":"Ikpe Justice","family":"Akpan","sequence":"first","affiliation":[{"name":"Department of Management & Information Systems, Kent State University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Murali","family":"Shanker","sequence":"additional","affiliation":[{"name":"Department of Management & Information Systems, Kent State University, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2018,2,27]]},"reference":[{"key":"bibr1-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/0377-2217(86)90293-6"},{"key":"bibr2-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.cie.2017.08.020"},{"key":"bibr3-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1057\/palgrave.jors.2600971"},{"key":"bibr4-0037549718757039","first-page":"1478","volume-title":"Proceedings of the 31st conference on simulation: Simulation \u2013 a bridge to the future","author":"Jain S"},{"key":"bibr5-0037549718757039","first-page":"9","volume-title":"Proceedings of the winter 2005 simulation conference","author":"Akpan JI"},{"key":"bibr6-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2014.04.002"},{"key":"bibr7-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCA.2005.851296"},{"key":"bibr8-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2004.12.004"},{"key":"bibr9-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2012.06.009"},{"key":"bibr10-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.jas.2011.07.015"},{"key":"bibr11-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1177\/0037549711423734"},{"key":"bibr12-0037549718757039","first-page":"513","volume-title":"Proceedings of the 34th conference on Winter simulation: exploring new frontiers","author":"Waller AP"},{"key":"bibr13-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1080\/00140139508925243"},{"key":"bibr14-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/0377-2217(86)90293-6"},{"key":"bibr15-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1109\/WSC.2000.899087"},{"key":"bibr16-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1057\/jors.2008.196"},{"key":"bibr17-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1057\/palgrave.jos.4250002"},{"key":"bibr18-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.simpat.2010.01.004"},{"key":"bibr19-0037549718757039","first-page":"13","volume-title":"Strategic advantage of computing information systems in enterprise management","author":"Akpan IJ","year":"2010"},{"key":"bibr20-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.advengsoft.2007.01.025"},{"key":"bibr21-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1061\/(ASCE)0887-3801(2001)15:4(329)"},{"key":"bibr22-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2012.01.170"},{"key":"bibr23-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1061\/(ASCE)CO.1943-7862.0000270"},{"key":"bibr24-0037549718757039","volume-title":"Applied simulation: modeling & analysis using Flexsim","author":"Beaverstock M","year":"2012","edition":"3"},{"key":"bibr25-0037549718757039","first-page":"173","volume-title":"Proceedings of the winter 2002 simulation conference","volume":"1","author":"Rohrer MW"},{"key":"bibr26-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.autcon.2006.09.007"},{"key":"bibr27-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2005.08.003"},{"key":"bibr28-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2016.2596099"},{"key":"bibr29-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/S0926-5805(02)00047-X"},{"key":"bibr30-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1177\/003754978704900304"},{"key":"bibr31-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/0377-2217(91)90101-Z"},{"key":"bibr32-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.simpat.2008.04.022"},{"key":"bibr33-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1177\/003754970107700301"},{"key":"bibr34-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.aei.2011.08.010"},{"key":"bibr35-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1111\/j.1540-5915.1991.tb00344.x"},{"key":"bibr36-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1177\/0037549708101182"},{"key":"bibr37-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1057\/palgrave.jors.2602331"},{"key":"bibr38-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2017.09.007"},{"key":"bibr39-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1057\/palgrave.jors.2601864"},{"key":"bibr40-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2006.17"},{"key":"bibr41-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1061\/(ASCE)0887-3801(2005)19:4(356)"},{"key":"bibr42-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1287\/isre.9.2.194"},{"key":"bibr43-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1518\/001872095779049408"},{"key":"bibr44-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2006.01.006"},{"key":"bibr45-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1518\/001872001775992534"},{"key":"bibr46-0037549718757039","doi-asserted-by":"publisher","DOI":"10.7326\/0003-4819-151-4-200908180-00135"},{"key":"bibr47-0037549718757039","doi-asserted-by":"crossref","first-page":"1061","DOI":"10.1109\/WSC.2002.1166356","volume-title":"Proceedings of the winter simulation conference","volume":"2","author":"Mueller-Wittig W"},{"key":"bibr48-0037549718757039","first-page":"2774","volume-title":"Proceedings of the 2016 winter simulation conference","author":"Hutabarat W"},{"key":"bibr49-0037549718757039","first-page":"124","volume-title":"Proceedings of the Operational Research Society Simulation Workshop 2016 (SW16)","author":"Petti A"},{"key":"bibr50-0037549718757039","first-page":"755","volume-title":"Proceedings of the 35th winter conference on simulation: driving innovation","author":"Fishwick P"},{"key":"bibr51-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1177\/0037549711425180"},{"key":"bibr52-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.autcon.2005.07.007"},{"key":"bibr53-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1080\/0144619032000113690"},{"key":"bibr54-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.simpat.2006.09.020"},{"key":"bibr55-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1108\/01445150310460114"},{"key":"bibr56-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1177\/003754970107700304"},{"key":"bibr57-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.autcon.2012.09.015"},{"key":"bibr58-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1177\/0037549703040232"},{"key":"bibr59-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.compind.2005.01.007"},{"key":"bibr60-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1057\/palgrave.jors.2602353"},{"key":"bibr61-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1007\/s10055-010-0165-7"},{"key":"bibr62-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1287\/orsc.1110.0703"},{"key":"bibr63-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1057\/palgrave.jors.2602096"},{"key":"bibr64-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.simpat.2006.11.011"},{"key":"bibr65-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1177\/0037549704044081"},{"key":"bibr66-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1145\/1103323.1103327"},{"key":"bibr67-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1007\/s00366-013-0323-0"},{"key":"bibr68-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.csi.2012.07.004"},{"key":"bibr69-0037549718757039","doi-asserted-by":"publisher","DOI":"10.2307\/25148705"},{"key":"bibr70-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.advengsoft.2007.07.001"},{"issue":"20","key":"bibr71-0037549718757039","first-page":"293","volume":"12","author":"Kamat VR","year":"2007","journal-title":"ITcon"},{"key":"bibr72-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1080\/02329290290028507"},{"key":"bibr73-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1177\/0037549707086038"},{"key":"bibr74-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1145\/643114.643118"},{"key":"bibr75-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1007\/s11042-013-1584-8"},{"key":"bibr76-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/S0141-9382(00)00024-X"},{"key":"bibr77-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2007.01.030"},{"key":"bibr78-0037549718757039","doi-asserted-by":"publisher","DOI":"10.2307\/25148635"},{"key":"bibr79-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/S0926-5805(03)00019-0"},{"key":"bibr80-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.procir.2013.06.009"},{"key":"bibr81-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1080\/00207540600806430"},{"key":"bibr82-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmatprotec.2004.04.401"},{"key":"bibr83-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/S0928-4869(01)00045-3"},{"key":"bibr84-0037549718757039","doi-asserted-by":"publisher","DOI":"10.2307\/23042806"},{"key":"bibr85-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1080\/00207540410001699426"},{"key":"bibr86-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1145\/1842722.1842727"},{"key":"bibr87-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.simpat.2007.01.005"},{"key":"bibr88-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjsurg.2006.06.050"},{"key":"bibr89-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1080\/09511920500069259"},{"key":"bibr90-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1109\/38.946631"},{"key":"bibr91-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2012.05.099"},{"key":"bibr92-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1177\/1548512913504839"},{"key":"bibr93-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1007\/s12289-013-1157-4"},{"key":"bibr94-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.cie.2011.07.003"},{"key":"bibr95-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.cie.2015.04.032"},{"key":"bibr96-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2013.05.035"},{"key":"bibr97-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2009.07.059"},{"key":"bibr98-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1080\/09613210600942218"},{"key":"bibr99-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2012.07.045"},{"key":"bibr100-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.dss.2011.08.008"},{"key":"bibr101-0037549718757039","doi-asserted-by":"publisher","DOI":"10.3846\/1392-8619.2008.14.478-491"},{"key":"bibr102-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2010.08.004"},{"key":"bibr103-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2012.01.146"},{"key":"bibr104-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.autcon.2008.02.016"},{"key":"bibr105-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/S0926-5805(01)00049-8"},{"key":"bibr106-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1139\/l2012-077"},{"key":"bibr107-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1179\/174329306X107692"},{"key":"bibr108-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1016\/j.suronc.2016.05.023"},{"key":"bibr109-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1080\/19475705.2014.983188"},{"key":"bibr110-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1007\/s11837-016-1892-3"},{"key":"bibr111-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1007\/s10664-008-9102-8"},{"key":"bibr112-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1287\/inte.19.5.71"},{"key":"bibr113-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1057\/jors.1993.118"},{"key":"bibr114-0037549718757039","first-page":"681","volume-title":"Proceedings of the 28th winter conference on simulation","author":"Pidd M"},{"key":"bibr115-0037549718757039","first-page":"101","volume-title":"Proceedings of the 1996 winter simulation conference","author":"Barnes M"},{"key":"bibr116-0037549718757039","doi-asserted-by":"publisher","DOI":"10.1115\/1.1587745"}],"container-title":["SIMULATION"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0037549718757039","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/0037549718757039","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/0037549718757039","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T11:29:02Z","timestamp":1777634942000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/0037549718757039"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,2,27]]},"references-count":116,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2019,2]]}},"alternative-id":["10.1177\/0037549718757039"],"URL":"https:\/\/doi.org\/10.1177\/0037549718757039","relation":{},"ISSN":["0037-5497","1741-3133"],"issn-type":[{"value":"0037-5497","type":"print"},{"value":"1741-3133","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,2,27]]}}}