{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,20]],"date-time":"2026-05-20T16:47:14Z","timestamp":1779295634945,"version":"3.51.4"},"reference-count":34,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,12,27]],"date-time":"2023-12-27T00:00:00Z","timestamp":1703635200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ministry of Science and Technology, ROC (Taiwan)","award":["MOST 110-2221-E-A49-114"],"award-info":[{"award-number":["MOST 110-2221-E-A49-114"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Virtual Worlds"],"abstract":"<jats:p>Design discussion is crucial in the architectural design process. To enhance the spatial understanding of 3D space and discussion effectiveness, recently, some systems have been proposed to support design discussion interactively in an immersive virtual environment. The entire design discussion can be archived and potentially become course materials for future learners. In this paper, we propose an asynchronous VR exploration system that aims to help learners explore content effectively and efficiently anywhere and at any time. To improve effectiveness and efficiency, we also propose a summarization-to-detail approach with the application space by which students can observe the visualization of spatial summarization of actions and participants\u2019 dwell time or the temporal distribution of dialogues and then locate the important or interesting region or dialogue for further exploration. To further explore the discussion content, students can call the preview to see the time-lapse animation of the object operation to understand the change in models or playback to view the discussion details. We conducted an exploratory user study with 10 participants to evaluate user experience, user impression, and effectiveness of learning the design discussion course content using our asynchronous VR design discussion content exploration system. The results indicate that the interactive VR exploration system presented can help learners study the design discussion content effectively. Participants also provided some positive feedback and confirmed the usefulness and value of the system presented. Our applications and lessons learned have implications for future asynchronous VR exploration systems, not only for architectural design discussion content, but also for other applications, such as industrial visual inspections and educational visualizations of design discussions.<\/jats:p>","DOI":"10.3390\/virtualworlds3010001","type":"journal-article","created":{"date-parts":[[2023,12,27]],"date-time":"2023-12-27T07:45:32Z","timestamp":1703663132000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Design and Evaluation of an Asynchronous VR Exploration System for Architectural Design Discussion Content"],"prefix":"10.3390","volume":"3","author":[{"given":"Hsuan-Ming","family":"Chang","sequence":"first","affiliation":[{"name":"Department of Computer Science, National Yang Ming Chiao Tung University, Hsinchu 30010, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ting-Wei","family":"Hsu","sequence":"additional","affiliation":[{"name":"Department of Computer Science, National Yang Ming Chiao Tung University, Hsinchu 30010, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ming-Han","family":"Tsai","sequence":"additional","affiliation":[{"name":"Department of Information Engineering and Computer Science, Feng Chia University, Taichung 40724, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8348-0534","authenticated-orcid":false,"given":"Sabarish V.","family":"Babu","sequence":"additional","affiliation":[{"name":"School of Computing, Clemson University, Clemson, SC 29634, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9038-6124","authenticated-orcid":false,"given":"Jung-Hong","family":"Chuang","sequence":"additional","affiliation":[{"name":"Department of Computer Science, National Yang Ming Chiao Tung University, Hsinchu 30010, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,12,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Anderson, L., Esser, J., and Interrante, V. (2003, January 22\u201323). A virtual environment for conceptual design in architecture. Proceedings of the ACM Workshop on Virtual Environments 2003, Zurich, Switzerland.","DOI":"10.1145\/769953.769960"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"031013","DOI":"10.1115\/1.4036921","article-title":"A review of the capabilities of current low-cost virtual reality technology and its potential to enhance the design process","volume":"17","author":"Coburn","year":"2017","journal-title":"J. Comput. Inf. Sci. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"376","DOI":"10.1016\/j.compenvurbsys.2015.05.001","article-title":"To go where no man has gone before: Virtual reality in architecture, landscape architecture and environmental planning","volume":"54","author":"Portman","year":"2015","journal-title":"Comput. Environ. Urban Syst."},{"key":"ref_4","first-page":"285","article-title":"The design studio \u201ccrit\u201d: Teacher\u2013student communication","volume":"24","author":"Goldschmidt","year":"2010","journal-title":"AI Edam"},{"key":"ref_5","unstructured":"Castronovo, F., Nikolic, D., Liu, Y., and Messner, J. (2013, January 30\u201331). An evaluation of immersive virtual reality systems for design reviews. Proceedings of the 13th International Conference on Construction Applications of Virtual Reality, London, UK."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Hsu, T., Tsai, M., Babu, S.V., Hsu, P., Chang, H., Lin, W., and Chuang, J. (2020, January 22\u201326). Design and Initial Evaluation of a VR based Immersive and Interactive Architectural Design Discussion System. Proceedings of the 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Atlanta, GA, USA.","DOI":"10.1109\/VR46266.2020.00056"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Stoakley, R., Conway, M.J., and Pausch, R. (1995, January 7\u201311). Virtual reality on a WIM: Interactive worlds in miniature. Proceedings of the CHI, Denver, CO, USA.","DOI":"10.1145\/223904.223938"},{"key":"ref_8","unstructured":"Inoue, S., Rodgers, P., Spencer, N., and Tennant, A. (2015, January 22\u201324). Reductionism as a tool for creative exploration. Proceedings of the European Academy of Design Conference, Paris, France."},{"key":"ref_9","unstructured":"Goldschmidt, G. (2014). An Anthology of Theories and Models of Design, Springer."},{"key":"ref_10","unstructured":"Messner, J.I., Yerrapathruni, S.C., Baratta, A.J., and Whisker, V.E. (2003, January 22\u201325). Using virtual reality to improve construction engineering education. Proceedings of the American Society for Engineering Education Annual Conference & Exposition, Nashville, TN, USA."},{"key":"ref_11","first-page":"435","article-title":"Spatial understanding in immersive virtual environments","volume":"1","author":"Schnabel","year":"2003","journal-title":"Int. J. Archit. Comput."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Bruder, G., Steinicke, F., and Hinrichs, K.H. (2009, January 14\u201315). Arch-explore: A natural user interface for immersive architectural walkthroughs. Proceedings of the 2009 IEEE Symposium on 3D User Interfaces, Lafayette, LA, USA.","DOI":"10.1109\/3DUI.2009.4811208"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1456650.1456652","article-title":"A review of overview+ detail, zooming, and focus+ context interfaces","volume":"41","author":"Cockburn","year":"2009","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_14","unstructured":"Kraak, M.J. (2003, January 10\u201316). The space-time cube revisited from a geovisualization perspective. Proceedings of the 21st International Cartographic Conference, Durban, South Africa."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Coulton, P., Bamford, W., Cheverst, K., and Rashid, O. (2008). 3D Space-Time Visualization of Player Behaviour in Pervasive Location-Based Games. Int. J. Comput. Games Technol.","DOI":"10.1155\/2008\/192153"},{"key":"ref_16","unstructured":"Zeng, W., Zhong, C., Anwar, A., Arisona, S.M., and McLoughlin, I.V. (2012, January 12\u201314). MetroBuzz: Interactive 3D visualization of spatiotemporal data. Proceedings of the 2012 International Conference on Computer Information Science (ICCIS), Kuala Lumpur, Malaysia."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Von Landesberger, T., Bremm, S., Andrienko, N., Andrienko, G., and Teku\u0161ov\u00e1, M. (2012, January 14\u201319). Visual analytics methods for categoric spatio-temporal data. Proceedings of the 2012 IEEE Conference on Visual Analytics Science and Technology (VAST), Seattle, WA, USA.","DOI":"10.1109\/VAST.2012.6400553"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1109\/TVCG.2017.2745320","article-title":"EventThread: Visual Summarization and Stage Analysis of Event Sequence Data","volume":"24","author":"Guo","year":"2018","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Shapiro, B.R. (2017, January 6\u201311). Using Space Time Visualization in Learning Environment Design. Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, CHI EA\u201917, New York, NY, USA.","DOI":"10.1145\/3027063.3048422"},{"key":"ref_20","first-page":"1321","article-title":"A taxonomy of mixed reality visual displays","volume":"77","author":"Milgram","year":"1994","journal-title":"IEICE Trans. Inf. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Mulloni, A., Seichter, H., and Schmalstieg, D. (2012, January 21\u201325). Indoor navigation with mixed reality world-in-miniature views and sparse localization on mobile devices. Proceedings of the International Working Conference on Advanced Visual Interfaces, Capri Island, Italy.","DOI":"10.1145\/2254556.2254595"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Bonsch, A., Freitag, S., and Kuhlen, T.W. (2016, January 19\u201323). Automatic generation of world in miniatures for realistic architectural immersive virtual environments. Proceedings of the 2016 IEEE Virtual Reality (VR), Greenville, SC, USA.","DOI":"10.1109\/VR.2016.7504700"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Danyluk, K., Ens, B., Jenny, B., and Willett, W. (2021, January 8\u201313). A design space exploration of worlds in miniature. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.","DOI":"10.1145\/3411764.3445098"},{"key":"ref_24","unstructured":"Shneiderman, B. (1996, January 3\u20136). The eyes have it: A task by data type taxonomy for information visualizations. Proceedings of the 1996 IEEE Symposium on Visual Languages, Boulder, CO, USA."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhang, N., Tian, Y., and Patel, J.M. (2010, January 1\u20136). Discovery-driven graph summarization. Proceedings of the 2010 IEEE 26th International Conference on Data Engineering (ICDE 2010), Long Beach, CA, USA.","DOI":"10.1109\/ICDE.2010.5447830"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1109\/TVCG.2012.65","article-title":"TripAdvisorN-D: A Tourism-Inspired High-Dimensional Space Exploration Framework with Overview and Detail","volume":"19","author":"Nam","year":"2013","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1111\/cgf.12629","article-title":"Interactive visual analysis for vehicle detector data","volume":"Volume 34","author":"Chen","year":"2015","journal-title":"Proceedings of the Computer Graphics Forum"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1111\/cgf.13408","article-title":"Design Factors for Summary Visualization in Visual Analytics","volume":"37","author":"Sarikaya","year":"2018","journal-title":"Comput. Graph. Forum"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Khan, A., Sepasgozar, S., Liu, T., and Yu, R. (2021). Integration of BIM and immersive technologies for AEC: A scientometric-SWOT analysis and critical content review. Buildings, 11.","DOI":"10.3390\/buildings11030126"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1207\/s15327108ijap0303_3","article-title":"Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness","volume":"3","author":"Kennedy","year":"1993","journal-title":"Int. J. Aviat. Psychol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"113","DOI":"10.3758\/BRM.41.1.113","article-title":"NASA TLX: Software for assessing subjective mental workload","volume":"41","author":"Cao","year":"2009","journal-title":"Behav. Res. Methods"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1162\/pres.1994.3.2.130","article-title":"Depth of presence in virtual environments","volume":"3","author":"Slater","year":"1994","journal-title":"Presence Teleoperat. Virtual Environ."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1162\/105474603322761289","article-title":"The effect of the agency and anthropomorphism on users\u2019 sense of telepresence, copresence, and social presence in virtual environments","volume":"12","author":"Nowak","year":"2003","journal-title":"Presence Teleoperat. Virtual Environ."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1080\/10447319509526110","article-title":"IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use","volume":"7","author":"Lewis","year":"1995","journal-title":"Int. J.-Hum.-Comput. Interact."}],"container-title":["Virtual Worlds"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2813-2084\/3\/1\/1\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:42:47Z","timestamp":1760132567000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2813-2084\/3\/1\/1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,27]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,3]]}},"alternative-id":["virtualworlds3010001"],"URL":"https:\/\/doi.org\/10.3390\/virtualworlds3010001","relation":{},"ISSN":["2813-2084"],"issn-type":[{"value":"2813-2084","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,27]]}}}