{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T18:21:29Z","timestamp":1776104489503,"version":"3.50.1"},"reference-count":56,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW1","license":[{"start":{"date-parts":[[2021,4,13]],"date-time":"2021-04-13T00:00:00Z","timestamp":1618272000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2021,4,13]]},"abstract":"<jats:p>Physical face-to-face collaboration with someone gives a higher-quality experience compared to mediated communication options, such as a phone- or video-based chat. Participants can share rich sensory cues to multiple human senses in a physical space. Also, the perceptual sensing of the surrounding environment including other peoples' reactions can influence human communication and emotion, and thus collaborative performance. Shared spaces in virtual environments provide degraded sensory experiences because most commercial virtual reality systems typically provide only visual and audio feedback. The impact of richer, multi-sensory feedback on joint decision-making tasks in VR is still an open area of research. Two independent studies exploring this topic are presented in this paper. We implemented a multi-sensory system that delivers vision, audio, tactile, and smell feedback, and we compared the system to a typical VR system. The scenario placed two users in a virtual theme-park safari ride with a number of non-player character (NPC) passengers to simulate realistic scenarios compared to the real-world and we varied the type and complexity of NPCs reactions to participants.<\/jats:p>\n          <jats:p>In Experiment 1, we provided both users with either multi-sensory or typical sensory feedback symmetrically as a between-subjects factor, and used NPC reaction type as a within-subjects factor. In Experiment 2, we provided sensory feedback asymmetrically to each user (i.e., one had multi-sensory cues and the other had typical sensory cues) as a between-subjects factor, and used NPC reaction type as a within-subjects factor. We found that the number of sensory channels and NPC reactions did not influence user perception significantly under either symmetric or asymmetric sensory feedback conditions. However, after accounting for individual personality traits (e.g., assertive, passive), as well as any existing relationship between the pairs, we found that increasing the number of sensory channels can significantly improve subjective responses.<\/jats:p>","DOI":"10.1145\/3449146","type":"journal-article","created":{"date-parts":[[2021,4,22]],"date-time":"2021-04-22T17:51:09Z","timestamp":1619113869000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":30,"title":["On the Use of Multi-sensory Cues in Symmetric and Asymmetric Shared Collaborative Virtual Spaces"],"prefix":"10.1145","volume":"5","author":[{"given":"Sungchul","family":"Jung","sequence":"first","affiliation":[{"name":"University of Canterbury, Christchurch, New Zealand"}]},{"given":"Nawam","family":"Karki","sequence":"additional","affiliation":[{"name":"University of Canterbury, Christchurch, New Zealand"}]},{"given":"Max","family":"Slutter","sequence":"additional","affiliation":[{"name":"University of Twente, Enschede, Netherlands"}]},{"given":"Robert W.","family":"Lindeman","sequence":"additional","affiliation":[{"name":"University of Canterbury, Christchurch, New Zealand"}]}],"member":"320","published-online":{"date-parts":[[2021,4,22]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1177\/0146167203029007002"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2145204.2145302"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01409795"},{"key":"e_1_2_1_4_1","volume-title":"Passive, and Assertive: Which Communication Style Is Commonly Used by College Students? SSRN","author":"Bocar Anna C.","year":"2017","unstructured":"Anna C. Bocar. 2017. Aggressive, Passive, and Assertive: Which Communication Style Is Commonly Used by College Students? SSRN (2017)."},{"key":"e_1_2_1_5_1","volume-title":"Ready player one","author":"Cline Ernest","unstructured":"Ernest Cline. 2011. Ready player one. New York: Crown Publishers."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1207\/S1532785XMEP0204_02"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","unstructured":"A. Dey H. Chen C. Zhuang M. Billinghurst and R. W. Lindeman. 2018. Effects of Sharing Real-Time Multi-Sensory Heart Rate Feedback in Different Immersive Collaborative Virtual Environments. In 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 165--173. https:\/\/doi.org\/10.1109\/ISMAR.2018.00052","DOI":"10.1109\/ISMAR.2018.00052"},{"key":"e_1_2_1_8_1","volume-title":"Ecorys report | VR & AR set to create up to 480,000 jobs by","year":"2020","unstructured":"Ecorys. 2017. Ecorys report | VR & AR set to create up to 480,000 jobs by 2020. https:\/\/ec.europa.eu\/futurium\/en\/connect-university\/vr-ar-set-create-480000-jobs-2020."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.17077\/drivingassessment.1639"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","unstructured":"M. Feng A. Dey and R. W. Lindeman. 2016a. The effect of multi-sensory cues on performance and experience during walking in immersive virtual environments. In 2016 IEEE Virtual Reality (VR). 173--174. https:\/\/doi.org\/10.1109\/VR.2016.7504709","DOI":"10.1109\/VR.2016.7504709"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DUI.2016.7460037"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DUI.2015.7131744"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbusres.2018.10.050"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03193146"},{"key":"e_1_2_1_15_1","volume-title":"Studying the Sense of Embodiment in VR Shared Experiences. 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR)","author":"Fribourg Rebecca","year":"2018","unstructured":"Rebecca Fribourg, Ferran Argelaguet, Ludovic Hoyet, and Anatole L\u00e9cuyer. 2018. Studying the Sense of Embodiment in VR Shared Experiences. 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) (2018), 273--280."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/358916.358947"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/143457.143474"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2071396.2071398"},{"key":"e_1_2_1_19_1","unstructured":"William Gibson. 1984. Neuromancer. New York :Ace Science Fiction Books."},{"key":"e_1_2_1_20_1","volume-title":"Characterizing Asymmetric Collaborative Interactions in Virtual and Augmented Realities. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 127--135","author":"Grandi J. G.","unstructured":"J. G. Grandi, H. G. Debarba, and A. Maciel. 2019. Characterizing Asymmetric Collaborative Interactions in Virtual and Augmented Realities. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 127--135."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025683"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300239"},{"key":"e_1_2_1_23_1","unstructured":"Heilig Morton L. 1961. Sensorama simulator. https:\/\/patents.google.com\/patent\/US3050870A\/en"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/142750.142769"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1068\/b35011"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2014.00736"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/159764.159762"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/351006.351018"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2002.1012339"},{"key":"e_1_2_1_30_1","volume-title":"Hughes","author":"Jung Sungchul","year":"2016","unstructured":"Sungchul Jung and Charles E. Hughes. 2016. The Effects of Indirect Real Body Cues of Irrelevant Parts on Virtual Body Ownership and Presence. In ICAT-EGVE 2016 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments. 107--114."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3131277.3132186"},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the 25th IEEE Conference on Virtual Reality and 3D User Interfaces, IEEE VR 2018.","author":"Jung Sungchul","unstructured":"Sungchul Jung, Pamela J Wisniewski, and Charles E. Hughes. 2018. In Limbo: The Effect of Gradual Visual Transition between Real and Virtual on Virtual Body Ownership Illusion and Presence. In Proceedings of the 25th IEEE Conference on Virtual Reality and 3D User Interfaces, IEEE VR 2018."},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the 27th IEEE Conference on Virtual Reality and 3D User Interfaces, IEEE VR 2020.","author":"Jung Sungchul","unstructured":"Sungchul Jung, Andrew L. Wood, Simon Hoermann, Pramuditha L. Abhayawardhana, and Robert W. Lindeman. 2020. The Impact of Multi-sensory Stimuli on Confidence Levels for Perceptual-cognitive Tasks in VR. In Proceedings of the 27th IEEE Conference on Virtual Reality and 3D User Interfaces, IEEE VR 2020."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2015.00141"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00371-016-1294-0"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2821592.2821626"},{"key":"e_1_2_1_37_1","volume-title":"Introduction to Sociology 2nd canadian edition ed.). https:\/\/opentextbc.ca\/introductionto","author":"Little William","unstructured":"William Little. 2016. Introduction to Sociology 2nd canadian edition ed.). https:\/\/opentextbc.ca\/introductionto."},{"key":"e_1_2_1_38_1","volume-title":"Improvement of olfactory display using solenoid valves","author":"Nakamoto Takamichi","unstructured":"Takamichi Nakamoto and Hai Pham Dinh Minh. 2007. Improvement of olfactory display using solenoid valves. IEEE, 179--186."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.3390\/mti2040061"},{"key":"e_1_2_1_40_1","unstructured":"World Health Organization. 2020. Coronavirus disease (COVID-19) outbreak. https:\/\/www.who.int\/emergencies\/diseases\/novel-coronavirus-2019."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0189078"},{"key":"e_1_2_1_42_1","volume-title":"Gartner Top 10 Strategic Technology Trends for","author":"Panetta Kasey","year":"2020","unstructured":"Kasey Panetta. 2020. Gartner Top 10 Strategic Technology Trends for 2020. https:\/\/www.gartner.com\/smarterwithgartner\/gartner-top-10-strategic-technology-trends-for-2020\/."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40864-015-0012-y"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/302979.303113"},{"key":"e_1_2_1_45_1","volume-title":"Kai Vogeley, and Gary Bente.","author":"Roth Daniel","year":"2015","unstructured":"Daniel Roth, Marc Erich Latoschik, Kai Vogeley, and Gary Bente. 2015. Hybrid Avatar-Agent Technology -- A Conceptual Step Towards Mediated \"Social\" Virtual Reality and its Respective Challenges. i-com, Vol. 14, 2 (2015)."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267782.3267791"},{"key":"e_1_2_1_47_1","volume-title":"Effective presentation technique of scent using small ejection quantities of odor","author":"Sato Junta","unstructured":"Junta Sato, Kaori Ohtsu, Yuichi Bannai, and Ken-ichi Okada. 2009. Effective presentation technique of scent using small ejection quantities of odor. IEEE, 151--158."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3134301"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2009.0138"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ipm.2003.10.002"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/VR.2016.7504689"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/VR.1999.756941"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCG.2012.110"},{"key":"e_1_2_1_54_1","first-page":"37","volume-title":"Seite von - bis","author":"Szalavari Zsolt","unstructured":"Zsolt Szalavari, Dieter Schmalstieg, Anton Fuhrmann, and Michael Gervautz. 1998. \"Studierstube\" - An Environment for Collaboration in Augmented Reality 1 ed.).., Seite von - bis: pp. 37--49."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1162\/105474600566989"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/1460563.1460615"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449146","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3449146","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:17Z","timestamp":1750191497000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3449146"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,13]]},"references-count":56,"journal-issue":{"issue":"CSCW1","published-print":{"date-parts":[[2021,4,13]]}},"alternative-id":["10.1145\/3449146"],"URL":"https:\/\/doi.org\/10.1145\/3449146","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,13]]},"assertion":[{"value":"2021-04-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}