{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T16:47:50Z","timestamp":1776098870770,"version":"3.50.1"},"reference-count":61,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2025,5,2]],"date-time":"2025-05-02T00:00:00Z","timestamp":1746144000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"crossref","award":["2024YFE0200800"],"award-info":[{"award-number":["2024YFE0200800"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100006374","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62321001, 62471055, 62406039, 62401080, U23B2001, 62101064, 62171057, 62201072, 62001054, 62071067"],"award-info":[{"award-number":["62321001, 62471055, 62406039, 62401080, U23B2001, 62101064, 62171057, 62201072, 62001054, 62071067"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Ministry of Education and China Mobile Joint Fund","award":["MCM20200202, MCM20180101"],"award-info":[{"award-number":["MCM20200202, MCM20180101"]}]},{"DOI":"10.13039\/501100006374","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["2024PTB-004"],"award-info":[{"award-number":["2024PTB-004"]}],"id":[{"id":"10.13039\/501100006374","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2025,5,2]]},"abstract":"<jats:p>Whiteboard collaboration in virtual reality (VR) is an important task in collaborative virtual environments. The current research mainly relies on the use of controllers or dedicated pens but additional devices will cause inconvenience to users. Bare-hand writing offers rich collaborative semantics through natural gestures but remains underexplored. This paper addresses challenges and solutions for bare-hand whiteboard collaboration. We analyze the input process and identify key challenges in determining pen-drop, writing, and pen-lift intentions while maintaining user control over their avatar. Our approach addresses two VR scenarios: one without and one with physical planes. The method for the first case is called Air-writing, which dynamically adjusts the distance between the avatar's torso and the virtual whiteboard during the processes of pen-drop and pen-lift to ensure a consistent writing experience in VR. The method for the second case is called Physical-writing, which allows users to write smoothly with passive haptic feedback and physical constraints provided by the real surface by remapping the whiteboard in VR with a plane in reality. A comprehensive user study is conducted to evaluate communication efficiency, input accuracy, collaboration efficiency, and user experience of the two methods. The experimental results indicate that bare-hand interaction improves communication efficiency by 8% over controllers and performs similarly to real-world whiteboard collaboration. The Physical-writing method also demonstrates higher accuracy and user satisfaction compared to the Air-writing method.<\/jats:p>","DOI":"10.1145\/3711092","type":"journal-article","created":{"date-parts":[[2025,5,20]],"date-time":"2025-05-20T11:36:19Z","timestamp":1747740979000},"page":"1-31","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Towards Bare-Hand Interaction for Whiteboard Collaboration in Virtual Reality"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-0427-824X","authenticated-orcid":false,"given":"Guangtian","family":"Liu","sequence":"first","affiliation":[{"name":"State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-0150-2771","authenticated-orcid":false,"given":"Haonan","family":"Su","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2182-2228","authenticated-orcid":false,"given":"Jingyu","family":"Wang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing, China and Pengcheng Laboratory, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0829-4624","authenticated-orcid":false,"given":"Qi","family":"Qi","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3072-7422","authenticated-orcid":false,"given":"Haifeng","family":"Sun","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3345-1732","authenticated-orcid":false,"given":"Zirui","family":"Zhuang","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1691-6457","authenticated-orcid":false,"given":"Pengfei","family":"Ren","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing, China and E-byte.com, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1486-0573","authenticated-orcid":false,"given":"Jianxin","family":"Liao","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications, Beijing, China"}]}],"member":"320","published-online":{"date-parts":[[2025,5,2]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2023. Connect Meta Quest to your PC over Wi-Fi with Air Link. https:\/\/www.meta.com\/help\/quest\/articles\/headsetsand- accessories\/oculus-link\/connect-with-air-link\/."},{"key":"e_1_2_1_2_1","unstructured":"2023. High Definition Render Pipeline (HDRP). https:\/\/unity.com\/srp\/High-Definition-Render-Pipeline."},{"key":"e_1_2_1_3_1","unstructured":"2023. Mirror Networking -- Open Source Networking for Unity. https:\/\/mirror-networking.com."},{"key":"e_1_2_1_4_1","unstructured":"2023. Unity Real-Time Development Platform. https:\/\/unity.com."},{"key":"e_1_2_1_5_1","unstructured":"2023. WritePadSDK. https:\/\/github.com\/phatware\/WritePadSDK."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3486582"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173779"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cag.2012.12.003"},{"key":"e_1_2_1_9_1","volume-title":"Non-verbal communication in human social interaction. Non-verbal communication 2, 1","author":"Argyle Michael","year":"1972","unstructured":"Michael Argyle. 1972. Non-verbal communication in human social interaction. Non-verbal communication 2, 1 (1972)."},{"key":"e_1_2_1_10_1","first-page":"5643","article-title":"Experimental Evaluation of Sketching on Surfaces in VR","volume":"17","author":"Arora Rahul","year":"2017","unstructured":"Rahul Arora, Rubaiat Habib Kazi, Fraser Anderson, Tovi Grossman, Karan Singh, and George W Fitzmaurice. 2017. Experimental Evaluation of Sketching on Surfaces in VR.. In CHI, Vol. 17. 5643--5654.","journal-title":"CHI"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858226"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447310802205776"},{"key":"e_1_2_1_13_1","volume-title":"Nonverbal communication","author":"Burgoon Judee K","unstructured":"Judee K Burgoon, Valerie Manusov, and Laura K Guerrero. 2021. Nonverbal communication. Routledge."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2023.103045"},{"key":"e_1_2_1_15_1","volume-title":"Unscripted retargeting: Reach prediction for haptic retargeting in virtual reality. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR)","author":"Clarence Aldrich","unstructured":"Aldrich Clarence, Jarrod Knibbe, Maxime Cordeil, and MichaelWybrow. 2021. Unscripted retargeting: Reach prediction for haptic retargeting in virtual reality. In 2021 IEEE Virtual Reality and 3D User Interfaces (VR). IEEE, 150--159."},{"key":"e_1_2_1_16_1","volume-title":"Remote virtual whiteboard assistance for improving task performance during lunar surface operations. Virtual Reality","author":"Davis Leah","year":"2022","unstructured":"Leah Davis, Neil McHenry, Manuel Carrera, Lauren Brady, Kevin Mayorga, Brock Balthazor, Israel Gomez, Gregory Chamitoff, and Ana Diaz-Artiles. 2022. Remote virtual whiteboard assistance for improving task performance during lunar surface operations. Virtual Reality (2022), 1--12."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196737"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3472749.3474810"},{"key":"e_1_2_1_19_1","volume-title":"Handwriting for efficient text entry in industrial VR applications: influence of board orientation and sensory feedback on performance","author":"Fourrier Nicolas","year":"2023","unstructured":"Nicolas Fourrier, Guillaume Moreau, Mustapha Benaouicha, and Jean-Marie Normand. 2023. Handwriting for efficient text entry in industrial VR applications: influence of board orientation and sensory feedback on performance. IEEE Transactions on Visualization and Computer Graphics (2023)."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267782.3267790"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3611659.3615716"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/CTS.2012.6261054"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-20068-7_19"},{"key":"e_1_2_1_24_1","volume-title":"Verbal and nonverbal communication in high-immersion virtual reality for language learners. Intelligent CALL, granular systems, and learner data: short papers from EUROCALL","author":"Gruber Alice","year":"2022","unstructured":"Alice Gruber and Regina Kaplan-Rakowski. 2022. Verbal and nonverbal communication in high-immersion virtual reality for language learners. Intelligent CALL, granular systems, and learner data: short papers from EUROCALL (2022), 129--134."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jenvp.2023.102137"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10798-016-9379-7"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1037\/e577632012-009"},{"key":"e_1_2_1_28_1","volume-title":"Metaverse classroom exploration. In 2022 Intermountain Engineering, Technology and Computing (IETC)","author":"Hedrick Emily","unstructured":"Emily Hedrick, Michael Harper, Eric Oliver, and Daniel Hatch. 2022. Teaching & learning in virtual reality: Metaverse classroom exploration. In 2022 Intermountain Engineering, Technology and Computing (IETC). IEEE, 1--5."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/191666.191821"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR55827.2022.00070"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3586183.3606713"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.3390\/mti6010006"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1749-818X.2008.00067.x"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.3390\/app13010299"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/PACIFICVIS.2015.7156378"},{"key":"e_1_2_1_36_1","volume-title":"JDCAD: A highly interactive 3D modeling system. Computers & graphics 18, 4","author":"Liang Jiandong","year":"1994","unstructured":"Jiandong Liang and Mark Green. 1994. JDCAD: A highly interactive 3D modeling system. Computers & graphics 18, 4 (1994), 499--506."},{"key":"e_1_2_1_37_1","volume-title":"Max M\u00f6bus, Andreas Fender, and Christian Holz.","author":"Luong Tiffany","year":"2023","unstructured":"Tiffany Luong, Yi Fei Cheng, Max M\u00f6bus, Andreas Fender, and Christian Holz. 2023. Controllers or Bare Hands? A Controlled Evaluation of Input Techniques on Interaction Performance and Exertion in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics (2023)."},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the ACM on Human-Computer Interaction 4, CSCW2","author":"Maloney Divine","year":"2020","unstructured":"Divine Maloney, Guo Freeman, and Donghee YvetteWohn. 2020. '' Talking without a Voice'' Understanding Non-verbal Communication in Social Virtual Reality. Proceedings of the ACM on Human-Computer Interaction 4, CSCW2 (2020), 1--25."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.3390\/mti4040091"},{"key":"e_1_2_1_40_1","volume-title":"Stewart Von Itzstein, and Ross Smith","author":"Matthews Brandon","year":"2021","unstructured":"Brandon Matthews, Bruce H Thomas, Stewart Von Itzstein, and Ross Smith. 2021. Adaptive Reset Techniques for Haptic Retargeted Interaction. IEEE Transactions on Visualization and Computer Graphics (2021)."},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/VR.2019.8797974"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174227"},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the 33rd annual ACM conference on human factors in computing systems. 2143--2152","author":"McGill Mark","year":"2015","unstructured":"Mark McGill, Daniel Boland, Roderick Murray-Smith, and Stephen Brewster. 2015. A dose of reality: Overcoming usability challenges in vr head-mounted displays. In Proceedings of the 33rd annual ACM conference on human factors in computing systems. 2143--2152."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-16234-3_2"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501898"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-02686-8_72"},{"key":"e_1_2_1_47_1","volume-title":"Computer graphics forum","author":"Poupyrev Ivan","unstructured":"Ivan Poupyrev, Tadao Ichikawa, Suzanne Weghorst, and Mark Billinghurst. 1998. Egocentric object manipulation in virtual environments: empirical evaluation of interaction techniques. In Computer graphics forum, Vol. 17. Wiley Online Library, 41--52."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/274644.274692"},{"key":"e_1_2_1_49_1","volume-title":"Controlling Continuous Locomotion in Virtual Reality with Bare Hands Using Hand Gestures. In International Conference on Virtual Reality and Mixed Reality. Springer, 191--205","author":"Sch\u00e4fer Alexander","year":"2022","unstructured":"Alexander Sch\u00e4fer, Gerd Reis, and Didier Stricker. 2022. Controlling Continuous Locomotion in Virtual Reality with Bare Hands Using Hand Gestures. In International Conference on Virtual Reality and Mixed Reality. Springer, 191--205."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1080\/15710882.2015.1054841"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1002\/j.2162-6057.2001.tb01045.x"},{"key":"e_1_2_1_52_1","volume-title":"2021 IEEE conference on virtual reality and 3D user interfaces abstracts and workshops (VRW). IEEE, 534--535","author":"Takashina Tomomi","year":"2021","unstructured":"Tomomi Takashina, Mitsuru Ito, Hitoshi Nagaura, and Eisuke Wakabayashi. 2021. Evaluation of curved raycastingbased interactive surfaces in virtual environments. In 2021 IEEE conference on virtual reality and 3D user interfaces abstracts and workshops (VRW). IEEE, 534--535."},{"key":"e_1_2_1_53_1","unstructured":"Theophilus Teo Kuniharu Sakurada Masaaki Fukuoka and Maki Sugimoto. 2022. Evaluating Techniques to Share Hand Gestures for Remote Collaboration using Top-Down Projection in a Virtual Environment.. In ICAT-EGVE. 17--25."},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1145\/3560817"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3027063.3053239"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.3390\/electronics11244152"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.3724\/SP.J.2096-5796.2018.0006"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/MODELS50736.2021.00034"},{"key":"e_1_2_1_59_1","volume-title":"2015 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI). IEEE, 545--548","author":"Yu Jeongmin","year":"2015","unstructured":"Jeongmin Yu, Seungtak Noh, Youngkyoon Jang, Gabyong Park, and Woontack Woo. 2015. A hand-based collaboration framework in egocentric coexistence reality. In 2015 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI). IEEE, 545--548."},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2021.3067777"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.3390\/sym12101723"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3711092","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3711092","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T09:27:29Z","timestamp":1755768449000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3711092"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,2]]},"references-count":61,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,5,2]]}},"alternative-id":["10.1145\/3711092"],"URL":"https:\/\/doi.org\/10.1145\/3711092","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,2]]},"assertion":[{"value":"2025-05-02","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}