{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T06:33:58Z","timestamp":1767854038038,"version":"3.49.0"},"reference-count":54,"publisher":"Association for Computing Machinery (ACM)","issue":"3","funder":[{"DOI":"10.13039\/501100012166","name":"National Key R&D Program of China","doi-asserted-by":"crossref","award":["2022ZD0118001"],"award-info":[{"award-number":["2022ZD0118001"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["U22A2022 & 62332017"],"award-info":[{"award-number":["U22A2022 & 62332017"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2025,9,3]]},"abstract":"<jats:p>Virtual Reality (VR) painting applications allow users to create visual imagery in 3D space. However, existing bare-hand VR painting and sketching systems frequently rely on generic hand gestures, which could lead to significant user misunderstandings. In this paper, we propose HPIPainting, a bare-hand VR painting system that implements a virtual pen interaction mechanism based on the Hand-Pen Interaction(HPI) paradigm. This paradigm leverages microgesture recognition to integrate natural pen-grasping gestures into a precise interaction model, enabling users to sketch in 3D space naturally and immersively. Specifically, we explored the design space for VR painting gestures and filtered out 9 microgestures through subjective evaluations to control various painting functions, such as start painting, edit, brush adjustment, geometric creation, and grid operations. Studies demonstrate that HPIPainting improves the immersion, usability, and expressive freedom of bare-hand VR Painting, it achieves controller-level drawing accuracy with a mean error of 1.21 mm, fast and reliable mode-switching within 222 ms, and significantly higher ratings for ease of use, hand fatigue, and naturalness compared to pinch- and controller-based input.<\/jats:p>","DOI":"10.1145\/3749538","type":"journal-article","created":{"date-parts":[[2025,9,3]],"date-time":"2025-09-03T17:15:45Z","timestamp":1756919745000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["HPIPainting: A Hand-Pen Interaction for VR Painting"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0001-7727-1058","authenticated-orcid":false,"given":"Ang","family":"Cai","sequence":"first","affiliation":[{"name":"School of Computer and Communication Engineering, USTB, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5483-3225","authenticated-orcid":false,"given":"Chao","family":"Yao","sequence":"additional","affiliation":[{"name":"School of Computer and Communication Engineering, USTB, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-2661-8047","authenticated-orcid":false,"given":"Hongjun","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Intelligence Science and Technology, USTB, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-5719-738X","authenticated-orcid":false,"given":"Changsheng","family":"Li","sequence":"additional","affiliation":[{"name":"School of Intelligence Science and Technology, USTB, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-9885-0692","authenticated-orcid":false,"given":"Yongyue","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Intelligence Science and Technology, USTB, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7560-0225","authenticated-orcid":false,"given":"Yu","family":"Guo","sequence":"additional","affiliation":[{"name":"School of Intelligence Science and Technology, USTB, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-8984-9212","authenticated-orcid":false,"given":"Xiaokun","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Intelligence Science and Technology, USTB, Beijing, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9142-3276","authenticated-orcid":false,"given":"Xiaojuan","family":"Ban","sequence":"additional","affiliation":[{"name":"School of Intelligence Science and Technology, USTB, Beijing, China"}]}],"member":"320","published-online":{"date-parts":[[2025,9,3]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173759"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025474"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2663204.2663246"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/323663.323667"},{"key":"e_1_2_1_5_1","volume-title":"Lucio Tommaso De Paolis, and Ugo Erra.","author":"Capece Nicola","year":"2023","unstructured":"Nicola Capece, Carola Gatto, Gilda Manfredi, Gabriele Gilio, Benito Luigi Nuzzo, Lucio Tommaso De Paolis, and Ugo Erra. 2023. Enhancing Art Therapy with Virtual Reality and Hand Gesture Recognition: A Case Study in Pottery Modeling. In Extended Reality, Lucio Tommaso De Paolis, Pasquale Arpaia, and Marco Sacco (Eds.). Springer Nature Switzerland, Cham, 210--226."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753725"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2501988.2502042"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/97243.97247"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3550337"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196737"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2522848.2532595"},{"key":"e_1_2_1_12_1","unstructured":"Facebook. 2016. Quill. https:\/\/quill.fb.com\/."},{"key":"e_1_2_1_13_1","unstructured":"Google VR. 2020. Tilt Brush README. https:\/\/github.com\/googlevr\/tilt-brush.original-date: 2020-04-13T18:55:08Z."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557130"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3641825.3687736"},{"key":"e_1_2_1_16_1","unstructured":"Apple Inc. 2025. Apple Vision Pro. https:\/\/www.apple.com\/apple-vision-pro\/."},{"key":"e_1_2_1_17_1","unstructured":"HTC Inc. 2025. Vive Pro 2. https:\/\/www.vive.com\/cn\/."},{"key":"e_1_2_1_18_1","unstructured":"Microsoft Inc. 2025. Hololens 2. https:\/\/learn.microsoft.com\/zh-cn\/hololens\/."},{"key":"e_1_2_1_19_1","unstructured":"Meta Inc. 2025. Quest. https:\/\/about.meta.com\/technologies\/meta-quest."},{"key":"e_1_2_1_20_1","unstructured":"PICO Inc. 2025. PICO 4. https:\/\/www.picoxr.com\/global\/products\/pico4."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCCA52192.2021.9666439"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3084873.3084900"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445302"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007.1060"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/364338.364370"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642067"},{"key":"e_1_2_1_27_1","unstructured":"Laan Labs. 2024. AirDraw - Finger Paint. https:\/\/apps.apple.com\/us\/app\/airdraw-finger-paint\/id6477749286. Version 1.0.4."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984582"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376698"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/1054972.1055036"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2992138.2992144"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuropsychologia.2014.10.034"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/3478112"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267782.3267786"},{"key":"e_1_2_1_35_1","unstructured":"Mark R. Mine. 1995. Virtual Environment Interaction Techniques. Technical Report. USA."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3474085.3478552"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3461778.3462098"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/38.103389"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/365024.365114"},{"key":"e_1_2_1_40_1","doi-asserted-by":"crossref","unstructured":"Holger Schultheis and Anthony Jameson. 2004. Assessing Cognitive Load in Adaptive Hypermedia Systems: Physiological and Behavioral Methods. In International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems. https:\/\/api.semanticscholar.org\/CorpusID:6514356","DOI":"10.1007\/978-3-540-27780-4_26"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR52148.2021.00026"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3574131.3574428"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376353"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3489849.3489925"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025865"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300426"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2503673.2503694"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642047"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijhcs.2019.03.011"},{"key":"e_1_2_1_50_1","volume-title":"Proceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium","author":"Wiese E.","unstructured":"E. Wiese, J. H. Israel, A. Meyer, and S. Bongartz. 2010. Investigating the learnability of immersive free-hand sketching. In Proceedings of the Seventh Sketch-Based Interfaces and Modeling Symposium (Annecy, France) (SBIM '10). Eurographics Association, Goslar, DEU, 135--142."},{"key":"e_1_2_1_51_1","volume-title":"HCI in Games","author":"Xie Jiaqi","unstructured":"Jiaqi Xie, Hao Zheng, Junxian Lin, and Xiaoying Tang. 2024. Digital Gamification Design of Chinese Landscape Painting Based on Gesture Interaction. In HCI in Games, Xiaowen Fang (Ed.). Springer Nature Switzerland, Cham, 127--142."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2016.2546942"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/3472749.3474756"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2024.3354784"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3749538","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,25]],"date-time":"2025-09-25T16:31:55Z","timestamp":1758817915000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3749538"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,3]]},"references-count":54,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2025,9,3]]}},"alternative-id":["10.1145\/3749538"],"URL":"https:\/\/doi.org\/10.1145\/3749538","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,3]]},"assertion":[{"value":"2025-09-03","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}