{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T11:15:03Z","timestamp":1781090103594,"version":"3.54.1"},"reference-count":73,"publisher":"Association for Computing Machinery (ACM)","issue":"ISS","license":[{"start":{"date-parts":[[2023,10,31]],"date-time":"2023-10-31T00:00:00Z","timestamp":1698710400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2023,10,31]]},"abstract":"<jats:p>Room-scale VR has been considered an alternative to physical office workspaces. For office activities, users frequently require planar input methods, such as typing or handwriting, to quickly record annotations to virtual content. However, current off-the-shelf VR HMD setups rely on mid-air interactions, which can cause arm fatigue and decrease input accuracy. To address this issue, we propose UbiSurface, a robotic touch surface that can automatically reposition itself to physically present a virtual planar input surface (VR whiteboard, VR canvas, etc.) to users and to permit them to achieve accurate and fatigue-less input while walking around a virtual room. We design and implement a prototype of UbiSurface that can dynamically change a canvas-sized touch surface's position, height, and pitch and yaw angles to adapt to virtual surfaces spatially arranged at various locations and angles around a virtual room. We then conduct studies to validate its technical performance and examine how UbiSurface facilitates the user's primary mid-air planar interactions, such as painting and writing in a room-scale VR setup. Our results indicate that this system reduces arm fatigue and increases input accuracy, especially for writing tasks. We then discuss the potential benefits and challenges of robotic touch devices for future room-scale VR setups.<\/jats:p>","DOI":"10.1145\/3626479","type":"journal-article","created":{"date-parts":[[2023,11,1]],"date-time":"2023-11-01T16:26:12Z","timestamp":1698855972000},"page":"376-397","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["UbiSurface: A Robotic Touch Surface for Supporting Mid-air Planar Interactions in Room-Scale VR"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3785-9612","authenticated-orcid":false,"given":"Ryota","family":"Gomi","sequence":"first","affiliation":[{"name":"Tohoku University, Sendai, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1020-5750","authenticated-orcid":false,"given":"Kazuki","family":"Takashima","sequence":"additional","affiliation":[{"name":"Tohoku University, Sendai, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-5999-8129","authenticated-orcid":false,"given":"Yuki","family":"Onishi","sequence":"additional","affiliation":[{"name":"Singapore Management Univeristy, Singapore, Singapore"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1039-0167","authenticated-orcid":false,"given":"Kazuyuki","family":"Fujita","sequence":"additional","affiliation":[{"name":"Tohoku University, Sendai, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7047-627X","authenticated-orcid":false,"given":"Yoshifumi","family":"Kitamura","sequence":"additional","affiliation":[{"name":"Tohoku University, Sendai, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2023,11]]},"reference":[{"key":"e_1_2_2_1_1","unstructured":"Quest 2. 2021. Meta Quest 2 Hand tracking.  https:\/\/www.meta.com\/jp\/en\/quest\/products\/quest-2\/ \t\t\t\t  Quest 2. 2021. Meta Quest 2 Hand tracking.  https:\/\/www.meta.com\/jp\/en\/quest\/products\/quest-2\/"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3131785.3131821"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300589"},{"key":"e_1_2_2_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/258549.258760"},{"key":"e_1_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3472749.3474790"},{"key":"e_1_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/2839462.2839484"},{"key":"e_1_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173759"},{"key":"e_1_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025474"},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2687921"},{"key":"e_1_2_2_10_1","volume-title":"Psychophysical bases of perceived exertion.. Medicine and science in sports and exercise, 14 5","author":"Borg Gunnar A. V.","year":"1982","unstructured":"Gunnar A. V. Borg . 1982. Psychophysical bases of perceived exertion.. Medicine and science in sports and exercise, 14 5 ( 1982 ), 377\u201381. Gunnar A. V. Borg. 1982. Psychophysical bases of perceived exertion.. Medicine and science in sports and exercise, 14 5 (1982), 377\u201381."},{"key":"e_1_2_2_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/VR.2019.8798238"},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379337.3415891"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR50242.2020.00060"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1162\/105474698565659"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376701"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2011.283"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3206505.3206526"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376628"},{"key":"e_1_2_2_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445349"},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3526113.3545651"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3569461"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242594"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858519"},{"key":"e_1_2_2_24_1","volume-title":"Sarah C. Meacham, Lizhou Cao, and Victoria R. Blakely.","author":"Hansberger Jeffrey T.","year":"2017","unstructured":"Jeffrey T. Hansberger , Chao Peng , Shannon L. Mathis , Vaidyanath Areyur Shanthakumar , Sarah C. Meacham, Lizhou Cao, and Victoria R. Blakely. 2017 . Dispelling the Gorilla Arm Syndrome: The Viability of Prolonged Gesture Interactions. In Virtual, Augmented and Mixed Reality, Stephanie Lackey and Jessie Chen (Eds.). Springer International Publishing , Cham. 505\u2013520. isbn:978-3-319-57987-0 Jeffrey T. Hansberger, Chao Peng, Shannon L. Mathis, Vaidyanath Areyur Shanthakumar, Sarah C. Meacham, Lizhou Cao, and Victoria R. Blakely. 2017. Dispelling the Gorilla Arm Syndrome: The Viability of Prolonged Gesture Interactions. In Virtual, Augmented and Mixed Reality, Stephanie Lackey and Jessie Chen (Eds.). Springer International Publishing, Cham. 505\u2013520. isbn:978-3-319-57987-0"},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3131785.3131795"},{"key":"e_1_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557130"},{"key":"e_1_2_2_27_1","first-page":"32","article-title":"A force and shape display for virtual reality system","volume":"1","author":"Hirata Ryokichi","year":"1996","unstructured":"Ryokichi Hirata , Hiroshi Hoshino , Taro Maeda , and Susumu Tachi . 1996 . A force and shape display for virtual reality system . Transactions of the Virtual Reality Society of Japan , 1 , 1 (1996), 32 \u2013 32 . Ryokichi Hirata, Hiroshi Hoshino, Taro Maeda, and Susumu Tachi. 1996. A force and shape display for virtual reality system. Transactions of the Virtual Reality Society of Japan, 1, 1 (1996), 32\u201332.","journal-title":"Transactions of the Virtual Reality Society of Japan"},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/VR50410.2021.00048"},{"key":"e_1_2_2_29_1","unstructured":"HTC. 2019. VIVE^TM| VIVE Virtual Reality System.  https:\/\/www.vive.com\/us\/product\/vive-virtual-reality-system\/ \t\t\t\t  HTC. 2019. VIVE^TM| VIVE Virtual Reality System.  https:\/\/www.vive.com\/us\/product\/vive-virtual-reality-system\/"},{"key":"e_1_2_2_30_1","unstructured":"ISO. 2016. ISO\/TS 15066:2016(en) Robots and robotic devices \u2014 Collaborative robots.  https:\/\/www.iso.org\/obp\/ui\/#iso:std:iso:ts:15066:ed-1:v1:en \t\t\t\t  ISO. 2016. ISO\/TS 15066:2016(en) Robots and robotic devices \u2014 Collaborative robots.  https:\/\/www.iso.org\/obp\/ui\/#iso:std:iso:ts:15066:ed-1:v1:en"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025523"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445302"},{"key":"e_1_2_2_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVCG.2007.1060"},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISMAR55827.2022.00034"},{"key":"e_1_2_2_35_1","volume-title":"The Annual SIGRAD Conference. Special Theme-Real-Time Simulations. Conference Proceedings from SIGRAD2003","author":"Lange Marcus","year":"2003","unstructured":"Marcus Lange , Jonas Hjalmarsson , Matthew Cooper , Ander Ynnerman , and Vu Duong . 2003 . 3d visualization and 3d and voice interaction in air traffic management . In The Annual SIGRAD Conference. Special Theme-Real-Time Simulations. Conference Proceedings from SIGRAD2003 . 17\u201322. Marcus Lange, Jonas Hjalmarsson, Matthew Cooper, Ander Ynnerman, and Vu Duong. 2003. 3d visualization and 3d and voice interaction in air traffic management. In The Annual SIGRAD Conference. Special Theme-Real-Time Simulations. Conference Proceedings from SIGRAD2003. 17\u201322."},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2807442.2807489"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2019.2933338"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3519717"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445583"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/0003-6870(93)90080-S"},{"key":"e_1_2_2_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581079"},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/tvcg.2019.2963190"},{"key":"e_1_2_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TOH.2021.3061150"},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.2312\/PE\/VE2007Short\/085-088"},{"key":"e_1_2_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/VR46266.2020.00023"},{"key":"e_1_2_2_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/VR55154.2023.00045"},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818384.2818403"},{"key":"e_1_2_2_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/VRAIS.1998.658467"},{"key":"e_1_2_2_49_1","volume-title":"Modern Statistical Methods for HCI","author":"Robertson Judy","year":"1926","unstructured":"Judy Robertson and Maurits Kaptein . 2016. Modern Statistical Methods for HCI ( 1 st ed.). Springer Publishing Company, Inc orporated. isbn:33 1926 6314 Judy Robertson and Maurits Kaptein. 2016. Modern Statistical Methods for HCI (1st ed.). Springer Publishing Company, Incorporated. isbn:3319266314","edition":"1"},{"key":"e_1_2_2_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3405755.3406161"},{"key":"e_1_2_2_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/HAPTICS.2014.6775425"},{"key":"e_1_2_2_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173865"},{"key":"e_1_2_2_53_1","volume-title":"Human Walking in Virtual Environments: Perception, Technology, and Applications","author":"Steinicke Frank","year":"1984","unstructured":"Frank Steinicke , Yon Visell , Jennifer Campos , and Anatole Lcuyer . 2013. Human Walking in Virtual Environments: Perception, Technology, and Applications . Springer Publishing Company, Inc orporated. isbn:144 1984 313 Frank Steinicke, Yon Visell, Jennifer Campos, and Anatole Lcuyer. 2013. Human Walking in Virtual Environments: Perception, Technology, and Applications. Springer Publishing Company, Incorporated. isbn:1441984313"},{"key":"e_1_2_2_54_1","doi-asserted-by":"publisher","DOI":"10.2312\/gch.20171300"},{"key":"e_1_2_2_55_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300243"},{"key":"e_1_2_2_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376523"},{"key":"e_1_2_2_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3472749.3474821"},{"key":"e_1_2_2_58_1","doi-asserted-by":"publisher","DOI":"10.1145\/3332165.3347958"},{"key":"e_1_2_2_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3359996.3364271"},{"key":"e_1_2_2_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/311535.311589"},{"key":"e_1_2_2_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROBOT.2008.4543489"},{"key":"e_1_2_2_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445546"},{"key":"e_1_2_2_63_1","doi-asserted-by":"publisher","DOI":"10.1109\/VR.2017.7892233"},{"key":"e_1_2_2_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267782.3267788"},{"key":"e_1_2_2_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581423"},{"key":"e_1_2_2_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/VR.2019.8798255"},{"key":"e_1_2_2_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2659766.2659777"},{"key":"e_1_2_2_68_1","doi-asserted-by":"publisher","DOI":"10.1109\/VR.2015.7223332"},{"key":"e_1_2_2_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376286"},{"key":"e_1_2_2_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/2983310.2985746"},{"key":"e_1_2_2_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3379337.3415859"},{"key":"e_1_2_2_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445343"},{"key":"e_1_2_2_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3332165.3347869"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3626479","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3626479","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:50:15Z","timestamp":1750287015000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3626479"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,31]]},"references-count":73,"journal-issue":{"issue":"ISS","published-print":{"date-parts":[[2023,10,31]]}},"alternative-id":["10.1145\/3626479"],"URL":"https:\/\/doi.org\/10.1145\/3626479","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,31]]},"assertion":[{"value":"2023-11-01","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}