{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T07:13:25Z","timestamp":1781594005515,"version":"3.54.5"},"reference-count":91,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2024,1,29]],"date-time":"2024-01-29T00:00:00Z","timestamp":1706486400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2024,4,30]]},"abstract":"<jats:p>We introduce RadarHand, a wrist-worn wearable with millimetre wave radar that detects on-skin touch-based proprioceptive hand gestures. Radars are robust, private, small, penetrate materials, and require low computation costs. We first evaluated the proprioceptive and tactile perception nature of the back of the hand and found that tapping on the thumb is the least proprioceptive error of all the finger joints, followed by the index finger, middle finger, ring finger, and pinky finger in the eyes-free and high cognitive load situation. Next, we trained deep-learning models for gesture classification. We introduce two types of gestures based on the locations of the back of the hand: generic gestures and discrete gestures. Discrete gestures are gestures that start at specific locations and end at specific locations at the back of the hand, in contrast to generic gestures, which can start anywhere and end anywhere on the back of the hand. Out of 27 gesture group possibilities, we achieved 92% accuracy for a set of seven gestures and 93% accuracy for the set of eight discrete gestures. Finally, we evaluated RadarHand\u2019s performance in real-time under two interaction modes: Active interaction and Reactive interaction. Active interaction is where the user initiates input to achieve the desired output, and reactive interaction is where the device initiates interaction and requires the user to react. We obtained an accuracy of 87% and 74% for active generic and discrete gestures, respectively, as well as 91% and 81.7% for reactive generic and discrete gestures, respectively. We discuss the implications of RadarHand for gesture recognition and directions for future works.<\/jats:p>","DOI":"10.1145\/3617365","type":"journal-article","created":{"date-parts":[[2023,10,27]],"date-time":"2023-10-27T22:05:12Z","timestamp":1698444312000},"page":"1-36","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["RadarHand: A Wrist-Worn Radar for On-Skin Touch-Based Proprioceptive Gestures"],"prefix":"10.1145","volume":"31","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6392-7290","authenticated-orcid":false,"given":"Ryo","family":"Hajika","sequence":"first","affiliation":[{"name":"The University of Auckland, New Zealand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7008-5458","authenticated-orcid":false,"given":"Tamil Selvan","family":"Gunasekaran","sequence":"additional","affiliation":[{"name":"The University of Auckland, New Zealand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-8592-1320","authenticated-orcid":false,"given":"Chloe Dolma Si Ying","family":"Haigh","sequence":"additional","affiliation":[{"name":"The University of Auckland, New Zealand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6090-2837","authenticated-orcid":false,"given":"Yun Suen","family":"Pai","sequence":"additional","affiliation":[{"name":"Keio University Graduate School of Media Design, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-1248-554X","authenticated-orcid":false,"given":"Eiji","family":"Hayashi","sequence":"additional","affiliation":[{"name":"Google Inc., USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-9083-4872","authenticated-orcid":false,"given":"Jaime","family":"Lien","sequence":"additional","affiliation":[{"name":"Google Inc., USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5541-4425","authenticated-orcid":false,"given":"Danielle","family":"Lottridge","sequence":"additional","affiliation":[{"name":"The University of Auckland, New Zealand"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4172-6759","authenticated-orcid":false,"given":"Mark","family":"Billinghurst","sequence":"additional","affiliation":[{"name":"The University of Auckland, New Zealand"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,1,29]]},"reference":[{"key":"e_1_3_2_2_2","unstructured":"Mart\u00edn Abadi Ashish Agarwal Paul Barham Eugene Brevdo Zhifeng Chen Craig Citro Greg S. Corrado Andy Davis Jeffrey Dean Matthieu Devin Sanjay Ghemawat Ian Goodfellow Andrew Harp Geoffrey Irving Michael Isard Yangqing Jia Rafal Jozefowicz Lukasz Kaiser Manjunath Kudlur Josh Levenberg Dandelion Man\u00e9 Rajat Monga Sherry Moore Derek Murray Chris Olah Mike Schuster Jonathon Shlens Benoit Steiner Ilya Sutskever Kunal Talwar Paul Tucker Vincent Vanhoucke Vijay Vasudevan Fernanda Vi\u00e9gas Oriol Vinyals Pete Warden Martin Wattenberg Martin Wicke Yuan Yu and Xiaoqiang Zheng. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. https:\/\/www.tensorflow.org\/Software available from tensorflow.org."},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1093\/iwc\/iwu005"},{"key":"e_1_3_2_4_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445138"},{"key":"e_1_3_2_5_2","doi-asserted-by":"publisher","DOI":"10.3390\/s21175771"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1093\/brain\/10.1.1"},{"key":"e_1_3_2_7_2","doi-asserted-by":"publisher","DOI":"10.1109\/ITSC.2015.109"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3332166"},{"key":"e_1_3_2_9_2","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3026030"},{"key":"e_1_3_2_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3064663.3064766"},{"key":"e_1_3_2_11_2","first-page":"3","volume-title":"Proceedings of the IEEE Conference on Virtual Reality 2005 (VR 2005).","author":"Burns Eric","year":"2005","unstructured":"Eric Burns, Sharif Razzaque, Abigail T. Panter, Mary C. Whitton, Matthew R. McCallus, and Frederick P. Brooks. 2005. The hand is slower than the eye: A quantitative exploration of visual dominance over proprioception. In Proceedings of the IEEE Conference on Virtual Reality 2005 (VR 2005). IEEE, 3\u201310."},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ergon.2013.05.005"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858589"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/3300061.3300124"},{"key":"e_1_3_2_15_2","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647396"},{"key":"e_1_3_2_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISWC.2007.4373768"},{"key":"e_1_3_2_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173993"},{"key":"e_1_3_2_18_2","volume-title":"Elemente Der Psychophysik","author":"Fechner Gustav Theodor","year":"1860","unstructured":"Gustav Theodor Fechner. 1860. Elemente Der Psychophysik. Vol. 2. Breitkopf u. H\u00e4rtel."},{"key":"e_1_3_2_19_2","doi-asserted-by":"publisher","DOI":"10.4324\/9780203840702"},{"key":"e_1_3_2_20_2","volume-title":"Sensation and Perception","author":"Goldstein E. Bruce","year":"2016","unstructured":"E. Bruce Goldstein and James Brockmole. 2016. Sensation and Perception. Cengage Learning."},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1145\/3357236.3395569"},{"key":"e_1_3_2_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411763.3451699"},{"key":"e_1_3_2_23_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3519808"},{"key":"e_1_3_2_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047233"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1145\/2470654.2466114"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jshs.2014.10.004"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047255"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753574"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753394"},{"key":"e_1_3_2_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445367"},{"key":"e_1_3_2_31_2","doi-asserted-by":"publisher","DOI":"10.1177\/1545968315573055"},{"key":"e_1_3_2_32_2","article-title":"Mobilenets: Efficient convolutional neural networks for mobile vision applications","author":"Howard Andrew G.","year":"2017","unstructured":"Andrew G. Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, and Adam Hartwig. 2017. Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017).","journal-title":"arXiv preprint arXiv:1704.04861"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.1113\/jphysiol.1979.sp012619"},{"key":"e_1_3_2_34_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.clinbiomech.2014.08.017"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1206157"},{"key":"e_1_3_2_36_2","doi-asserted-by":"publisher","DOI":"10.1145\/2642918.2647356"},{"key":"e_1_3_2_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984582"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1145\/2073370.2073374"},{"key":"e_1_3_2_39_2","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925953"},{"key":"e_1_3_2_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/2047196.2047259"},{"key":"e_1_3_2_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/2807442.2807489"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1145\/3380984"},{"key":"e_1_3_2_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/3380984"},{"key":"e_1_3_2_44_2","doi-asserted-by":"publisher","DOI":"10.1006\/nimg.1999.0448"},{"key":"e_1_3_2_45_2","doi-asserted-by":"publisher","DOI":"10.1002\/ana.24179"},{"key":"e_1_3_2_46_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-9457(01)00058-6"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1978969"},{"key":"e_1_3_2_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/3384657.3384776"},{"key":"e_1_3_2_49_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300610"},{"key":"e_1_3_2_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/2735711.2735830"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/2501988.2502039"},{"key":"e_1_3_2_52_2","doi-asserted-by":"crossref","first-page":"538","DOI":"10.1117\/12.607176","volume-title":"Signal Processing, Sensor Fusion, and Target Recognition XIV","author":"Otero Michael","year":"2005","unstructured":"Michael Otero. 2005. Application of a continuous wave radar for human gait recognition. In Signal Processing, Sensor Fusion, and Target Recognition XIV, Vol. 5809. International Society for Optics and Photonics, 538\u2013548."},{"key":"e_1_3_2_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501898"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0236416"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1145\/2468356.2468527"},{"key":"e_1_3_2_56_2","doi-asserted-by":"publisher","DOI":"10.1152\/physrev.00048.2011"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/2750858.2804280"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/2629633"},{"key":"e_1_3_2_59_2","doi-asserted-by":"publisher","DOI":"10.1145\/3490149.3501320"},{"key":"e_1_3_2_60_2","doi-asserted-by":"publisher","DOI":"10.1109\/RADAR.2018.8378688"},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-62970-4"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1145\/2396636.2396643"},{"key":"e_1_3_2_63_2","volume-title":"The Integrative Action of the Nervous System","author":"Sherrington Charles","year":"1952","unstructured":"Charles Sherrington. 1952. The Integrative Action of the Nervous System. CUP Archive."},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10067-013-2193-7"},{"key":"e_1_3_2_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3026005"},{"key":"e_1_3_2_66_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2017.3641636"},{"key":"e_1_3_2_67_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-9406(05)60109-5"},{"key":"e_1_3_2_68_2","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501878"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.23919\/SICE.2017.8105457"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2017.00501"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2018.01.064"},{"key":"e_1_3_2_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/2325616.2325626"},{"key":"e_1_3_2_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/3532212"},{"key":"e_1_3_2_74_2","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984565"},{"key":"e_1_3_2_75_2","doi-asserted-by":"publisher","DOI":"10.1109\/APS.2011.5996925"},{"key":"e_1_3_2_76_2","doi-asserted-by":"publisher","DOI":"10.1145\/1107548.1107578"},{"key":"e_1_3_2_77_2","doi-asserted-by":"crossref","unstructured":"Robert Watson-Watt. 1945. Radar in war and in peace.","DOI":"10.1038\/156319a0"},{"key":"e_1_3_2_78_2","doi-asserted-by":"publisher","DOI":"10.1145\/2702123.27023911315"},{"key":"e_1_3_2_79_2","doi-asserted-by":"publisher","DOI":"10.1145\/2556288.2557239"},{"key":"e_1_3_2_80_2","doi-asserted-by":"publisher","DOI":"10.1145\/3025453.3025704"},{"key":"e_1_3_2_81_2","doi-asserted-by":"publisher","DOI":"10.1145\/3242587.3242645"},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.1145\/3379337.3415897"},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.1093\/rheumatology\/keh568"},{"key":"e_1_3_2_84_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173669"},{"key":"e_1_3_2_85_2","doi-asserted-by":"publisher","unstructured":"Xuhai Xu Jun Gong Carolina Brum Lilian Liang Bongsoo Suh Shivam Kumar Gupta Yash Agarwal Laurence Lindsey Runchang Kang Behrooz Shahsavari Tu Nguyen Heriberto Nieto Scott E. Hudson Charlie Maalouf Jax Seyed Mousavi and Gierad Laput. 2022. Enabling hand gesture customization on wrist-worn devices. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans LA ) (CHI\u201922). ACM New York Article 496 19 pages. 9781450391573 10.1145\/3491102.3501904","DOI":"10.1145\/3491102.3501904"},{"key":"e_1_3_2_86_2","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173652"},{"key":"e_1_3_2_87_2","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984515"},{"key":"e_1_3_2_88_2","doi-asserted-by":"publisher","DOI":"10.1145\/2992154.2992187"},{"key":"e_1_3_2_89_2","doi-asserted-by":"publisher","DOI":"10.1145\/3191787"},{"key":"e_1_3_2_90_2","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858082"},{"key":"e_1_3_2_91_2","doi-asserted-by":"publisher","DOI":"10.1109\/BSN.2015.7299364"},{"key":"e_1_3_2_92_2","first-page":"247","volume-title":"Cockroaches as Models for Neurobiology: Applications in Biomedical Research","author":"Zill Sasha N.","year":"2019","unstructured":"Sasha N. Zill. 2019. Mechanoreceptors: Exteroceptors and proprioceptors. In Cockroaches as Models for Neurobiology: Applications in Biomedical Research. CRC Press, 247\u2013267."}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617365","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3617365","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:45:54Z","timestamp":1750178754000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3617365"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,29]]},"references-count":91,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,4,30]]}},"alternative-id":["10.1145\/3617365"],"URL":"https:\/\/doi.org\/10.1145\/3617365","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"value":"1073-0516","type":"print"},{"value":"1557-7325","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,29]]},"assertion":[{"value":"2022-07-08","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-06-23","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-01-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}