{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T05:31:15Z","timestamp":1778304675133,"version":"3.51.4"},"reference-count":79,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2021,9,9]],"date-time":"2021-09-09T00:00:00Z","timestamp":1631145600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Research Grants Council of Hong Kong","award":["CityU 11217420"],"award-info":[{"award-number":["CityU 11217420"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2021,9,9]]},"abstract":"<jats:p>This paper presents WR-Hand, a wearable-based system tracking 3D hand pose of 14 hand skeleton points over time using Electromyography (EMG) and gyroscope sensor data from commercial armband. This system provides a significant leap in wearable sensing and enables new application potentials in medical care, human-computer interaction, etc. A challenge is the armband EMG sensors inevitably collect mixed EMG signals from multiple forearm muscles because of the fixed sensor positions on the device, while prior bio-medical models for hand pose tracking are built on isolated EMG signal inputs from isolated forearm spots for different muscles. In this paper, we leverage the recent success of neural networks to enhance the existing bio-medical model using the armband's EMG data and visualize our design to understand why our solution is effective. Moreover, we propose solutions to place the constructed hand pose reliably in a global coordinate system, and address two practical issues by providing a general plug-and-play version for new users without training and compensating for the position difference in how users wear their armbands. We implement a prototype using different commercial armbands, which is lightweight to execute on user's phone in real-time. Extensive evaluation shows the efficacy of the WR-Hand design.<\/jats:p>","DOI":"10.1145\/3478112","type":"journal-article","created":{"date-parts":[[2021,9,14]],"date-time":"2021-09-14T22:48:23Z","timestamp":1631659703000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":27,"title":["WR-Hand"],"prefix":"10.1145","volume":"5","author":[{"given":"Yang","family":"Liu","sequence":"first","affiliation":[{"name":"Department of Computer Science, City University of Hong Kong, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chengdong","family":"Lin","sequence":"additional","affiliation":[{"name":"Department of Computer Science, City University of Hong Kong, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhenjiang","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Computer Science, City University of Hong Kong, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,9,14]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"2015. Myo Price. https:\/\/www.businessinsider.com\/myo-armband-demo-ces-2015-2015-1.  2015. Myo Price. https:\/\/www.businessinsider.com\/myo-armband-demo-ces-2015-2015-1."},{"key":"e_1_2_1_2_1","unstructured":"2016. Leap Motion Goes Mobile Blog. http:\/\/blog.leapmotion.com\/mobile-platform\/.  2016. Leap Motion Goes Mobile Blog. http:\/\/blog.leapmotion.com\/mobile-platform\/."},{"key":"e_1_2_1_3_1","unstructured":"2019. Leap Motion Applications. https:\/\/gallery.leapmotion.com\/.  2019. Leap Motion Applications. https:\/\/gallery.leapmotion.com\/."},{"key":"e_1_2_1_4_1","unstructured":"2019. Outpatient Hand Rehabilitation. https:\/\/www.stonybrookmedicine.edu\/patientcare\/physical-occupational-therapy\/hand-rehabilitation.  2019. Outpatient Hand Rehabilitation. https:\/\/www.stonybrookmedicine.edu\/patientcare\/physical-occupational-therapy\/hand-rehabilitation."},{"key":"e_1_2_1_5_1","unstructured":"2020. Everything you need to know about stroke. https:\/\/www.medicalnewstoday.com\/articles\/7624#treatment.  2020. Everything you need to know about stroke. https:\/\/www.medicalnewstoday.com\/articles\/7624#treatment."},{"key":"e_1_2_1_6_1","unstructured":"2020. Hand Rehabilitation: 5 Best Methods for Recovery at Home. https:\/\/www.flintrehab.com\/hand-rehabilitation\/.  2020. Hand Rehabilitation: 5 Best Methods for Recovery at Home. https:\/\/www.flintrehab.com\/hand-rehabilitation\/."},{"key":"e_1_2_1_7_1","unstructured":"2020. Immersive Control. https:\/\/www.ctrl-labs.com\/.  2020. Immersive Control. https:\/\/www.ctrl-labs.com\/."},{"key":"e_1_2_1_8_1","unstructured":"2021. gForce Armband. http:\/\/www.oymotion.com\/en\/product32\/149.  2021. gForce Armband. http:\/\/www.oymotion.com\/en\/product32\/149."},{"key":"e_1_2_1_9_1","unstructured":"2021. Leap Motion. https:\/\/www.leapmotion.com\/.  2021. Leap Motion. https:\/\/www.leapmotion.com\/."},{"key":"e_1_2_1_10_1","unstructured":"2021. Leap Motion Goes Mobile. https:\/\/developer.leapmotion.com\/107.  2021. Leap Motion Goes Mobile. https:\/\/developer.leapmotion.com\/107."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/SVR.2016.21"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3041164.3041172"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10514-016-9589-6"},{"key":"e_1_2_1_14_1","volume-title":"Proc. of ICLR.","author":"Bahdanau Dzmitry","year":"2015","unstructured":"Dzmitry Bahdanau , Kyung Hyun Cho , and Yoshua Bengio . 2015 . Neural machine translation by jointly learning to align and translate . In Proc. of ICLR. Dzmitry Bahdanau, Kyung Hyun Cho, and Yoshua Bengio. 2015. Neural machine translation by jointly learning to align and translate. In Proc. of ICLR."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1177\/0278364912474079"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2019.01110"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1123\/jab.20.4.367"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICUSAI47366.2019.9124812"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858125"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.337"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNSRE.2019.2896269"},{"key":"e_1_2_1_22_1","volume-title":"E-Book","author":"Erickson Mia","year":"2020","unstructured":"Mia Erickson , Heather F Smith , Carol Waggy , and Neal E Pratt . 2020. Anatomy and Kinesiology of the Hand. Rehabilitation of the Hand and Upper Extremity , E-Book ( 2020 ), 1. Mia Erickson, Heather F Smith, Carol Waggy, and Neal E Pratt. 2020. Anatomy and Kinesiology of the Hand. Rehabilitation of the Hand and Upper Extremity, E-Book (2020), 1."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3131672.3131693"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/2946645.2946704"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00622"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00878"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.602"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01261-8_29"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3306346.3322957"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984563"},{"key":"e_1_2_1_31_1","volume-title":"Proc. of NIPS.","author":"Goodfellow Ian","year":"2014","unstructured":"Ian Goodfellow , Jean Pouget-Abadie , Mehdi Mirza , Bing Xu , David Warde-Farley , Sherjil Ozair , Aaron Courville , and Yoshua Bengio . 2014 . Generative adversarial nets . In Proc. of NIPS. Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative adversarial nets. In Proc. of NIPS."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1242073.1242272"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/SMC.2015.251"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3432202"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2015.277"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3241539.3241548"},{"key":"e_1_2_1_37_1","volume-title":"Zhen Gang Xiao, and Carlo Menon","author":"Jiang Xianta","year":"2017","unstructured":"Xianta Jiang , Lukas-Karim Merhi , Zhen Gang Xiao, and Carlo Menon . 2017 . Exploration of force myography and surface electromyography in hand gesture classification. Elsevier Medical engineering & physics 41 (2017), 63--73. Xianta Jiang, Lukas-Karim Merhi, Zhen Gang Xiao, and Carlo Menon. 2017. Exploration of force myography and surface electromyography in hand gesture classification. Elsevier Medical engineering & physics 41 (2017), 63--73."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2018.2837758"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.trit.2016.03.010"},{"key":"e_1_2_1_40_1","volume-title":"Visualizing and understanding recurrent networks. arXiv preprint arXiv:1506.02078","author":"Karpathy Andrej","year":"2015","unstructured":"Andrej Karpathy , Justin Johnson , and Li Fei-Fei . 2015. Visualizing and understanding recurrent networks. arXiv preprint arXiv:1506.02078 ( 2015 ). Andrej Karpathy, Justin Johnson, and Li Fei-Fei. 2015. Visualizing and understanding recurrent networks. arXiv preprint arXiv:1506.02078 (2015)."},{"key":"e_1_2_1_41_1","volume-title":"Yunus Emre Kara, and Lale Akarun","author":"Keskin Cem","year":"2013","unstructured":"Cem Keskin , Furkan K&iota;ra\u00e7 , Yunus Emre Kara, and Lale Akarun . 2013 . Real time hand pose estimation using depth sensors. In Consumer depth cameras for computer vision. Springer . Cem Keskin, Furkan K&iota;ra\u00e7, Yunus Emre Kara, and Lale Akarun. 2013. Real time hand pose estimation using depth sensors. In Consumer depth cameras for computer vision. Springer."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12984-017-0284-4"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984582"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3307334.3326109"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/THMS.2014.2302794"},{"key":"e_1_2_1_46_1","first-page":"2579","article-title":"Visualizing data using t-SNE","author":"van der Maaten Laurens","year":"2008","unstructured":"Laurens van der Maaten and Geoffrey Hinton . 2008 . Visualizing data using t-SNE . Journal of machine learning research 9 , Nov (2008), 2579 -- 2605 . Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of machine learning research 9, Nov (2008), 2579--2605.","journal-title":"Journal of machine learning research 9"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.23915\/distill.00016"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/3DV.2018.00023"},{"key":"e_1_2_1_49_1","volume-title":"A real-time EMG-driven virtual arm. Computers in biology and medicine 32, 1","author":"Manal Kurt","year":"2002","unstructured":"Kurt Manal , Roger V Gonzalez , David G Lloyd , and Thomas S Buchanan . 2002. A real-time EMG-driven virtual arm. Computers in biology and medicine 32, 1 ( 2002 ), 25--36. Kurt Manal, Roger V Gonzalez, David G Lloyd, and Thomas S Buchanan. 2002. A real-time EMG-driven virtual arm. Computers in biology and medicine 32, 1 (2002), 25--36."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/3126594.3126604"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858093"},{"key":"e_1_2_1_52_1","volume-title":"Proc. of NIPS.","author":"Mnih Volodymyr","year":"2014","unstructured":"Volodymyr Mnih , Nicolas Heess , Alex Graves , 2014 . Recurrent models of visual attention . In Proc. of NIPS. Volodymyr Mnih, Nicolas Heess, Alex Graves, et al. 2014. Recurrent models of visual attention. In Proc. of NIPS."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00013"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1109\/EMBC.2015.7318801"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1186\/1743-0003-11-122"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3356250.3360040"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/2735711.2735830"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIM.2021.3063752"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0179766"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2018.2790801"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1088\/0305-4470\/12\/11\/017"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.gmod.2015.04.001"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/2500423.2500434"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3241539.3241582"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/2906388.2906407"},{"key":"e_1_2_1_66_1","volume-title":"Neural network committees for finger joint angle estimation from surface EMG signals. Biomedical engineering online 8, 1","author":"Shrirao Nikhil A","year":"2009","unstructured":"Nikhil A Shrirao , Narender P Reddy , and Durga R Kosuri . 2009. Neural network committees for finger joint angle estimation from surface EMG signals. Biomedical engineering online 8, 1 ( 2009 ), 2. Nikhil A Shrirao, Narender P Reddy, and Durga R Kosuri. 2009. Neural network committees for finger joint angle estimation from surface EMG signals. Biomedical engineering online 8, 1 (2009), 2."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2629500"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1145\/3274783.3274854"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.5120\/14079-2073"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.3390\/s16122138"},{"key":"e_1_2_1_71_1","volume-title":"Proc. of ICML.","author":"Xu Kelvin","year":"2015","unstructured":"Kelvin Xu , Jimmy Ba , Ryan Kiros , Kyunghyun Cho , Aaron Courville , Ruslan Salakhudinov , Rich Zemel , and Yoshua Bengio . 2015 . Show, attend and tell: Neural image caption generation with visual attention . In Proc. of ICML. Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhudinov, Rich Zemel, and Yoshua Bengio. 2015. Show, attend and tell: Neural image caption generation with visual attention. In Proc. of ICML."},{"key":"e_1_2_1_72_1","first-page":"16","article-title":"Capturing Hand Articulations using Recurrent Neural Network for 3D Hand Pose Estimation","volume":"15","year":"2019","unstructured":"Cheol-hwan Yoo, Seung-wook Kim, Seo-won Ji, Yong-goo Shin, and Sung-jea Ko. 2019 . Capturing Hand Articulations using Recurrent Neural Network for 3D Hand Pose Estimation . Feedback 15 (2019), 16 . Cheol-hwan Yoo, Seung-wook Kim, Seo-won Ji, Yong-goo Shin, and Sung-jea Ko. 2019. Capturing Hand Articulations using Recurrent Neural Network for 3D Hand Pose Estimation. Feedback 15 (2019), 16.","journal-title":"Feedback"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00279"},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1145\/1502650.1502708"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984574"},{"key":"e_1_2_1_76_1","volume-title":"HandAugment: A Simple Data Augmentation Method for Depth-Based 3D Hand Pose Estimation. arXiv preprint arXiv:2001.00702","author":"Zhang Zhaohui","year":"2020","unstructured":"Zhaohui Zhang , Shipeng Xie , Mingxiu Chen , and Haichao Zhu . 2020. HandAugment: A Simple Data Augmentation Method for Depth-Based 3D Hand Pose Estimation. arXiv preprint arXiv:2001.00702 ( 2020 ). Zhaohui Zhang, Shipeng Xie, Mingxiu Chen, and Haichao Zhu. 2020. HandAugment: A Simple Data Augmentation Method for Depth-Based 3D Hand Pose Estimation. arXiv preprint arXiv:2001.00702 (2020)."},{"key":"e_1_2_1_77_1","volume-title":"Proc. of ICML.","author":"Zhao Mingmin","year":"2017","unstructured":"Mingmin Zhao , Shichao Yue , Dina Katabi , Tommi S Jaakkola , and Matt T Bianchi . 2017 . Learning sleep stages from radio signals: A conditional adversarial architecture . In Proc. of ICML. Mingmin Zhao, Shichao Yue, Dina Katabi, Tommi S Jaakkola, and Matt T Bianchi. 2017. Learning sleep stages from radio signals: A conditional adversarial architecture. In Proc. of ICML."},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/2639108.2639110"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.525"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478112","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3478112","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:31:33Z","timestamp":1750188693000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478112"}},"subtitle":["Wearable Armband Can Track User's Hand"],"short-title":[],"issued":{"date-parts":[[2021,9,9]]},"references-count":79,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2021,9,9]]}},"alternative-id":["10.1145\/3478112"],"URL":"https:\/\/doi.org\/10.1145\/3478112","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,9]]},"assertion":[{"value":"2021-09-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}