{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T19:34:49Z","timestamp":1776886489588,"version":"3.51.2"},"reference-count":47,"publisher":"Association for Computing Machinery (ACM)","issue":"ISS","license":[{"start":{"date-parts":[[2020,11,4]],"date-time":"2020-11-04T00:00:00Z","timestamp":1604448000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Shanghai RFID Engineering Technology Research Center","award":["19DZ2283800"],"award-info":[{"award-number":["19DZ2283800"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2020,11,4]]},"abstract":"<jats:p>Gesture recognition plays a fundamental role in emerging Human-Computer Interaction (HCI) paradigms. Recent advances in wireless sensing show promise for device-free and pervasive gesture recognition. Among them, RFID has gained much attention given its low-cost, light-weight and pervasiveness, but pioneer studies on RFID sensing still suffer two major problems when it comes to gesture recognition. The first is they are only evaluated on simple whole-body activities, rather than complex and fine-grained hand gestures. The second is they can not effectively work without retraining in new domains, i.e. new users or environments. To tackle these problems, in this paper, we propose RFree-GR, a domain-independent RFID system for complex and fine-grained gesture recognition. First of all, we exploit signals from the multi-tag array to profile the sophisticated spatio-temporal changes of hand gestures. Then, we elaborate a Multimodal Convolutional Neural Network (MCNN) to aggregate information across signals and abstract complex spatio-temporal patterns. Furthermore, we introduce an adversarial model to our deep learning architecture to remove domain-specific information while retaining information relevant to gesture recognition. We extensively evaluate RFree-GR on 16 commonly used American Sign Language (ASL) words. The average accuracy for new users and environments (new setup and new position) are $89.03%$, $90.21%$ and $88.38%$, respectively, significantly outperforming existing RFID based solutions, which demonstrates the superior effectiveness and generalizability of RFree-GR.<\/jats:p>","DOI":"10.1145\/3427315","type":"journal-article","created":{"date-parts":[[2020,11,5]],"date-time":"2020-11-05T00:44:02Z","timestamp":1604537042000},"page":"1-22","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":49,"title":["Towards Domain-independent Complex and Fine-grained Gesture Recognition with RFID"],"prefix":"10.1145","volume":"4","author":[{"given":"Cao","family":"Dian","sequence":"first","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dong","family":"Wang","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qian","family":"Zhang","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Run","family":"Zhao","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yinggang","family":"Yu","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,11,4]]},"reference":[{"key":"e_1_2_2_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDCS.2017.141"},{"key":"e_1_2_2_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3191739"},{"key":"e_1_2_2_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3131672.3131693"},{"key":"e_1_2_2_4_1","volume-title":"International conference on machine learning . 1180--1189","author":"Ganin Yaroslav","year":"2015","unstructured":"Yaroslav Ganin and Victor Lempitsky . 2015 . Unsupervised domain adaptation by backpropagation . In International conference on machine learning . 1180--1189 . Yaroslav Ganin and Victor Lempitsky. 2015. Unsupervised domain adaptation by backpropagation. In International conference on machine learning . 1180--1189."},{"key":"e_1_2_2_5_1","first-page":"23","article-title":"EPC radio-frequency identity protocols class-1 generation-2 UHF RFID protocol for communications at 860 MHz--960 MHz","volume":"1","author":"Global EPC","year":"2008","unstructured":"EPC Global . 2008 . EPC radio-frequency identity protocols class-1 generation-2 UHF RFID protocol for communications at 860 MHz--960 MHz . Version , Vol. 1 , 0 (2008), 23 . EPC Global. 2008. EPC radio-frequency identity protocols class-1 generation-2 UHF RFID protocol for communications at 860 MHz--960 MHz. Version , Vol. 1, 0 (2008), 23.","journal-title":"Version"},{"key":"e_1_2_2_6_1","volume-title":"High-Precision SmartWatch-based Sign Language Translator.","author":"Hou Jiahui","year":"2019","unstructured":"Jiahui Hou , Xiang-Yang Li , Peide Zhu , Zefan Wang , Yu Wang , Jianwei Qian , and Panlong Yang . 2019. SignSpeaker : A Real-time , High-Precision SmartWatch-based Sign Language Translator. ( 2019 ). Jiahui Hou, Xiang-Yang Li, Peide Zhu, Zefan Wang, Yu Wang, Jianwei Qian, and Panlong Yang. 2019. SignSpeaker: A Real-time, High-Precision SmartWatch-based Sign Language Translator. (2019)."},{"key":"e_1_2_2_7_1","first-page":"26","volume-title":"Au-Id: Automatic User Identification and Authentication through the Motions Captured from Sequential Human Activities Using RFID","author":"Huang Anna","year":"2019","unstructured":"Anna Huang , Dong Wang , Run Zhao , and Qian Zhang . 2019. Au-Id: Automatic User Identification and Authentication through the Motions Captured from Sequential Human Activities Using RFID . , Vol. 3 , 2, Article 48 ( 2019 ), bibinfonumpages 26 pages. https:\/\/doi.org\/10.1145\/3328919 Anna Huang, Dong Wang, Run Zhao, and Qian Zhang. 2019. Au-Id: Automatic User Identification and Authentication through the Motions Captured from Sequential Human Activities Using RFID. , Vol. 3, 2, Article 48 (2019), bibinfonumpages26 pages. https:\/\/doi.org\/10.1145\/3328919"},{"key":"e_1_2_2_8_1","volume-title":"Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167","author":"Ioffe Sergey","year":"2015","unstructured":"Sergey Ioffe and Christian Szegedy . 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 ( 2015 ). Sergey Ioffe and Christian Szegedy. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 (2015)."},{"key":"e_1_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300245"},{"key":"e_1_2_2_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3241539.3241548"},{"key":"e_1_2_2_11_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba . 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_2_2_12_1","doi-asserted-by":"publisher","DOI":"10.21437\/Interspeech.2015-711"},{"key":"e_1_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300568"},{"key":"e_1_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984582"},{"key":"e_1_2_2_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2850421"},{"key":"e_1_2_2_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897824.2925953"},{"key":"e_1_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3191755"},{"key":"e_1_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.456"},{"key":"e_1_2_2_19_1","unstructured":"Vinod Nair and Geoffrey E Hinton. 2010. Rectified linear units improve restricted boltzmann machines. In ICML .  Vinod Nair and Geoffrey E Hinton. 2010. Rectified linear units improve restricted boltzmann machines. In ICML ."},{"key":"e_1_2_2_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2541016.2541072"},{"key":"e_1_2_2_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3381010"},{"key":"e_1_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2015.2496324"},{"key":"e_1_2_2_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/2906388.2906407"},{"key":"e_1_2_2_24_1","volume-title":"Neural speech recognizer: Acoustic-to-word LSTM model for large vocabulary speech recognition. arXiv preprint arXiv:1610.09975","author":"Soltau Hagen","year":"2016","unstructured":"Hagen Soltau , Hank Liao , and Hasim Sak . 2016. Neural speech recognizer: Acoustic-to-word LSTM model for large vocabulary speech recognition. arXiv preprint arXiv:1610.09975 ( 2016 ). Hagen Soltau, Hank Liao, and Hasim Sak. 2016. Neural speech recognizer: Acoustic-to-word LSTM model for large vocabulary speech recognition. arXiv preprint arXiv:1610.09975 (2016)."},{"key":"e_1_2_2_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2942358.2942393"},{"key":"e_1_2_2_26_1","unstructured":"American Sign Language University. [n.d.]. BASIC ASL. http:\/\/lifeprint.com\/asl101\/pages-layout\/concepts.htm  American Sign Language University. [n.d.]. BASIC ASL. http:\/\/lifeprint.com\/asl101\/pages-layout\/concepts.htm"},{"key":"e_1_2_2_27_1","unstructured":"Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez \u0141ukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998--6008.  Ashish Vaswani Noam Shazeer Niki Parmar Jakob Uszkoreit Llion Jones Aidan N Gomez \u0141ukasz Kaiser and Illia Polosukhin. 2017. Attention is all you need. In Advances in neural information processing systems. 5998--6008."},{"key":"e_1_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3210240.3210335"},{"key":"e_1_2_2_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/INFOCOM.2018.8486346"},{"key":"e_1_2_2_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/2740070.2626330"},{"key":"e_1_2_2_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.783"},{"key":"e_1_2_2_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/2984511.2984565"},{"key":"e_1_2_2_33_1","volume-title":"Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking. ACM, 82--94","author":"Wang Wei","year":"2016","unstructured":"Wei Wang , Alex X Liu , and Ke Sun . 2016 a. Device-free gesture tracking using acoustic signals . In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking. ACM, 82--94 . Wei Wang, Alex X Liu, and Ke Sun. 2016a. Device-free gesture tracking using acoustic signals. In Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking. ACM, 82--94."},{"key":"e_1_2_2_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2639108.2639143"},{"key":"e_1_2_2_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3351271"},{"key":"e_1_2_2_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/JIOT.2019.2941527"},{"key":"e_1_2_2_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/2639108.2639111"},{"key":"e_1_2_2_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/2789168.2790100"},{"key":"e_1_2_2_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3338286.3340130"},{"key":"e_1_2_2_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3264958"},{"key":"e_1_2_2_41_1","volume-title":"RFree-ID: An Unobtrusive Human Identification System Irrespective of Walking Cofactors Using COTS RFID. In 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom). 1--10","author":"Zhang Q.","unstructured":"Q. Zhang , D. Li , R. Zhao , D. Wang , Y. Deng , and B. Chen . 2018 . RFree-ID: An Unobtrusive Human Identification System Irrespective of Walking Cofactors Using COTS RFID. In 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom). 1--10 . Q. Zhang, D. Li , R. Zhao, D. Wang, Y. Deng, and B. Chen. 2018. RFree-ID: An Unobtrusive Human Identification System Irrespective of Walking Cofactors Using COTS RFID. In 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom). 1--10."},{"key":"e_1_2_2_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302296"},{"key":"e_1_2_2_43_1","volume-title":"ReActor: Real-time and Accurate Contactless Gesture Recognition with RFID. In 2019 16th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON) . IEEE, 1--9.","author":"Zhang Shigeng","year":"2019","unstructured":"Shigeng Zhang , Chengwei Yang , Xiaoyan Kui , Jianxin Wang , Xuan Liu , and Song Guo . 2019 b . ReActor: Real-time and Accurate Contactless Gesture Recognition with RFID. In 2019 16th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON) . IEEE, 1--9. Shigeng Zhang, Chengwei Yang, Xiaoyan Kui, Jianxin Wang, Xuan Liu, and Song Guo. 2019 b. ReActor: Real-time and Accurate Contactless Gesture Recognition with RFID. In 2019 16th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON) . IEEE, 1--9."},{"key":"e_1_2_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/MMUL.2012.24"},{"key":"e_1_2_2_45_1","volume-title":"International Conference on Machine Learning . 4100--4109","author":"Zhao Mingmin","year":"2017","unstructured":"Mingmin Zhao , Shichao Yue , Dina Katabi , Tommi S Jaakkola , and Matt T Bianchi . 2017 . Learning sleep stages from radio signals: A conditional adversarial architecture . In International Conference on Machine Learning . 4100--4109 . Mingmin Zhao, Shichao Yue, Dina Katabi, Tommi S Jaakkola, and Matt T Bianchi. 2017. Learning sleep stages from radio signals: A conditional adversarial architecture. In International Conference on Machine Learning . 4100--4109."},{"key":"e_1_2_2_46_1","volume-title":"CRH: A Contactless Respiration and Heartbeat Monitoring System with COTS RFID Tags. In 2018 15th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON). 1--9.","author":"Zhao R.","unstructured":"R. Zhao , D. Wang , Q. Zhang , H. Chen , and A. Huang . 2018 . CRH: A Contactless Respiration and Heartbeat Monitoring System with COTS RFID Tags. In 2018 15th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON). 1--9. R. Zhao, D. Wang , Q. Zhang, H. Chen, and A. Huang. 2018. CRH: A Contactless Respiration and Heartbeat Monitoring System with COTS RFID Tags. In 2018 15th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON). 1--9."},{"key":"e_1_2_2_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2016.2549518"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3427315","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3427315","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T22:02:25Z","timestamp":1750197745000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3427315"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,4]]},"references-count":47,"journal-issue":{"issue":"ISS","published-print":{"date-parts":[[2020,11,4]]}},"alternative-id":["10.1145\/3427315"],"URL":"https:\/\/doi.org\/10.1145\/3427315","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,4]]},"assertion":[{"value":"2020-11-04","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}