{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,23]],"date-time":"2025-12-23T10:04:01Z","timestamp":1766484241212,"version":"build-2065373602"},"reference-count":46,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,1,28]],"date-time":"2023-01-28T00:00:00Z","timestamp":1674864000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"natural science foundation of Xinjiang Uygur Autonomous Region","award":["2022D01C54"],"award-info":[{"award-number":["2022D01C54"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Traditional human-computer interaction technology relies heavily on input devices such as mice and keyboards, which limit the speed and naturalness of interaction and can no longer meet the more advanced interaction needs of users. With the development of computer vision (CV) technology, research on contactless gesture recognition has become a new research hotspot. However, current CV-based gesture recognition technology has the limitation of a limited number of gesture recognition and cannot achieve fast and accurate text input operations. To solve this problem, this paper proposes an over-the-air handwritten character recognition system based on the coordinate correction YOLOv5 algorithm and a lightweight convolutional neural network (LGR-CNN), referred to as Air-GR. Unlike the direct recognition of captured gesture pictures, the system uses the trajectory points of gesture actions to generate images for gesture recognition. Firstly, by combining YOLOv5 with the gesture coordinate correction algorithm proposed in this paper, the system can effectively improve gesture detection accuracy. Secondly, considering that the captured gesture coordinates may contain multiple gestures, this paper proposes a time-window-based algorithm for segmenting the gesture coordinates. Finally, the system recognizes user gestures by plotting the segmented gesture coordinates in a two-dimensional coordinate system and feeding them into the constructed lightweight convolutional neural network, LGR-CNN. For the gesture trajectory image classification task, the accuracy of LGR-CNN is 13.2%, 12.2%, and 4.5% higher than that of the mainstream networks VGG16, ResNet, and GoogLeNet, respectively. The experimental results show that Air-GR can quickly and effectively recognize any combination of 26 English letters and numbers, and its recognition accuracy reaches 95.24%.<\/jats:p>","DOI":"10.3390\/s23031464","type":"journal-article","created":{"date-parts":[[2023,1,30]],"date-time":"2023-01-30T02:28:34Z","timestamp":1675045714000},"page":"1464","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Air-GR: An Over-the-Air Handwritten Character Recognition System Based on Coordinate Correction YOLOv5 Algorithm and LGR-CNN"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9396-3313","authenticated-orcid":false,"given":"Yajun","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Software Engineering, Xinjiang University, \u00dcr\u00fcmqi 830046, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zijian","family":"Li","sequence":"additional","affiliation":[{"name":"School of Software Engineering, Xinjiang University, \u00dcr\u00fcmqi 830046, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhixiong","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Software Engineering, Xinjiang University, \u00dcr\u00fcmqi 830046, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bo","family":"Yuan","sequence":"additional","affiliation":[{"name":"School of Software Engineering, Xinjiang University, \u00dcr\u00fcmqi 830046, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xu","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Software Engineering, Xinjiang University, \u00dcr\u00fcmqi 830046, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1109\/TASLP.2020.3039600","article-title":"Gated recurrent fusion with joint training framework for robust end-to-end speech recognition","volume":"29","author":"Fan","year":"2020","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"508","DOI":"10.1109\/TASE.2020.3045880","article-title":"A novel illumination-robust hand gesture recognition system with event-based neuromorphic vision sensor","volume":"18","author":"Chen","year":"2021","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_3","unstructured":"Wachs, J., Stern, H., Edan, Y., Gillam, M., and Handler, J. (2006). Applications of Soft Computing, Springer."},{"key":"ref_4","unstructured":"Dinh, D.L., and Kim, T.S. (2017). Smart Energy Control Systems for Sustainable Buildings, Springer."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Lee, T.H., and Lee, H.J. (2018, January 15\u201320). A new virtual keyboard with finger gesture recognition for AR\/VR devices. Proceedings of the International Conference on Human-Computer Interaction, Las Vegas, NV, USA.","DOI":"10.1007\/978-3-319-91250-9_5"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/LSENS.2021.3081689","article-title":"Wearable smart band for American sign language recognition with polymer carbon nanocomposite-based pressure sensors","volume":"5","author":"Ramalingame","year":"2021","journal-title":"IEEE Sens. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3041","DOI":"10.1109\/JSEN.2019.2892073","article-title":"Hand-gesture recognition using two-antenna Doppler radar with deep convolutional neural networks","volume":"19","author":"Skaria","year":"2019","journal-title":"IEEE Sens. J."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"94460","DOI":"10.1109\/ACCESS.2019.2928318","article-title":"In-air gesture interaction: Real time hand posture recognition using passive RFID tags","volume":"7","author":"Cheng","year":"2019","journal-title":"IEEE Access"},{"key":"ref_9","first-page":"8671","article-title":"Widar3. 0: Zero-effort cross-domain gesture recognition with wi-fi","volume":"44","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Chu, X., Liu, J., and Shimamoto, S. (2021, January 9\u201311). A sensor-based hand gesture recognition system for Japanese sign language. Proceedings of the 2021 IEEE 3rd Global Conference on Life Sciences and Technologies (LifeTech), Nara, Japan.","DOI":"10.1109\/LifeTech52111.2021.9391981"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"5775","DOI":"10.1109\/JSEN.2019.2904595","article-title":"Cooperative sensing and wearable computing for sequential hand gesture recognition","volume":"19","author":"Zhang","year":"2019","journal-title":"IEEE Sens. J."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Jeon, H., Choi, H., Noh, D., Kim, T., and Lee, D. (2022). Wearable Inertial Sensor-Based Hand-Guiding Gestures Recognition Method Robust to Significant Changes in the Body-Alignment of Subject. Mathematics, 10.","DOI":"10.3390\/math10244753"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"8671","DOI":"10.1109\/LRA.2021.3103648","article-title":"A New Data augmentation method for time series wearable sensor data using a learning mode switching-based DCGAN","volume":"6","author":"Jeon","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"205","DOI":"10.23919\/JCC.2021.03.016","article-title":"WiFi CSI gesture recognition based on parallel LSTM-FCN deep space-time neural network","volume":"18","author":"Tang","year":"2021","journal-title":"China Commun."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1568","DOI":"10.1093\/gji\/ggab401","article-title":"Attention-based LSTM-FCN for earthquake detection and location","volume":"228","author":"Bai","year":"2021","journal-title":"Geophys. J. Int."},{"key":"ref_16","first-page":"11","article-title":"WiFine: Real-time Gesture Recognition Using Wi-Fi with Edge Intelligence","volume":"24","author":"Xing","year":"2022","journal-title":"ACM Trans. Sens. Netw. (TOSN)"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1109\/TMC.2016.2549518","article-title":"Grfid: A device-free rfid-based gesture recognition system","volume":"16","author":"Zou","year":"2016","journal-title":"IEEE Trans. Mob. Comput."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Li, W., Jiang, J., Liu, D., Liu, D., Gao, Y., and Li, Q. (2021, January 17\u201319). Digital gesture recognition based on millimeter wave radar. Proceedings of the 2021 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC), Xi\u2019an, China.","DOI":"10.1109\/ICSPCC52875.2021.9564707"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Shareef, S.K., Haritha IV, S.L., Prasanna, Y.L., and Kumar, G.K. (2021, January 3\u20135). Deep learning based hand gesture translation system. Proceedings of the 2021 5th International Conference on Trends in Electronics and Informatics (ICOEI), Tirunelveli, India.","DOI":"10.1109\/ICOEI51242.2021.9452947"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Areeb, Q.M., and Nadeem, M. (2021, January 25\u201326). Deep Learning Based Hand Gesture Recognition for Emergency Situation: A Study on Indian Sign Language. Proceedings of the 2021 International Conference on Data Analytics for Business and Industry (ICDABI), Sakheer, Bahrain.","DOI":"10.1109\/ICDABI53623.2021.9655842"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"871","DOI":"10.1109\/TSMCB.2012.2217324","article-title":"Most probable longest common subsequence for recognition of gesture character input","volume":"43","author":"Frolova","year":"2013","journal-title":"IEEE Trans. Cybern."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"664","DOI":"10.1145\/322033.322044","article-title":"Algorithms for the longest common subsequence problem","volume":"24","author":"Hirschberg","year":"1977","journal-title":"J. ACM (JACM)"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2094","DOI":"10.1109\/TCYB.2015.2464195","article-title":"Low-complexity hand gesture recognition system for continuous streams of digits and letters","volume":"46","author":"Poularakis","year":"2015","journal-title":"IEEE Trans. Cybern."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"116485","DOI":"10.1109\/ACCESS.2022.3218679","article-title":"3D Gesture Recognition and Adaptation for Human\u2013Robot Interaction","volume":"10","author":"Das","year":"2022","journal-title":"IEEE Access"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"7689","DOI":"10.1109\/TIP.2021.3108349","article-title":"Tmmf: Temporal multi-modal fusion for single-stage continuous gesture recognition","volume":"30","author":"Gammulle","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"14610","DOI":"10.1109\/JSEN.2022.3181518","article-title":"Video hand gestures recognition using depth camera and lightweight cnn","volume":"22","author":"Yeduri","year":"2022","journal-title":"IEEE Sens. J."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"26602","DOI":"10.1109\/JSEN.2021.3119977","article-title":"Robust hand gestures recognition using a deep CNN and thermal images","volume":"21","author":"Breland","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster r-cnn: Towards real-time object detection with region proposal networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 11\u201314). Ssd: Single shot multibox detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"5184","DOI":"10.1109\/ACCESS.2022.3140876","article-title":"Aircraft Target Detection in Remote Sensing Images Based on Improved YOLOv5","volume":"10","author":"Luo","year":"2022","journal-title":"IEEE Access"},{"key":"ref_32","unstructured":"Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/TBIOM.2019.2908436","article-title":"A fast and accurate system for face detection, identification, and verification","volume":"1","author":"Ranjan","year":"2019","journal-title":"IEEE Trans. Biom. Behav. Identity Sci."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Yang, S.Q., Chen, Y.H., Zhang, Z.Y., and Chen, J.H. (2022, January 15\u201317). Student in-class behaviors detection and analysis system based on CBAM-YOLOv5. Proceedings of the 2022 7th International Conference on Intelligent Computing and Signal Processing (ICSP), Xi\u2019an, China.","DOI":"10.1109\/ICSP54964.2022.9778630"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Guo, Y., Chen, S., Zhan, R., Wang, W., and Zhang, J. (2022, January 17\u201322). SAR Ship Detection Based on YOLOv5 Using CBAM and BiFPN. Proceedings of the IGARSS 2022\u20142022 IEEE International Geoscience and Remote Sensing Symposium, Kuala Lumpur, Malaysia.","DOI":"10.1109\/IGARSS46834.2022.9884180"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"80716","DOI":"10.1109\/ACCESS.2020.2988796","article-title":"Unsupervised K-means clustering algorithm","volume":"8","author":"Sinaga","year":"2020","journal-title":"IEEE Access"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Yang, Y., Liao, Y., Cheng, L., Zhang, K., Wang, H., and Chen, S. (2021, January 9\u201311). Remote Sensing Image Aircraft Target Detection Based on GIoU-YOLO v3. Proceedings of the 2021 6th International Conference on Intelligent Computing and Signal Processing (ICSP), Xi\u2019an, China.","DOI":"10.1109\/ICSP51882.2021.9408837"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"5032","DOI":"10.1109\/TIP.2021.3077144","article-title":"A systematic iou-related method: Beyond simplified regression for better localization","volume":"30","author":"Peng","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8\u201314). Cbam: Convolutional block attention module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Han, K., Wang, Y., Tian, Q., Guo, J., Xu, C., and Xu, C. (2020, January 13\u201319). Ghostnet: More features from cheap operations. Proceedings of the IEEE\/CVF conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00165"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Wang, Q., Wu, B., Zhu, P., Li, P., Zuo, W., and Hu, Q. (2020, January 13\u201319). Supplementary material for \u2018ECA-Net: Efficient channel attention for deep convolutional neural networks. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01155"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Zhang, Z., Wu, B., and Jiang, Y. (2022, January 15\u201317). Gesture Recognition System Based on Improved YOLO v3. Proceedings of the 2022 7th International Conference on Intelligent Computing and Signal Processing (ICSP), Xi\u2019an, China.","DOI":"10.1109\/ICSP54964.2022.9778394"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"59612","DOI":"10.1109\/ACCESS.2021.3069714","article-title":"Arabic sign language recognition system using 2D hands and body skeleton data","volume":"9","author":"Bencherif","year":"2021","journal-title":"IEEE Access"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"17421","DOI":"10.1109\/JSEN.2021.3059685","article-title":"Dynamic hand gesture recognition based on 3D hand pose estimation for human-robot interaction","volume":"22","author":"Gao","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Huang, Z., Li, J., Liang, J., Zen, B., and Tan, J. (2022, January 19\u201321). An IoT-Oriented Gesture Recognition System Based on ResNet-Mediapipe Hybrid Model. Proceedings of the 2022 5th International Conference on Pattern Recognition and Artificial Intelligence (PRAI), Chengdu, China.","DOI":"10.1109\/PRAI55851.2022.9904258"},{"key":"ref_46","first-page":"7421","article-title":"Real-Time Hand Gesture Recognition System Using MediaPipe and LSTM","volume":"2582","author":"Agrawal","year":"2022","journal-title":"Int. J. Res. Publ. Rev."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/3\/1464\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:18:10Z","timestamp":1760120290000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/3\/1464"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,28]]},"references-count":46,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,2]]}},"alternative-id":["s23031464"],"URL":"https:\/\/doi.org\/10.3390\/s23031464","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2023,1,28]]}}}