{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,25]],"date-time":"2026-01-25T16:13:23Z","timestamp":1769357603600,"version":"3.49.0"},"reference-count":31,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2024,4,10]],"date-time":"2024-04-10T00:00:00Z","timestamp":1712707200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Coordena\u00e7\u00e3o de Aperfei\u00e7oamento de Pessoal de N\u00edvel Superior\u2014Brasil (CAPES)","award":["001"],"award-info":[{"award-number":["001"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In recent decades, technological advancements have transformed the industry, highlighting the efficiency of automation and safety. The integration of augmented reality (AR) and gesture recognition has emerged as an innovative approach to create interactive environments for industrial equipment. Gesture recognition enhances AR applications by allowing intuitive interactions. This study presents a web-based architecture for the integration of AR and gesture recognition, designed to interact with industrial equipment. Emphasizing hardware-agnostic compatibility, the proposed structure offers an intuitive interaction with equipment control systems through natural gestures. Experimental validation, conducted using Google Glass, demonstrated the practical viability and potential of this approach in industrial operations. The development focused on optimizing the system\u2019s software and implementing techniques such as normalization, clamping, conversion, and filtering to achieve accurate and reliable gesture recognition under different usage conditions. The proposed approach promotes safer and more efficient industrial operations, contributing to research in AR and gesture recognition. Future work will include improving the gesture recognition accuracy, exploring alternative gestures, and expanding the platform integration to improve the user experience.<\/jats:p>","DOI":"10.3390\/s24082407","type":"journal-article","created":{"date-parts":[[2024,4,10]],"date-time":"2024-04-10T03:07:48Z","timestamp":1712718468000},"page":"2407","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["A Framework for Real-Time Gestural Recognition and Augmented Reality for Industrial Applications"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-5185-5648","authenticated-orcid":false,"given":"Winnie","family":"Torres","sequence":"first","affiliation":[{"name":"Electrical Engineering Department, Center of Technology, Federal University of Rio Grande do Norte\u2014UFRN, Natal 59072-970, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-7090-4720","authenticated-orcid":false,"given":"Lilian","family":"Santos","sequence":"additional","affiliation":[{"name":"Computing Institute, A. C. Sim\u00f5es Campus, Federal University of Alagoas\u2014UFAL, Macei\u00f3 57072-970, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4111-8721","authenticated-orcid":false,"given":"Gustavo","family":"Melo","sequence":"additional","affiliation":[{"name":"Electrical Engineering Department, Center of Technology, Federal University of Rio Grande do Norte\u2014UFRN, Natal 59072-970, Brazil"}]},{"given":"Andressa","family":"Oliveira","sequence":"additional","affiliation":[{"name":"Electrical Engineering Department, Center of Technology, Federal University of Rio Grande do Norte\u2014UFRN, Natal 59072-970, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-4817-0072","authenticated-orcid":false,"given":"Pedro","family":"Nascimento","sequence":"additional","affiliation":[{"name":"Computing Institute, A. C. Sim\u00f5es Campus, Federal University of Alagoas\u2014UFAL, Macei\u00f3 57072-970, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-4654-1542","authenticated-orcid":false,"given":"Geovane","family":"Carvalho","sequence":"additional","affiliation":[{"name":"Computing Institute, A. C. Sim\u00f5es Campus, Federal University of Alagoas\u2014UFAL, Macei\u00f3 57072-970, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3077-2031","authenticated-orcid":false,"given":"T\u00e1cito","family":"Neves","sequence":"additional","affiliation":[{"name":"Department of Exact Sciences, Center for Applied Sciences and Education, Federal University of Para\u00edba, Rio Tinto 58297-000, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9486-4509","authenticated-orcid":false,"given":"Allan","family":"Martins","sequence":"additional","affiliation":[{"name":"Electrical Engineering Department, Center of Technology, Federal University of Rio Grande do Norte\u2014UFRN, Natal 59072-970, Brazil"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6769-4946","authenticated-orcid":false,"given":"\u00cdcaro","family":"Ara\u00fajo","sequence":"additional","affiliation":[{"name":"Computing Institute, A. C. Sim\u00f5es Campus, Federal University of Alagoas\u2014UFAL, Macei\u00f3 57072-970, Brazil"}]}],"member":"1968","published-online":{"date-parts":[[2024,4,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Chen, J.Y.C., and Fragomeni, G. (2020). Virtual, Augmented and Mixed Reality. Design and Interaction, Proceedings of the 12th International Conference, VAMR 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Copenhagen, Denmark, 19\u201324 July 2020, Springer.","DOI":"10.1007\/978-3-030-49695-1"},{"key":"ref_2","unstructured":"Ronzhin, A., and Shishlakov, V. (2020, January 15\u201318). Hand Gestures Recognition Model for Augmented Reality Robotic Applications. Proceedings of the 15th International Conference on Electromechanics and Robotics \u201cZavalishin\u2019s Readings\u201d, Ufa, Russia."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Dong, J., Xia, Z., and Zhao, Q. (2021). Augmented Reality Assisted Assembly Training Oriented Dynamic Gesture Recognition and Prediction. Appl. Sci., 11.","DOI":"10.3390\/app11219789"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"546","DOI":"10.1109\/TNSRE.2021.3059741","article-title":"A Transferable Adaptive Domain Adversarial Neural Network for Virtual Reality Augmented EMG-Based Gesture Recognition","volume":"29","author":"Phinyomark","year":"2021","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Chen, J.Y.C., Fragomeni, G., Degen, H., and Ntoa, S. (2022). HCI International 2022\u2014Late Breaking Papers: Interacting with eXtended Reality and Artificial Intelligence, Proceedings of the 24th International Conference on Human-Computer Interaction, HCII 2022, Virtual Event, 26 June\u20131 July 2022, Springer.","DOI":"10.1007\/978-3-031-21707-4"},{"key":"ref_6","first-page":"633","article-title":"Enhancing Virtual and Augmented Reality Interactions with a MediaPipe-Based Hand Gesture Recognition User Interface","volume":"28","author":"Jo","year":"2023","journal-title":"Ing. Syst. D\u2019Inf."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1057","DOI":"10.1007\/s11831-022-09831-7","article-title":"Realidade Aumentada: Uma Revis\u00e3o Abrangente","volume":"30","author":"Dargan","year":"2023","journal-title":"Arch. Comput. Methods Eng."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Huo, J., Keung, K.L., Lee, C.K.M., and Ng, H.Y. (2021, January 13\u201316). Hand Gesture Recognition with Augmented Reality and Leap Motion Controller. Proceedings of the 2021 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM), Singapore.","DOI":"10.1109\/IEEM50564.2021.9672611"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sutherland, I.E. (1968, January 9\u201311). A head-mounted three dimensional display. Proceedings of the Fall Joint Computer Conference, Part I, San Francisco, CA, USA.","DOI":"10.1145\/1476589.1476686"},{"key":"ref_10","unstructured":"Thomas, P.C., and David, W. (1992, January 7\u201310). Augmented reality: An application of heads-up display technology to manual manufacturing processes. Proceedings of the Hawaii International Conference on System Sciences, Kauai, HI, USA."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Santi, G.M., Ceruti, A., Liverani, A., and Osti, F. (2021). Augmented reality in industry 4.0 and future innovation programs. Technologies, 9.","DOI":"10.3390\/technologies9020033"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhou, K., Liu, T., and Zhou, L. (2015, January 15\u201317). Industry 4.0: Towards future industrial opportunities and challenges. Proceedings of the 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), Zhangjiajie, China.","DOI":"10.1109\/FSKD.2015.7382284"},{"key":"ref_13","unstructured":"Schwab, K. (2017). The Fourth Industrial Revolution, Currency."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Nayyar, A., and Kumar, A. (2020). A Roadmap to Industry 4.0: Smart Production, Sharp Business and Sustainable Development, Springer.","DOI":"10.1007\/978-3-030-14544-6"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Chang, S.N., and Chen, W.L. (2017, January 13\u201317). Does visualize industries matter? A technology foresight of global Virtual Reality and Augmented Reality Industry. Proceedings of the 2017 International Conference on Applied System Innovation (ICASI), Sapporo, Japan.","DOI":"10.1109\/ICASI.2017.7988432"},{"key":"ref_16","unstructured":"Wu, Y., and Huang, T.S. (1999). Gesture-Based Communication in Human-Computer Interaction, Proceedings of the International Gesture Workshop, GW\u201999, Gif-sur-Yvette, France, 17\u201319 March 1999, Springer."},{"key":"ref_17","unstructured":"Turk, M. (2002). Handbook of Virtual Environments, CRC Press."},{"key":"ref_18","first-page":"308","article-title":"Hand Gesture Recognition Based on Various Deep Learning YOLO Models","volume":"14","author":"Mesbahi","year":"2023","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2300207","DOI":"10.1002\/aisy.202300207","article-title":"A Review of Hand Gesture Recognition Systems Based on Noninvasive Wearable Sensors","volume":"5","author":"Tchantchane","year":"2023","journal-title":"Adv. Intell. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zargar, H., and Shah, L. (2023, January 7). Real-time hand gesture pattern recognition and device control through inbuilt webcam. Proceedings of the 1st Workshop on Intelligent Infocommunication Networks, Systems and Services (WI2NS2), Budapest, Hungary.","DOI":"10.3311\/WINS2023-002"},{"key":"ref_21","first-page":"403","article-title":"The application of gesture recognition based on MediaPipe in virtual scene","volume":"Volume 12636","author":"Zhou","year":"2023","journal-title":"Proceedings of the Third International Conference on Machine Learning and Computer Application (ICMLCA 2022)"},{"key":"ref_22","unstructured":"Liang, R.H., and Ouhyoung, M. (1998, January 14\u201316). A real-time continuous gesture recognition system for sign language. Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition, Nara, Japan."},{"key":"ref_23","unstructured":"Rekha, J., Bhattacharya, J., and Majumder, S. (2011, January 18\u201321). Hand gesture recognition for sign language: A new hybrid approach. Proceedings of the International Conference on Image Processing, Computer Vision, and Pattern Recognition (IPCV), Las Vegas, NV, USA."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Verma, H.V., Aggarwal, E., and Chandra, S. (2013, January 9\u201311). Gesture recognition using kinect for sign language translation. Proceedings of the 2013 IEEE Second International Conference on Image Information Processing (ICIIP-2013), Shimla, India.","DOI":"10.1109\/ICIIP.2013.6707563"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1109\/TPAMI.2019.2929257","article-title":"OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields","volume":"43","author":"Cao","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_26","unstructured":"Lugaresi, C., Tang, J., Nash, H., McClanahan, C., Uboweja, E., Hays, M., Zhang, F., Chang, C., Yong, M., and Lee, J. (2019). Mediapipe: A framework for building perception pipelines. arXiv."},{"key":"ref_27","unstructured":"St\u00f6rring, M., Moeslund, T.B., Liu, Y., and Granum, E. (2004, January 6\u20138). Computer vision-based gesture recognition for an augmented reality interface. Proceedings of the 4th IASTED International Conference on Visualization, Imaging, and Image Processing, Marbella, Spain."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Liang, H., Yuan, J., Thalmann, D., and Thalmann, N.M. (2015, January 26\u201330). Ar in hand: Egocentric palm pose tracking and gesture recognition for augmented reality applications. Proceedings of the 23rd ACM international conference on Multimedia, Brisbane, Australia.","DOI":"10.1145\/2733373.2807972"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Li, C., Zhang, X., and Jin, L. (2017, January 22\u201329). LPSNet: A Novel Log Path Signature Feature Based Hand Gesture Recognition Framework. Proceedings of the 2017 IEEE International Conference on Computer Vision Workshops (ICCVW), Venice, Italy.","DOI":"10.1109\/ICCVW.2017.80"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Sch\u00e4fer, A., Reis, G., and Stricker, D. (2022). AnyGesture: Arbitrary One-Handed Gestures for Augmented, Virtual, and Mixed Reality Applications. Appl. Sci., 12.","DOI":"10.3390\/app12041888"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2280","DOI":"10.1016\/j.patcog.2014.01.005","article-title":"Automatic generation and detection of highly reliable fiducial markers under occlusion","volume":"47","year":"2014","journal-title":"Pattern Recognit."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/8\/2407\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:25:24Z","timestamp":1760106324000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/8\/2407"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,4,10]]},"references-count":31,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2024,4]]}},"alternative-id":["s24082407"],"URL":"https:\/\/doi.org\/10.3390\/s24082407","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,4,10]]}}}