{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T15:06:35Z","timestamp":1781363195615,"version":"3.54.1"},"reference-count":49,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2022,9,1]],"date-time":"2022-09-01T00:00:00Z","timestamp":1661990400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Technologies for pattern recognition are used in various fields. One of the most relevant and important directions is the use of pattern recognition technology, such as gesture recognition, in socially significant tasks, to develop automatic sign language interpretation systems in real time. More than 5% of the world\u2019s population\u2014about 430 million people, including 34 million children\u2014are deaf-mute and not always able to use the services of a living sign language interpreter. Almost 80% of people with a disabling hearing loss live in low- and middle-income countries. The development of low-cost systems of automatic sign language interpretation, without the use of expensive sensors and unique cameras, would improve the lives of people with disabilities, contributing to their unhindered integration into society. To this end, in order to find an optimal solution to the problem, this article analyzes suitable methods of gesture recognition in the context of their use in automatic gesture recognition systems, to further determine the most optimal methods. From the analysis, an algorithm based on the palm definition model and linear models for recognizing the shapes of numbers and letters of the Kazakh sign language are proposed. The advantage of the proposed algorithm is that it fully recognizes 41 letters of the 42 in the Kazakh sign alphabet. Until this time, only Russian letters in the Kazakh alphabet have been recognized. In addition, a unified function has been integrated into our system to configure the frame depth map mode, which has improved recognition performance and can be used to create a multimodal database of video data of gesture words for the gesture recognition system.<\/jats:p>","DOI":"10.3390\/s22176621","type":"journal-article","created":{"date-parts":[[2022,9,2]],"date-time":"2022-09-02T00:19:01Z","timestamp":1662077941000},"page":"6621","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Sign Language Recognition Method Based on Palm Definition Model and Multiple Classification"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4669-9254","authenticated-orcid":false,"given":"Nurzada","family":"Amangeldy","sequence":"first","affiliation":[{"name":"Faculty of Information Technologies, L.N. Gumilyov Eurasian National University, Nur-Sultan 010008, Kazakhstan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3807-9530","authenticated-orcid":false,"given":"Saule","family":"Kudubayeva","sequence":"additional","affiliation":[{"name":"Faculty of Information Technologies, L.N. Gumilyov Eurasian National University, Nur-Sultan 010008, Kazakhstan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Akmaral","family":"Kassymova","sequence":"additional","affiliation":[{"name":"Institute of Economics, Information Technologies and Professional Education, Zangir Khan West Kazakhstan Agrarion-Technical University, Uralsk 090000, Kazakhstan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ardak","family":"Karipzhanova","sequence":"additional","affiliation":[{"name":"Department of Information and Technical Sciences, Faculty of Information Technologies and Economics, Kazakh Humanitarian Law Innovative University, East Kazakhstan Region, Semey 701400, Kazakhstan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8152-8661","authenticated-orcid":false,"given":"Bibigul","family":"Razakhova","sequence":"additional","affiliation":[{"name":"Faculty of Information Technologies, L.N. Gumilyov Eurasian National University, Nur-Sultan 010008, Kazakhstan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Serikbay","family":"Kuralov","sequence":"additional","affiliation":[{"name":"Faculty of Information Technologies, L.N. Gumilyov Eurasian National University, Nur-Sultan 010008, Kazakhstan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,9,1]]},"reference":[{"key":"ref_1","unstructured":"World Health Organization (WHO) (2022, August 02). Deafness and Hearing Loss. Available online: http:\/\/www.who.int\/news-room\/fact-sheets\/detail\/deafness-and-hearing-loss."},{"key":"ref_2","unstructured":"(2022, August 02). Law of the Republic of Kazakhstan \u201cOn Education\u201d. Available online: https:\/\/adilet.zan.kz\/kaz\/docs\/Z070000319_."},{"key":"ref_3","unstructured":"(2022, August 02). The Concept of Development of Inclusive Education in Kazakhstan. Available online: https:\/\/legalacts.egov.kz\/application\/downloadconceptfile?id=2506747."},{"key":"ref_4","unstructured":"Amangeldy, N., Kudubayeva, S.A., Tursynova, N.A., Baymakhanova, A., Yerbolatova, A., and Abdieva, S. (2022). Comparative analysis on the form of demonstration words of kazakh sign language with other sign languages. TURKLANG, 114."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Gani, E., and Kika, A. (2016). Albanian Sign Language (AlbSL) Number Recognition from Both Hand\u2019s Gestures Acqu4red by Kinect Sensors. Int. J. Adv. Comput. Sci. Appl., 7.","DOI":"10.14569\/IJACSA.2016.070729"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/j.procs.2020.06.022","article-title":"Hand Gesture Recognition using Image Processing and Feature Extraction Techniques","volume":"173","author":"Sharma","year":"2020","journal-title":"Procedia Comput. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Malik, M.S.A., Kousar, N., Abdullah, T., Ahmed, M., Rasheed, F., and Awais, M. (2018). Pakistan Sign Language Detection using PCA and KNN. Int. J. Adv. Comput. Sci. Appl., 9.","DOI":"10.14569\/IJACSA.2018.090414"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"7712","DOI":"10.30534\/ijatcse\/2020\/114952020","article-title":"Performance analysis and high recognition rate of automated hand gesture recognition though GMM and SVM-KNN classifiers","volume":"9","author":"Patil","year":"2020","journal-title":"Int. J. Adv. Trends Comput. Sci. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"92","DOI":"10.3991\/ijim.v12i2.8071","article-title":"Mobile Application Based Translation of Sign Language to Text Description in Kannada Language","volume":"12","author":"Kagalkar","year":"2018","journal-title":"Int. J. Interact. Mob. Technol."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Qin, M., and He, G. (2016, January 18\u201320). Gesture Recognition with Multiple Spatial Feature Fusion. Proceedings of the 2016 4th International Conference on Machinery, Materials and Computing Technology, Changsha, China.","DOI":"10.2991\/icmmct-16.2016.351"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Su, R., Chen, X., Cao, S., and Zhang, X. (2016). Random Forest-Based Recognition of Isolated Sign Language Subwords Using Data from Accelerometers and Surface Electromyographic Sensors. Sensors, 16.","DOI":"10.3390\/s16010100"},{"key":"ref_12","first-page":"58","article-title":"Sign language dactyl recognition based on machine learning algorithms","volume":"4","author":"Kenshimov","year":"2021","journal-title":"East.-Eur. J. Enterp. Technol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1311","DOI":"10.1007\/s11263-018-1121-3","article-title":"Deep Sign: Enabling Robust Statistical Continuous Sign Language Recognition via Hybrid CNN-HMMs","volume":"126","author":"Koller","year":"2018","journal-title":"Int. J. Comput. Vis."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Koller, O., Zargaran, S., Ney, H., and Bowden, R. (2016, January 19\u201322). Deep Sign: Hybrid CNN-HMM for Continuous Sign Language Recognition. Proceedings of the British Machine Vision Conference 2016, York, UK.","DOI":"10.5244\/C.30.136"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"26","DOI":"10.35940\/ijsce.F3409.059620","article-title":"Hand Motion Analysis using CNN","volume":"9","author":"Raj","year":"2020","journal-title":"Int. J. Soft Comput. Eng."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"34","DOI":"10.3991\/ijoe.v17i01.18585","article-title":"Web Based Recognition and Translation of American Sign Language with CNN and RNN","volume":"17","author":"Bendarkar","year":"2021","journal-title":"Int. J. Online Biomed. Eng."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Rahim, A., Islam, R., and Shin, J. (2019). Non-Touch Sign Word Recognition Based on Dynamic Hand Gesture Using Hybrid Segmentation and CNN Feature Fusion. Appl. Sci., 9.","DOI":"10.3390\/app9183790"},{"key":"ref_18","unstructured":"Nafis, A.F., and Suciati, N. (2021). Sign Language Recognition on Video Data Based on Graph Convolutional Network. J. Theor. Appl. Inf. Technol., 99."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"2353","DOI":"10.1016\/j.procs.2020.04.255","article-title":"A Deep Convolutional Neural Network Approach for Static Hand Gesture Recognition","volume":"171","author":"Adithya","year":"2020","journal-title":"Procedia Comput. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"60","DOI":"10.4018\/IJACI.2019070104","article-title":"Convolutional Neural Network Based American Sign Language Static Hand Gesture Recognition","volume":"10","author":"Ahuja","year":"2019","journal-title":"Int. J. Ambient Comput. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"20","DOI":"10.33166\/AETiC.2020.04.003","article-title":"Hand Gesture-based Sign Alphabet Recognition and Sentence Interpretation using a Convolutional Neural Network","volume":"4","author":"Rahim","year":"2020","journal-title":"Ann. Emerg. Technol. Comput."},{"key":"ref_22","first-page":"33","article-title":"Deep Learning Sign Language Recognition System Based on Wi-Fi CSI","volume":"12","author":"Bastwesy","year":"2020","journal-title":"Int. J. Intell. Syst. Appl."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"216718","DOI":"10.1109\/ACCESS.2020.3039539","article-title":"Multi-Information Spatial\u2013Temporal LSTM Fusion Continuous Sign Language Neural Machine Translation","volume":"8","author":"Xiao","year":"2020","journal-title":"IEEE Access"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Hossain, B., Adhikary, A., and Soheli, S.J. (2020). Sign Language Digit Recognition Using Different Convolutional Neural Network Model. Asian J. Res. Comput. Sci., 16\u201324.","DOI":"10.9734\/ajrcos\/2020\/v6i230154"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"8504","DOI":"10.30534\/ijatcse\/2020\/230952020","article-title":"Design and Development of a Sign Language Gesture Recognition using Open CV","volume":"9","author":"Tumuluru","year":"2020","journal-title":"Int. J. Adv. Trends Comput. Sci. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Mohammed, A.A.Q., Lv, J., and Islam, S. (2019). A Deep Learning-Based End-to-End Composite System for Hand Detection and Gesture Recognition. Sensors, 19.","DOI":"10.3390\/s19235282"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Khari, M., Garg, A.K., Gonzalez-Crespo, R., and Verdu, E. (2019). Gesture Recognition of RGB and RGB-D Static Images Using Convolutional Neural Networks. Int. J. Interact. Multimed. Artif. Intell., 5.","DOI":"10.9781\/ijimai.2019.09.002"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"565","DOI":"10.18280\/ts.380304","article-title":"Gesture Recognition of Somatosensory Interactive Acupoint Massage Based on Image Feature Deep Learning Model","volume":"38","author":"Jia","year":"2021","journal-title":"Trait. Signal"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1016\/j.cag.2021.07.007","article-title":"SHREC 2021: Skeleton-based hand gesture recognition in the wild","volume":"99","author":"Caputo","year":"2021","journal-title":"Comput. Graph."},{"key":"ref_30","first-page":"9","article-title":"Sign Language to Text and Speech Translation in Real Time Using Convolutional Neural Network","volume":"8","author":"Halder","year":"2021","journal-title":"Int. J. Res. Publ. Rev."},{"key":"ref_31","unstructured":"Gomase, K., Dhanawade, A., Gurav, P., and Lokare, S. (2022). Sign Language Recognition using Mediapipe. Int. Res. J. Eng. Technol., 9."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"57","DOI":"10.31937\/sk.v13i2.2109","article-title":"Hand Gesture Detection for American Sign Language using K-Nearest Neighbor with Mediapipe","volume":"13","author":"Alvin","year":"2021","journal-title":"Ultim. Comput. J. Sist. Komput."},{"key":"ref_33","first-page":"17","article-title":"Indian Sign Language Classification (ISL) using Machine Learning","volume":"1","author":"Chakraborty","year":"2021","journal-title":"Am. J. Electron. Commun."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"180270","DOI":"10.1109\/ACCESS.2019.2959206","article-title":"Multimodal Spatiotemporal Networks for Sign Language Recognition","volume":"7","author":"Zhang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3243217","article-title":"SKEPRID","volume":"14","author":"Yu","year":"2018","journal-title":"ACM Trans. Multimedia Comput. Commun. Appl."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Luqman, H., and El-Alfy, E.-S. (2021). Towards Hybrid Multimodal Manual and Non-Manual Arabic Sign Language Recognition: mArSL Database and Pilot Study. Electronics, 10.","DOI":"10.3390\/electronics10141739"},{"key":"ref_37","unstructured":"Kagirov, I., Ivanko, D., Ryumin, D., Axyonov, A., and Karpov, A. (2020, January 11\u201316). TheRuSLan: Database of Russian sign language. Proceedings of the LREC 2020\u201412th International Conference on Language Resources and Evaluation, Conference Proceedings, Marseille, France."},{"key":"ref_38","first-page":"179","article-title":"Automatic detection and recognition of 3d manual gestures for human-machine interaction","volume":"XLII-2\/W12","author":"Ryumin","year":"2019","journal-title":"ISPRS Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_39","unstructured":"Dimskis, L.S. (2002). We Study Sign Language, Academia Publishing Center."},{"key":"ref_40","unstructured":"Zaitseva, G.L. (2000). Signed speech. Dactylology, Vlados."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Kudubayeva, S., Amangeldy, N., Sundetbayeva, A., and Sarinova, A. (2019, January 6\u20138). The use of correlation analysis in the algorithm of dynamic gestures recognition in video sequence. Proceedings of the 5th International Conference on Engineering and MIS, Pahang, Malaysia.","DOI":"10.1145\/3330431.3330439"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Saggio, G., Cavallo, P., Ricci, M., Errico, V., Zea, J., and Benalc\u00e1zar, M. (2020). Sign Language Recognition Using Wearable Electronics: Implementing k-Nearest Neighbors with Dynamic Time Warping and Convolutional Neural Network Algorithms. Sensors, 20.","DOI":"10.3390\/s20143879"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Hou, J., Li, X.-Y., Zhu, P., Wang, Z., Wang, Y., Qian, J., and Yang, P. (2019, January 21\u201325). SignSpeaker: A Real-time, High-Precision SmartWatch-based Sign Language Translator. Proceeding of the MobiCom\u201919: The 25th Annual International Conference on Mobile Computing and Networking, Los Cabos, Mexico.","DOI":"10.1145\/3300061.3300117"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3432208","article-title":"Finger Gesture Tracking for Interactive Applications","volume":"4","author":"Liu","year":"2020","journal-title":"Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Yin, S., Yang, J., Qu, Y., Liu, W., Guo, Y., Liu, H., and Wei, D. (2018, January 30\u201331). Research on Gesture Recognition Technology of Data Glove Based on Joint Algorithm. Proceedings of the 2018 International Conference on Mechanical, Electronic, Control and Automation Engineering, Qingdao, China.","DOI":"10.2991\/mecae-18.2018.8"},{"key":"ref_46","first-page":"131","article-title":"Gloves based hand gesture recognition using indian sign language","volume":"8","author":"Bairagi","year":"2017","journal-title":"Int. J. Latest Trends Eng. Technol."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"964","DOI":"10.1080\/14686996.2019.1665458","article-title":"A smart glove with integrated triboelectric nanogenerator for self-powered gesture recognition and language expression","volume":"20","author":"Chiu","year":"2019","journal-title":"Sci. Technol. Adv. Mater."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Mummadi, C.K., Leo, F.P.P., Verma, K.D., Kasireddy, S., Scholl, P.M., Kempfle, J., and van Laerhoven, K. (2018). Real-time and embedded detection of hand gestures with an IMU-based glove. Informatics, 5.","DOI":"10.3390\/informatics5020028"},{"key":"ref_49","unstructured":"(2022, August 02). Available online: https:\/\/pypi.org\/project\/mediapipe\/."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/17\/6621\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:21:54Z","timestamp":1760142114000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/17\/6621"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,1]]},"references-count":49,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2022,9]]}},"alternative-id":["s22176621"],"URL":"https:\/\/doi.org\/10.3390\/s22176621","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,1]]}}}