{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,10]],"date-time":"2025-12-10T12:40:14Z","timestamp":1765370414852,"version":"3.37.3"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2024,6,1]],"date-time":"2024-06-01T00:00:00Z","timestamp":1717200000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,6,1]],"date-time":"2024-06-01T00:00:00Z","timestamp":1717200000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100019345","name":"King Salman center For Disability Research","doi-asserted-by":"crossref","award":["KSRG-2023-435","KSRG-2023-435","KSRG-2023-435","KSRG-2023-435"],"award-info":[{"award-number":["KSRG-2023-435","KSRG-2023-435","KSRG-2023-435","KSRG-2023-435"]}],"id":[{"id":"10.13039\/501100019345","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Artif Intell Rev"],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Real-time speech-to-text and text-to-speech technologies have significantly influenced the accessibility of communication for individuals who are deaf or mute. This research aims to assess the efficacy of these technologies in facilitating communication between deaf or mute individuals and those who are neither deaf nor mute. A mixed-method approach will incorporate qualitative and quantitative data collection and analysis techniques. The study will involve participants from deaf or mute and non-deaf or non-mute communities. The research will scrutinize the precision and efficiency of communication using these technologies and evaluate user experience and satisfaction. Furthermore, the study intends to pinpoint potential obstacles and limitations of these technologies and offer suggestions for enhancing their effectiveness in fostering inclusivity. The study proposes an active learning framework for sign language gesture recognition, termed Active Convolutional Neural Networks\u2014Sign Language (ActiveCNN-SL). ActiveCNN-SL aims to minimize the labeled data required for training and augment the accuracy of sign language gesture recognition through iterative human feedback. This proposed framework holds the potential to enhance communication accessibility for deaf and mute individuals and encourage inclusivity across various environments. The proposed framework is trained using two primary datasets: (i) the Sign Language Gesture Images Dataset and (ii) the American Sign Language Letters (ASL)\u2014v1. The framework employs Resnet50 and YoloV.8 to train the datasets. It has demonstrated high performance in terms of precision and accuracy. The ResNet model achieved a remarkable accuracy rate of 99.98% during training, and it also exhibited a validation accuracy of 100%, surpassing the baseline CNN and RNN models. The YOLOv8 model outperformed previous methods on the ASL alphabet dataset, achieving an overall mean average accuracy for all classes of 97.8%.<\/jats:p>","DOI":"10.1007\/s10462-024-10792-5","type":"journal-article","created":{"date-parts":[[2024,6,1]],"date-time":"2024-06-01T05:01:35Z","timestamp":1717218095000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Active convolutional neural networks sign language (ActiveCNN-SL) framework: a paradigm shift in deaf-mute communication"],"prefix":"10.1007","volume":"57","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3776-8430","authenticated-orcid":false,"given":"Hanaa","family":"ZainEldin","sequence":"first","affiliation":[]},{"given":"Nadiah A.","family":"Baghdadi","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1753-030X","authenticated-orcid":false,"given":"Samah A.","family":"Gamel","sequence":"additional","affiliation":[]},{"given":"Mansourah","family":"Aljohani","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6116-2191","authenticated-orcid":false,"given":"Fatma M.","family":"Talaat","sequence":"additional","affiliation":[]},{"given":"Amer","family":"Malki","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0120-3235","authenticated-orcid":false,"given":"Mahmoud","family":"Badawy","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1259-6193","authenticated-orcid":false,"given":"Mostafa","family":"Elhosseini","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,6,1]]},"reference":[{"key":"10792_CR1","unstructured":"Alawwad RA, Bchir O, Ismail MMB (2021) Arabic sign language recognition using Faster RCNN. Int J Adv Comput Sci Appl (IJACSA) 12(3):692\u2013700"},{"issue":"1","key":"10792_CR2","doi-asserted-by":"publisher","first-page":"234","DOI":"10.1109\/TMM.2018.2856094","volume":"21","author":"D Avola","year":"2018","unstructured":"Avola D et al (2018) Exploiting recurrent neural networks and leap motion controller for the recognition of sign language and semaphoric hand gestures. IEEE Trans Multimed 21(1):234\u2013245","journal-title":"IEEE Trans Multimed"},{"issue":"2","key":"10792_CR3","doi-asserted-by":"publisher","first-page":"3051","DOI":"10.1007\/s11042-020-09829-y","volume":"80","author":"AA Barbhuiya","year":"2021","unstructured":"Barbhuiya AA, Karsh RK, Jain R (2021) CNN based feature extraction and classification for sign language. Multimed Tools Appl 80(2):3051\u20133069","journal-title":"Multimed Tools Appl"},{"issue":"24","key":"10792_CR4","doi-asserted-by":"publisher","first-page":"e7230","DOI":"10.1002\/cpe.7230","volume":"34","author":"AA Barbhuiya","year":"2022","unstructured":"Barbhuiya AA, Karsh RK, Jain R (2022) Gesture recognition from RGB images using convolutional neural network-attention based system. Concurr Comput: Pract Exp 34(24):e7230","journal-title":"Concurr Comput: Pract Exp"},{"issue":"05","key":"10792_CR5","doi-asserted-by":"publisher","first-page":"2150033","DOI":"10.1142\/S1793524521500339","volume":"14","author":"Anas Bilal","year":"2021","unstructured":"Bilal A et al (2021a) Neuro-optimized numerical treatment of HIV infection model. Int J Biomath 14(05):2150033","journal-title":"Int J Biomath"},{"key":"10792_CR6","doi-asserted-by":"publisher","first-page":"23544","DOI":"10.1109\/ACCESS.2021.3056186","volume":"9","author":"A Bilal","year":"2021","unstructured":"Bilal A et al (2021b) Diabetic retinopathy detection and classification using mixed models for a disease grading database. IEEE Access 9:23544\u201323553","journal-title":"IEEE Access"},{"issue":"7","key":"10792_CR7","doi-asserted-by":"publisher","first-page":"1427","DOI":"10.3390\/sym14071427","volume":"14","author":"A Bilal","year":"2022","unstructured":"Bilal A et al (2022a) AI-based automatic detection and classification of diabetic retinopathy using U-Net and deep learning. Symmetry 14(7):1427","journal-title":"Symmetry"},{"issue":"6","key":"10792_CR8","first-page":"663","volume":"10","author":"A Bilal","year":"2022","unstructured":"Bilal A et al (2022b) A transfer learning and U-Net-based automatic detection of diabetic retinopathy from fundus images. Comput Methods Biomech Biomed Eng: Imaging Vis 10(6):663\u2013674","journal-title":"Comput Methods Biomech Biomed Eng: Imaging Vis"},{"key":"10792_CR9","doi-asserted-by":"publisher","unstructured":"Bilal A, Sun G, Mazhar S, Imran A (2022c) Improved grey wolf optimization-based feature selection and classification using CNN for diabetic retinopathy detection. In: Suma V, Fernando X, Du KL, Wang H (eds) Evolutionary Computing and Mobile Sustainable Networks. Lecture Notes on Data Engineering and Communications Technologies, vol 116. Springer, Singapore. https:\/\/doi.org\/10.1007\/978-981-16-9605-3_1","DOI":"10.1007\/978-981-16-9605-3_1"},{"issue":"2","key":"10792_CR10","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1080\/02533839.2021.2012525","volume":"45","author":"A Bilal","year":"2022","unstructured":"Bilal A et al (2022d) Lung nodules detection using grey wolf optimization by weighted filters and classification using CNN. J Chin Inst Eng 45(2):175\u2013186","journal-title":"J Chin Inst Eng"},{"issue":"24","key":"10792_CR11","doi-asserted-by":"publisher","first-page":"9603","DOI":"10.3390\/s22249603","volume":"22","author":"A Bilal","year":"2022","unstructured":"Bilal A et al (2022e) IGWO-IVNet3: DL-based automatic diagnosis of lung nodules using an improved gray wolf optimization and InceptionNet-V3. Sensors 22(24):9603","journal-title":"Sensors"},{"key":"10792_CR12","doi-asserted-by":"crossref","unstructured":"Bilal A, Liu X, Long H, Shafiq M, Waqar M (2023a) Increasing crop quality and yield with a machine learning-based crop monitoring system. Comput Mater Continua 76(2):2401\u20132426","DOI":"10.32604\/cmc.2023.037857"},{"issue":"19","key":"10792_CR13","doi-asserted-by":"publisher","first-page":"4094","DOI":"10.3390\/electronics12194094","volume":"12","author":"A Bilal","year":"2023","unstructured":"Bilal A et al (2023b) EdgeSVDNet: 5G-enabled detection and classification of vision-threatening diabetic retinopathy in retinal fundus images. Electronics 12(19):4094","journal-title":"Electronics"},{"issue":"10","key":"10792_CR14","doi-asserted-by":"publisher","first-page":"3554","DOI":"10.3390\/s18103554","volume":"18","author":"T-W Chong","year":"2018","unstructured":"Chong T-W, Lee B-G (2018) American sign language recognition using leap motion controller with machine learning approach. Sensors 18(10):3554","journal-title":"Sensors"},{"key":"10792_CR15","doi-asserted-by":"publisher","first-page":"118559","DOI":"10.1016\/j.eswa.2022.118559","volume":"211","author":"MM Damaneh","year":"2023","unstructured":"Damaneh MM, Mohanna F, Jafari P (2023) Static hand gesture recognition in sign language based on convolutional neural network with feature extraction method using ORB descriptor and Gabor filter. Exp Syst Appl 211:118559","journal-title":"Exp Syst Appl"},{"key":"10792_CR16","unstructured":"Dima TF, Ahmed ME (2021) Using YOLOv5 algorithm to detect and recognize American sign language. In: 2021 IEEE International Conference on Information Technology (ICIT). IEEE, Amman, Jordan. pp 603\u2013607"},{"issue":"5","key":"10792_CR17","doi-asserted-by":"publisher","first-page":"e5991","DOI":"10.1002\/cpe.5991","volume":"33","author":"H Duan","year":"2021","unstructured":"Duan H, Sun Y, Cheng W et al (2021) Gesture recognition based on multi-modal feature weight. Concurr Comput 33(5):e5991","journal-title":"Concurr Comput"},{"key":"10792_CR18","doi-asserted-by":"publisher","first-page":"192","DOI":"10.1111\/j.1471-3802.2011.01230.x","volume":"12","author":"A Foley","year":"2012","unstructured":"Foley A, Ferri BA (2012) Technology for people, not disabilities: Ensuring access and inclusion. J Res Spec Educ Needs 12:192\u2013200","journal-title":"J Res Spec Educ Needs"},{"issue":"3","key":"10792_CR19","doi-asserted-by":"publisher","first-page":"1285","DOI":"10.3390\/s22031285","volume":"22","author":"F Hardala\u00e7","year":"2022","unstructured":"Hardala\u00e7 F, Uysal F, Peker O, \u00c7i\u00e7eklida\u011f M, Tolunay T, Tokg\u00f6z N, Kutbay U, Demirciler B, Mert F (2022) Fracture detection in wrist X-ray images using deep learning-based object detection models. Sensors 22(3):1285","journal-title":"Sensors"},{"key":"10792_CR20","unstructured":"https:\/\/www.diversity.ucsf.edu\/data-reports. Accessed (14-4-2023)"},{"key":"10792_CR21","unstructured":"https:\/\/www.github.com\/paulinamoskwa\/Real-Time-Sign-Language. Accessed: 1-2-2023"},{"key":"10792_CR22","unstructured":"https:\/\/www.kaggle.com\/datasets\/ahmedkhanak1995\/sign-language-gesture-images-dataset. Accessed: 1-2-2023"},{"key":"10792_CR23","unstructured":"https:\/\/www.kaggle.com\/datasets\/grassknoted\/asl-alphabet. Accessed: 1-2-2023"},{"key":"10792_CR24","unstructured":"https:\/\/www.urmc.rochester.edu\/ncdhr\/research\/current-research.aspx. Accessed (3-4-2023)"},{"key":"10792_CR25","unstructured":"https:\/\/www.who.int\/news-room\/fact-sheets\/detail\/deafness-and-hearing-loss. Accessed (10-5-2023)"},{"key":"10792_CR26","unstructured":"Jain S (2023) ADDSL: hand gesture detection and sign language recognition on annotated danish sign language. arXiv preprint. https:\/\/arxiv.org\/abs\/2305.09736"},{"key":"10792_CR27","doi-asserted-by":"publisher","first-page":"100141","DOI":"10.1016\/j.array.2022.100141","volume":"14","author":"S Katoch","year":"2022","unstructured":"Katoch S, Singh V, Tiwary US (2022) Indian sign language recognition system using SURF with SVM and CNN. Array 14:100141","journal-title":"Array"},{"key":"10792_CR28","doi-asserted-by":"crossref","unstructured":"Kawas S, Karalis G, Wen T, Ladner RE (2016) Improving real-time captioning experiences for deaf and hard of hearing students. In: Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility. ACM,\u00a0Reno Nevada, USA pp 15\u201323","DOI":"10.1145\/2982142.2982164"},{"issue":"11","key":"10792_CR29","doi-asserted-by":"publisher","first-page":"1780","DOI":"10.3390\/electronics11111780","volume":"11","author":"D Kothadiya","year":"2022","unstructured":"Kothadiya D et al (2022) Deepsign: sign language detection and recognition using deep learning. Electronics 11(11):1780","journal-title":"Electronics"},{"key":"10792_CR30","doi-asserted-by":"publisher","first-page":"114403","DOI":"10.1016\/j.eswa.2020.114403","volume":"167","author":"CKM Lee","year":"2021","unstructured":"Lee CKM et al (2021) American sign language recognition and training method with recurrent neural network. Exp Syst Appl 167:114403","journal-title":"Exp Syst Appl"},{"issue":"6","key":"10792_CR31","doi-asserted-by":"publisher","first-page":"e6063","DOI":"10.1002\/cpe.6063","volume":"33","author":"S Liao","year":"2021","unstructured":"Liao S, Li G, Wu H et al (2021) Occlusion gesture recognition based on improved SSD. Concurr Comput 33(6):e6063","journal-title":"Concurr Comput"},{"key":"10792_CR32","doi-asserted-by":"crossref","unstructured":"Mannan A, Abbasi A, Javed AR, Ahsan A, Gadekallu TR, Xin Q (2022)\u00a0Hypertuned deep convolutional neural network for sign language recognition. Comput Intell Neurosci\u00a02022:1450822","DOI":"10.1155\/2022\/1450822"},{"key":"10792_CR33","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1016\/j.procs.2022.12.106","volume":"216","author":"Y Obi","year":"2023","unstructured":"Obi Y et al (2023) Sign language recognition system for communicating to people with disabilities. Proc Comput Sci 216:13\u201320","journal-title":"Proc Comput Sci"},{"issue":"3","key":"10792_CR34","doi-asserted-by":"publisher","first-page":"433","DOI":"10.3390\/diagnostics13030433","volume":"13","author":"MB \u00d6zda\u015f","year":"2023","unstructured":"\u00d6zda\u015f MB, Uysal F, Hardala\u00e7 F (2023a) Classification of retinal diseases in optical coherence tomography images using artificial intelligence and firefly algorithm. Diagnostics 13(3):433","journal-title":"Diagnostics"},{"key":"10792_CR35","doi-asserted-by":"crossref","unstructured":"\u00d6zda\u015f MB, Uysal F, Hardala\u00e7 F (2023b) Super resolution image acquisition for object detection in the military industry. In: 2023 5th International Congress on Human-Computer Interaction, Optimization and Robotic Applications (HORA).\u00a0IEEE, Istanbul, Turkey, pp 1\u20136","DOI":"10.1109\/HORA58378.2023.10156682"},{"key":"10792_CR36","doi-asserted-by":"crossref","unstructured":"Peker O, Uysal F, Hardala\u00e7 F (2022) Boost loss functions for better change detection. In:\u00a02022 3rd IEEE International Informatics and Software Engineering Conference (IISEC). IEEE, Ankara, Turkey, pp 1\u20134","DOI":"10.1109\/IISEC56263.2022.9998289"},{"issue":"9","key":"10792_CR37","doi-asserted-by":"publisher","first-page":"1035","DOI":"10.3390\/electronics10091035","volume":"10","author":"M Rivera-Acosta","year":"2021","unstructured":"Rivera-Acosta M et al (2021) Spelling correction real-time american sign language alphabet translation system based on yolo network and LSTM. Electronics 10(9):1035","journal-title":"Electronics"},{"key":"10792_CR38","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1016\/j.procs.2020.06.022","volume":"173","author":"A Sharma","year":"2020","unstructured":"Sharma A et al (2020) Hand gesture recognition using image processing and feature extraction techniques. Proc Comput Sci 173:181\u2013190","journal-title":"Proc Comput Sci"},{"issue":"22","key":"10792_CR39","doi-asserted-by":"publisher","first-page":"16917","DOI":"10.1007\/s00521-019-04023-0","volume":"32","author":"C Tan","year":"2020","unstructured":"Tan C, Sun Y, Li G, Jiang G, Chen D, Liu H (2020) Research on gesture recognition of smart data fusion features in the IoT. Neural Comput Appl 32(22):16917\u201316929","journal-title":"Neural Comput Appl"},{"issue":"10","key":"10792_CR40","doi-asserted-by":"publisher","first-page":"1772","DOI":"10.3390\/diagnostics13101772","volume":"13","author":"F Uysal","year":"2023","unstructured":"Uysal F (2023) Detection of monkeypox disease from human skin images with a hybrid deep learning model. Diagnostics 13(10):1772","journal-title":"Diagnostics"},{"issue":"1","key":"10792_CR41","first-page":"30","volume":"27","author":"F Uysal","year":"2022","unstructured":"Uysal F, Erkan M (2022) Multiclass classification of brain tumors with various deep learning models. Eng Proc 27(1):30","journal-title":"Eng Proc"},{"issue":"1","key":"10792_CR42","first-page":"8","volume":"31","author":"F Uysal","year":"2022","unstructured":"Uysal F, K\u00f6se MM (2022) Classification of breast cancer ultrasound images with deep learning-based models. Eng Proc 31(1):8","journal-title":"Eng Proc"},{"issue":"6","key":"10792_CR43","doi-asserted-by":"publisher","first-page":"2723","DOI":"10.3390\/app11062723","volume":"11","author":"F Uysal","year":"2021","unstructured":"Uysal F, Hardala\u00e7 F, Peker O, Tolunay T, Tokg\u00f6z N (2021) Classification of shoulder x-ray images with deep learning ensemble models. Appl Sci 11(6):2723","journal-title":"Appl Sci"},{"key":"10792_CR44","first-page":"1","volume":"1","author":"A Wadhawan","year":"2020","unstructured":"Wadhawan A, Kumar P (2020) Deep learning-based sign language recognition system for static signs. Neural Comput Appl 1:1\u20132","journal-title":"Neural Comput Appl"},{"issue":"23","key":"10792_CR45","doi-asserted-by":"publisher","first-page":"9107","DOI":"10.3390\/s22239107","volume":"22","author":"K Xia","year":"2022","unstructured":"Xia K et al (2022) A sign language recognition system applied to deaf-mute medical consultation. Sensors 22(23):9107","journal-title":"Sensors"}],"container-title":["Artificial Intelligence Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-024-10792-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10462-024-10792-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10462-024-10792-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,20]],"date-time":"2024-11-20T22:37:51Z","timestamp":1732142271000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10462-024-10792-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,1]]},"references-count":45,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["10792"],"URL":"https:\/\/doi.org\/10.1007\/s10462-024-10792-5","relation":{},"ISSN":["1573-7462"],"issn-type":[{"type":"electronic","value":"1573-7462"}],"subject":[],"published":{"date-parts":[[2024,6,1]]},"assertion":[{"value":"6 May 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 June 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}},{"value":"During the preparation of this work, the author(s) used QuillBot and Wordtune to improve language and readability. After using QuillBot and Wordtune, the authors reviewed and edited the content as needed and took full responsibility for the publication's content.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declaration of generative AI and AI-assisted technologies in the writing process"}}],"article-number":"162"}}