{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,25]],"date-time":"2026-09-25T05:13:14Z","timestamp":1790313194131,"version":"4.1.0"},"reference-count":49,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2022,7,11]],"date-time":"2022-07-11T00:00:00Z","timestamp":1657497600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Human beings usually rely on communication to express their feeling and ideas and to solve disputes among themselves. A major component required for effective communication is language. Language can occur in different forms, including written symbols, gestures, and vocalizations. It is usually essential for all of the communicating parties to be fully conversant with a common language. However, to date this has not been the case between speech-impaired people who use sign language and people who use spoken languages. A number of different studies have pointed out a significant gaps between these two groups which can limit the ease of communication. Therefore, this study aims to develop an efficient deep learning model that can be used to predict British sign language in an attempt to narrow this communication gap between speech-impaired and non-speech-impaired people in the community. Two models were developed in this research, CNN and LSTM, and their performance was evaluated using a multi-class confusion matrix. The CNN model emerged with the highest performance, attaining training and testing accuracies of 98.8% and 97.4%, respectively. In addition, the model achieved average weighted precession and recall of 97% and 96%, respectively. On the other hand, the LSTM model\u2019s performance was quite poor, with the maximum training and testing performance accuracies achieved being 49.4% and 48.7%, respectively. Our research concluded that the CNN model was the best for recognizing and determining British sign language.<\/jats:p>","DOI":"10.3390\/jimaging8070192","type":"journal-article","created":{"date-parts":[[2022,7,11]],"date-time":"2022-07-11T00:06:21Z","timestamp":1657497981000},"page":"192","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Sign and Human Action Detection Using Deep Learning"],"prefix":"10.3390","volume":"8","author":[{"given":"Shivanarayna","family":"Dhulipala","sequence":"first","affiliation":[{"name":"Department of Computing and Informatics, Bournemouth University, Talbot Campus Poole, Poole BH12 5BB, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3586-2570","authenticated-orcid":false,"given":"Festus Fatai","family":"Adedoyin","sequence":"additional","affiliation":[{"name":"Department of Computing and Informatics, Bournemouth University, Talbot Campus Poole, Poole BH12 5BB, UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0707-6131","authenticated-orcid":false,"given":"Alessandro","family":"Bruno","sequence":"additional","affiliation":[{"name":"Department of Biomedical Sciences, Humanitas University, Via Rita Levi Montalcini 4, Pieve Emanuele, 20072 Milan, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Chiarelli, B. (1991). The Origin of Human Language, Studies in Language Origins, Publisher John Benjamins.","DOI":"10.1075\/z.los2.05chi"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"46","DOI":"10.4066\/AMJ.2013.1596.","article-title":"Shared language: Towards more effective communication","volume":"6","author":"Thomas","year":"2013","journal-title":"Australas. Med. J."},{"key":"ref_3","unstructured":"Stephanidis, C. (2009). Sign Language Recognition, Generation, and Modelling: A Research Effort with Applications in Deaf Communication. UAHCI 2009: Universal Access in Human-Computer Interaction. Addressing Diversity, Springer."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.icte.2020.08.002","article-title":"Real-time Bhutanese Sign Language digits recognition system using Convolutional Neural Network. Science Direct","volume":"7","author":"Wangchuk","year":"2021","journal-title":"ICT Express"},{"key":"ref_5","first-page":"109","article-title":"(In)accessibility of the deaf to the television contents through sign language interpreting and sdh in turkey","volume":"9","year":"2018","journal-title":"Dokuz Eyl\u00fcL Univ. J. Humanit."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1177\/0008125619864925","article-title":"A Brief History of Artificial Intelligence: On the Past, Present, and Future of Artificial Intelligence","volume":"61","author":"Haenlein","year":"2019","journal-title":"Calif. Manag. Rev."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Ongsulee, P. (2017, January 22\u201324). Artificial intelligence, machine learning and deep learning. Proceedings of the 2017 15th International Conference on ICT and Knowledge Engineering, Bangkok, Thailand.","DOI":"10.1109\/ICTKE.2017.8259629"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1396","DOI":"10.1109\/TVCG.2020.3030418","article-title":"CNN Explainer: Learning Convolutional Neural Networks with Interactive Visualization","volume":"27","author":"Wang","year":"2021","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2358","DOI":"10.1016\/j.arth.2018.02.067","article-title":"Artificial intelligence, machine learning, deep learning, and cognitive computing: What do these terms mean and how will they impact health care?","volume":"33","author":"Bini","year":"2018","journal-title":"J. Arthroplast."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Sang-Ki, K., Chang, J.K., Hyedong, J., and Cho, C. (2019). Neural Sign Language Translation Based on Human Keypoint Estimation. Appl. Sci., 9.","DOI":"10.3390\/app9132683"},{"key":"ref_11","first-page":"E2","article-title":"A tutorial survey of architectures, algorithms, and applications for deep learning","volume":"3","author":"Deng","year":"2014","journal-title":"APSIPA Trans. Signal Inf. Process."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhou, T., Wang, W., Qi, S., Ling, H., and Shen, J. (2020, January 13\u201319). Cascaded Human-Object Interaction Recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00432"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zhou, T., Wang, W., Liu, S., Yang, Y., and Van Gool, L. (2021, January 20\u201325). Differentiable Multi-Granularity Human Representation Learning for Instance-Aware Human Semantic Parsing. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00167"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"14357","DOI":"10.1007\/s00521-021-06079-3","article-title":"Advances in machine translation for sign language: Approaches, limitations, and challenges","volume":"33","author":"Farooq","year":"2021","journal-title":"Neural Comput. Appl."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"115601","DOI":"10.1016\/j.eswa.2021.115601","article-title":"Applying deep neural networks for the automatic recognition of sign language words: A communication aid to deaf agriculturists","volume":"185","author":"Venugopalan","year":"2021","journal-title":"Sci. Direct. Expert Syst. Appl."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1016\/j.procs.2018.10.435","article-title":"Real Time Conversion of Sign Language to Speech and Prediction of gestures Using Artificial Neural Network","volume":"143","author":"Abraham","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Narayan, S., and Sajjan, V.S. (2021, January 25\u201327). Sign Language Recognition Using Deep Learning. Proceedings of the 2021 International Conference on Intelligent Technologies (CONIT), Karnataka, India.","DOI":"10.1109\/CONIT51480.2021.9498310"},{"key":"ref_18","unstructured":"Kang, E. (2019, December 10). Long Short-Term Memory (LSTM): Concept. Available online: https:\/\/medium.com\/@kangeugine\/long-short-term-memory-lstm-concept-cb3283934359."},{"key":"ref_19","first-page":"93","article-title":"Classification of Finger Spelling American Sign Language Using Convolutional Neural Network","volume":"10","author":"Marjusalinah","year":"2021","journal-title":"Comput. Eng. Appl. J."},{"key":"ref_20","unstructured":"Olga, B. (2021, November 24). A Review of Kaggle As a Data Science Resource\u20142021 Update. Available online: https:\/\/www.pathrise.com\/guides\/a-review-of-kaggle-as-a-data-science-resource\/."},{"key":"ref_21","first-page":"1121","article-title":"ATLASLang NMT: Arabic text language into Arabic sign language neural machine translation","volume":"33","author":"Brour","year":"2021","journal-title":"J. King Saud-Univ.-Comput. Inf. Sci."},{"key":"ref_22","unstructured":"Albert Florea, G., and Weilid, F. (2022, April 15). Deep Learning Models for Human Activity Recognition (Dissertation, Malm\u00f6 Universitet\/Teknik och Samh\u00e4lle). Available online: http:\/\/urn.kb.se\/resolve?urn=urn:nbn:se:mau:diva-20201."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"e1254","DOI":"10.1002\/widm.1254","article-title":"Recent trends in machine learning for human activity recognition\u2014A survey","volume":"8","author":"Roy","year":"2018","journal-title":"Wiley Interdiscip. Rev. Data Min. Knowl. Discov."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/j.neucom.2020.12.006","article-title":"RNN-Transducer based Chinese Sign Language Recognition","volume":"434","author":"Gao","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"107395","DOI":"10.1016\/j.compeleceng.2021.107395","article-title":"Intelligent real-time Arabic sign language classification using attention-based inception and BiLSTM","volume":"95","author":"Abdul","year":"2021","journal-title":"Comput. Electr. Eng."},{"key":"ref_26","first-page":"431","article-title":"A comparative study of an assistive e-learning interface among students with and without visual and hearing impairments","volume":"17","author":"Farhan","year":"2020","journal-title":"Disability and Rehabilitation: Assistive Technology"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"200032","DOI":"10.1016\/j.gvc.2021.200032","article-title":"A comprehensive evaluation of deep models and optimizers for Indian sign language recognition","volume":"5","author":"Sharma","year":"2021","journal-title":"Graph. Vis. Comput."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1007\/s10055-016-0301-0","article-title":"Hand posture and gesture recognition techniques for virtual reality applications: A survey","volume":"21","author":"Sagayam","year":"2017","journal-title":"Virtual Real."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"115657","DOI":"10.1016\/j.eswa.2021.115657","article-title":"Vision-based hand gesture recognition using deep learning for the interpretation of sign language","volume":"182","author":"Sharma","year":"2021","journal-title":"Expert Syst. Appl."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Rajam, P.S., and Balakrishnan, G. (2011, January 25\u201328). Real time Indian Sign Language Recognition System to aid deaf-dumb people. Proceedings of the 2011 IEEE 13th International Conference on Communication Technology, Jinan, China.","DOI":"10.1109\/ICCT.2011.6157974"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Liang, R.-H., and Ouhyoung, M.I. (1996, January 1\u20134). A Sign Language Recognition System Using Hidden Markov Model and Context Sensitive Search. Proceedings of the ACM Symposium on Virtual Reality Software and Technology, Hong Kong, China.","DOI":"10.1145\/3304181.3304194"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Agapito, L., Bronstein, M., and Rother, C. (2015). Sign Language Recognition Using Convolutional Neural Networks. ECCV 2014: Computer Vision\u2014ECCV 2014 Workshops, Springer.","DOI":"10.1007\/978-3-319-16220-1"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"108037","DOI":"10.1016\/j.dib.2022.108037","article-title":"Updating thermal imaging dataset of hand gestures with unique labels","volume":"42","author":"Yeduri","year":"2022","journal-title":"Data Brief"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"26602","DOI":"10.1109\/JSEN.2021.3119977","article-title":"Robust Hand Gestures Recognition Using a Deep CNN and Thermal Images","volume":"21","author":"Breland","year":"2021","journal-title":"IEEE Sens. J."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"96926","DOI":"10.1109\/ACCESS.2019.2929174","article-title":"Technical approaches to Chinese sign language processing: A review","volume":"7","author":"Kamal","year":"2019","journal-title":"IEEE Access"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2389","DOI":"10.1016\/S0031-3203(04)00165-7","article-title":"A Chinese sign language recognition system based on SOFM\/SRN\/HMM","volume":"37","author":"Gao","year":"2004","journal-title":"Pattern Recognit."},{"key":"ref_37","unstructured":"Koushik, J. (2016). Understanding convolutional neural networks. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"35","DOI":"10.5573\/IEIESPC.2015.4.1.035","article-title":"Deep convolution neural networks in computer vision: A review","volume":"4","author":"Yoo","year":"2015","journal-title":"IEIE Trans. Smart Process. Comput."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"377","DOI":"10.1016\/j.procs.2018.05.198","article-title":"An analysis of convolutional neural networks for image classification","volume":"132","author":"Sharma","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Balas, V., Kumar, R., and Srivastava, R. (2020). Fundamental Concepts of Convolutional Neural Network. Recent Trends and Advances in Artificial Intelligence and Internet of Things, Springer. Intelligent Systems Reference Library.","DOI":"10.1007\/978-3-030-32644-9"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Albawi, S., Mohammed, T.A., and Al-Zawi, S. (2017, January 21\u201323). Understanding of a convolutional neural network. Proceedings of the 2017 International Conference on Engineering and Technology (ICET), Antalya, Turkey.","DOI":"10.1109\/ICEngTechnol.2017.8308186"},{"key":"ref_42","unstructured":"Viswavarapu, L.K. (2018). Real-Time Finger Spelling American Sign Language Recognition Using Deep Convolutional Neural Networks. [Master\u2019s Thesis, University of North Texas Libraries, UNT Digital Library]. Available online: https:\/\/digital.library.unt.edu\/ark:\/67531\/metadc1404616\/."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1038\/s41377-021-00512-x","article-title":"Dynamical machine learning volumetric reconstruction of objects\u2019 interiors from limited angular views","volume":"10","author":"Kang","year":"2021","journal-title":"Light. Sci. Appl."},{"key":"ref_44","unstructured":"(2022, April 15). British Sign Language. Available online: https:\/\/www.british-sign.co.uk\/."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"5412","DOI":"10.1109\/TII.2021.3132340","article-title":"Attention-Inception and Long- Short-Term Memory-Based Electroencephalography Classification for Motor Imagery Tasks in Rehabilitation","volume":"18","author":"Amin","year":"2022","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_46","unstructured":"(2021, November 24). Kaggle 2021. Available online: https:\/\/www.kaggle.com\/."},{"key":"ref_47","unstructured":"Luo, W., Li, Y., Urtasun, R., and Zemel, R. (2016, January 5\u201310). Understanding the effective receptive field in deep convolutional neural networks. Proceedings of the 29th Conference on Neural Information Processing System, Barcelona, Spain."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Chandra, B., and Sharma, R.K. (2017, January 14\u201319). On improving recurrent neural network for image classification. Proceedings of the 2017 International Joint Conference on Neural Networks (IJCNN), Anchorage, AK, USA.","DOI":"10.1109\/IJCNN.2017.7966083"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"30743","DOI":"10.1007\/s11042-020-10165-4","article-title":"LSTM and multiple CNNs based event image classification","volume":"80","author":"Li","year":"2021","journal-title":"Multimed. Tools Appl."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/8\/7\/192\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:47:45Z","timestamp":1760140065000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/8\/7\/192"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,11]]},"references-count":49,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["jimaging8070192"],"URL":"https:\/\/doi.org\/10.3390\/jimaging8070192","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,11]]}}}