{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,24]],"date-time":"2026-02-24T16:30:58Z","timestamp":1771950658654,"version":"3.50.1"},"reference-count":50,"publisher":"Springer Science and Business Media LLC","issue":"14","license":[{"start":{"date-parts":[[2024,2,15]],"date-time":"2024-02-15T00:00:00Z","timestamp":1707955200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,15]],"date-time":"2024-02-15T00:00:00Z","timestamp":1707955200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Igd\u0131r University"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Neural Comput &amp; Applic"],"published-print":{"date-parts":[[2024,5]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This study focuses on real-time hand gesture recognition in the Turkish sign language detection system. YOLOv4-CSP based on convolutional neural network (CNN), a state-of-the-art object detection algorithm, is used to provide real-time and high-performance detection. The YOLOv4-CSP algorithm is created by adding CSPNet to the neck of the original YOLOv4 to improve network performance. A new object detection model has been proposed by optimizing the YOLOv4-CSP algorithm in order to provide more efficient detection in Turkish sign language. The model uses CSPNet throughout the network to increase the learning ability of the network. However, Proposed YOLOv4-CSP has a learning model with Mish activation function, complete intersection of union (CIoU) loss function and transformer block added. The Proposed YOLOv4-CSP algorithm has faster learning with transfer learning than previous versions. This allows the proposed YOLOv4-CSP algorithm to perform a faster restriction and recognition of static hand signals simultaneously. To evaluate the speed and detection performance of the proposed YOLOv4-CSP model, it is compared with previous YOLO series, which offers real-time detection, as well. YOLOv3, YOLOv3-SPP, YOLOv4-CSP and proposed YOLOv4-CSP models are trained with a labeled dataset consisting of numbers in Turkish Sign language, and their performances on the hand signals recognitions are compared. With the proposed method, 98.95% precision, 98.15% recall, 98.55 F1 score and 99.49% mAP results are obtained in 9.8\u00a0ms. The proposed method for detecting numbers in Turkish sign language outperforms other algorithms with both real-time performance and accurate hand sign prediction, regardless of background.<\/jats:p>","DOI":"10.1007\/s00521-024-09503-6","type":"journal-article","created":{"date-parts":[[2024,2,15]],"date-time":"2024-02-15T07:02:39Z","timestamp":1707980559000},"page":"7609-7624","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":48,"title":["Real-time sign language recognition based on YOLO algorithm"],"prefix":"10.1007","volume":"36","author":[{"given":"Melek","family":"Alaftekin","sequence":"first","affiliation":[]},{"given":"Ishak","family":"Pacal","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5686-6872","authenticated-orcid":false,"given":"Kenan","family":"Cicek","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,2,15]]},"reference":[{"key":"9503_CR1","doi-asserted-by":"publisher","first-page":"7205","DOI":"10.1007\/s12652-020-02396-y","volume":"12","author":"R Elakkiya","year":"2021","unstructured":"Elakkiya R (2021) Machine learning based sign language recognition: a review and its research frontier. J Ambient Intell Humaniz Comput 12:7205\u20137224","journal-title":"J Ambient Intell Humaniz Comput"},{"key":"9503_CR2","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1016\/j.procs.2015.12.276","volume":"76","author":"AZ Shukor","year":"2015","unstructured":"Shukor AZ, Miskon MF, Jamaluddin MH, Bin Ali F, Asyraf MF, Bin Bahar MB (2015) A new data glove approach for Malaysian sign language detection. Proc Comput Sci 76:60\u201367","journal-title":"Proc Comput Sci"},{"issue":"5","key":"9503_CR3","doi-asserted-by":"publisher","first-page":"1110","DOI":"10.1109\/TMM.2013.2246148","volume":"15","author":"Z Ren","year":"2013","unstructured":"Ren Z, Yuan J, Meng J, Zhang Z (2013) Robust part-based hand gesture recognition using Kinect. IEEE Trans Multimed 15(5):1110\u20131120","journal-title":"IEEE Trans Multimed"},{"key":"9503_CR4","doi-asserted-by":"crossref","unstructured":"Naglot D, Kulkarni M (2016) Real time sign language recognition using the leap motion controller. In: International conference on inventive computation technologies (ICICT)","DOI":"10.1109\/INVENTIVE.2016.7830097"},{"issue":"6","key":"9503_CR5","doi-asserted-by":"publisher","first-page":"7259","DOI":"10.1016\/j.eswa.2014.05.024","volume":"14","author":"SGM Almeida","year":"2014","unstructured":"Almeida SGM, Guimar\u00e3es FG, Ram\u00edrez JA (2014) Feature extraction in Brazilian sign language recognition based on phonological structure and using RGB-D sensors. Expert Syst Appl Int J 14(6):7259\u20137271","journal-title":"Expert Syst Appl Int J"},{"key":"9503_CR6","doi-asserted-by":"publisher","DOI":"10.1016\/j.measurement.2020.108471","volume":"168","author":"SA Khomami","year":"2021","unstructured":"Khomami SA, Shamekhi S (2021) Persian sign language recognition using IMU and surface EMG sensors. Measurement 168:108471","journal-title":"Measurement"},{"issue":"20","key":"9503_CR7","doi-asserted-by":"publisher","first-page":"5807","DOI":"10.3390\/s20205807","volume":"20","author":"S Tateno","year":"2020","unstructured":"Tateno S, Liu H, Ou J (2020) Development of sign language motion recognition system for hearing-impaired people using electromyography signal. Sensors 20(20):5807","journal-title":"Sensors"},{"key":"9503_CR8","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2020.113794","volume":"164","author":"R Rastgoo","year":"2021","unstructured":"Rastgoo R, Kiania K, Escalerab S (2021) Sign language recognition: a deep survey. Expert Syst Appl 164:113794","journal-title":"Expert Syst Appl"},{"key":"9503_CR9","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1016\/j.neucom.2015.09.116","volume":"187","author":"Y Guo","year":"2016","unstructured":"Guo Y, Liu Y, Oerlemans A, Lao S, Wu S, Lew MS (2016) Deep learning for visual understanding: a review. Neurocomputing 187:27\u201348","journal-title":"Neurocomputing"},{"issue":"2","key":"9503_CR10","first-page":"760","volume":"13","author":"I Pacal","year":"2023","unstructured":"Pacal I, Alaftekin M (2023) T\u00fcrk \u0130\u015faret Dilinin S\u0131n\u0131fland\u0131r\u0131lmas\u0131 i\u00e7in Derin \u00d6\u011frenme Yakla\u015f\u0131mlar\u0131. J Inst Sci Technol 13(2):760\u2013777","journal-title":"J Inst Sci Technol"},{"key":"9503_CR11","doi-asserted-by":"crossref","unstructured":"Nimisha K, Jacob A (2020) A brief review of the recent trends in sign language recognition. In: In 2020 international conference on communication and signal processing (ICCSP)","DOI":"10.1109\/ICCSP48568.2020.9182351"},{"key":"9503_CR12","doi-asserted-by":"publisher","first-page":"4164","DOI":"10.3390\/app11094164","volume":"11","author":"A Mujahid","year":"2021","unstructured":"Mujahid A, Awan MJ, Yasin A, Mohammed MA, Dama\u0161evi\u010dius R, Maskeli\u016bnas R, Abdulkareem KH (2021) Real-time hand gesture recognition based on deep learning YOLOv3 model. Appl Sci 11:4164","journal-title":"Appl Sci"},{"key":"9503_CR13","doi-asserted-by":"publisher","first-page":"1380","DOI":"10.1007\/s11042-023-14646-0","volume":"82","author":"Y Liu","year":"2023","unstructured":"Liu Y, Nand P, Hossain MA, Nguyen M, Yan WQ (2023) Sign language recognition from digital videos using feature pyramid network with detection transformer. Multimed Tools Appl 82:1380\u20137501","journal-title":"Multimed Tools Appl"},{"key":"9503_CR14","doi-asserted-by":"publisher","first-page":"3729","DOI":"10.3390\/math11173729","volume":"11","author":"AM Buttar","year":"2023","unstructured":"Buttar AM, Ahmad U, Gumaei AH, Assiri A, Akbar MA, Alkhamees BF (2023) Deep learning in sign language recognition: a hybrid approach for the recognition of static and dynamic signs. Mathematics 11:3729","journal-title":"Mathematics"},{"key":"9503_CR15","doi-asserted-by":"publisher","first-page":"34793","DOI":"10.1007\/s11042-023-15062-0","volume":"82","author":"AR Rashtehroudi","year":"2023","unstructured":"Rashtehroudi AR, Akoushideh A, Shahbahrami A (2023) PESTD: a large-scale Persian-English scene text dataset. Multimed Tools Appl 82:34793\u201334808","journal-title":"Multimed Tools Appl"},{"key":"9503_CR16","doi-asserted-by":"publisher","first-page":"2721","DOI":"10.1007\/s11760-023-02489-z","volume":"17","author":"S Sun","year":"2023","unstructured":"Sun S, Han L, Wei J, Hao H, Huang J, Xin W, Zhou X, Kang P (2023) ShuffleNetv2-YOLOv3: a real-time recognition method of static sign language based on a lightweight network. SIViP 17:2721\u20132729","journal-title":"SIViP"},{"key":"9503_CR17","doi-asserted-by":"publisher","first-page":"4964","DOI":"10.1109\/JSEN.2022.3204641","volume":"23","author":"S Wang","year":"2023","unstructured":"Wang S, Guo C, Yang R, Zhang Q, Ren H (2023) A lightweight vision-based measurement for hand gesture information acquisition. IEEE Sens J 23:4964\u20134973","journal-title":"IEEE Sens J"},{"key":"9503_CR18","doi-asserted-by":"crossref","unstructured":"Wang C-Y, Bochkovskiy A, Liao H-YM (2021) Scaled-YOLOv4: scaling cross stage partial network. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (CVPR)","DOI":"10.1109\/CVPR46437.2021.01283"},{"issue":"9","key":"9503_CR19","doi-asserted-by":"publisher","first-page":"1904","DOI":"10.1109\/TPAMI.2015.2389824","volume":"37","author":"K He","year":"2015","unstructured":"He K, Zhang X, Ren S, Sun J (2015) Spatial pyramid pooling in deep convolutional networks for visual recognition. IEEE Trans Pattern Anal Mach Intell 37(9):1904\u20131916","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"9503_CR20","doi-asserted-by":"crossref","unstructured":"Girshick R (2015) Fast R-CNN. In: Proceedings of the IEEE international conference on computer vision","DOI":"10.1109\/ICCV.2015.169"},{"key":"9503_CR21","doi-asserted-by":"crossref","unstructured":"Ren S, He K, Girshick R, Sun J (2017) Faster R-CNN: towards real-time object detection with region proposal networks. In: IEEE transactions on pattern analysis and machine intelligence, vol 36, no 6","DOI":"10.1109\/TPAMI.2016.2577031"},{"key":"9503_CR22","doi-asserted-by":"crossref","unstructured":"Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: IEEE conference on computer vision and pattern recognition (CVPR)","DOI":"10.1109\/CVPR.2016.91"},{"key":"9503_CR23","doi-asserted-by":"crossref","unstructured":"Redmon J, Farhadi A (2017) YOLO9000: better, faster, stronger. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI","DOI":"10.1109\/CVPR.2017.690"},{"key":"9503_CR24","unstructured":"Redmon J, Farhadi A (2018) YOLOv3: an incremental improvement. http:\/\/arxiv.org\/abs\/1804.02767"},{"key":"9503_CR25","unstructured":"Bochkovskiy A, Wang C-Y, Liao H-YM (2020) YOLOv4: optimal speed and accuracy of object detection. http:\/\/arxiv.org\/abs\/2004.10934"},{"key":"9503_CR26","doi-asserted-by":"crossref","unstructured":"Wang C-Y, Liao H-YM, Yeh I-H, Wu Y-H, Chen P-Y, Hsieh J-W (2020) CSPNet: a new backbone that can enhance learning capability of CNN. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition (CVPR)","DOI":"10.1109\/CVPRW50498.2020.00203"},{"key":"9503_CR27","unstructured":"Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: Proceedings of the 32nd international conference on machine learning"},{"key":"9503_CR28","unstructured":"Xu B, Wang N, Chen T, Li M (2015) Empirical evaluation of rectified activations in convolutional network"},{"key":"9503_CR29","unstructured":"Misra D (2019) Mish: a self regularized non-monotonic activation function. https:\/\/arxiv.org\/abs\/1908.08681."},{"key":"9503_CR30","doi-asserted-by":"crossref","unstructured":"Tan M, Pang R, Le QV (2020) EfficientDet: scalable and efficient object detection. In: 2020 IEEE\/CVF conference on computer vision and pattern recognition (CVPR)","DOI":"10.1109\/CVPR42600.2020.01079"},{"key":"9503_CR31","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 2016 IEEE conference on computer vision and pattern recognition (CVPR)","DOI":"10.1109\/CVPR.2016.90"},{"key":"9503_CR32","doi-asserted-by":"crossref","unstructured":"Xie S, Girshick R, Doll\u00e1r P, Tu Z, He K (2017) Aggregated residual transformations for deep neural networks. In: IEEE conference on computer vision and pattern recognition (CVPR)","DOI":"10.1109\/CVPR.2017.634"},{"key":"9503_CR33","unstructured":"Redmon J (2013) Darknet: open source neural networks in c. https:\/\/pjreddie.com\/darknet\/."},{"key":"9503_CR34","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2021.105031","volume":"141","author":"I Pacal","year":"2022","unstructured":"Pacal I, Karaman A, Karaboga D, Akay B, Basturk A, Nalbantoglu U, Coskun S (2022) An efficient real-time colonic polyp detection with YOLO algorithms trained by using negative samples and large datasets. Comput Biol Med 141:105031","journal-title":"Comput Biol Med"},{"key":"9503_CR35","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser \u0141, Polosukhin I (2017) Attention is all you need. In: The 31st international conference on neural information processing systems"},{"issue":"1","key":"9503_CR36","first-page":"1483","volume":"73","author":"S Elbedwehy","year":"2022","unstructured":"Elbedwehy S, Medhat T, Hamza AMF (2022) Efficient image captioning based on vision transformer models. Comput. Mater. Contin. 73(1):1483\u20131500","journal-title":"Comput. Mater. Contin."},{"key":"9503_CR37","unstructured":"Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Dehghani M, Minderer M (2021) An image is worth 16x16 words: Transformers for image recognition at scale In: 9. International conference on learning representations"},{"key":"9503_CR38","doi-asserted-by":"crossref","unstructured":"Liu S, Qi L, Qin H, Shi J, Jia J (2018) Path aggregation network for instance segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition","DOI":"10.1109\/CVPR.2018.00913"},{"key":"9503_CR39","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.neunet.2017.12.012","volume":"107","author":"S Elfwing","year":"2018","unstructured":"Elfwing S, Uchibe E, Doya K (2018) Sigmoid-weighted linear units for neural network function approximation in reinforcement learning. Neural Netw 107:3\u201311","journal-title":"Neural Netw"},{"key":"9503_CR40","doi-asserted-by":"crossref","unstructured":"Gustineli M (2022) A survey on recently proposed activation functions for deep learning. ArXiv abs\/2204.02921","DOI":"10.31224\/2245"},{"key":"9503_CR41","doi-asserted-by":"crossref","unstructured":"Zheng Z, Wang P, Liu W, Li J, Ye R, Ren D (2020) Distance-IoU loss: faster and better learning for bounding box regression. In: Proceedings of the AAAI conference on artificial intelligence","DOI":"10.1609\/aaai.v34i07.6999"},{"key":"9503_CR42","unstructured":"Kingma DP, Ba J (2015) Adam: a method for stochastic optimization. In: 3. International conference on learning representations (ICLR)"},{"issue":"7","key":"9503_CR43","first-page":"22","volume":"5","author":"M Khari","year":"2019","unstructured":"Khari M, Garg AK, Crespo RG, Verd\u00fa E (2019) Gesture recognition of RGB and RGB-D static images using convolutional neural networks. Int J Interact Multimed Artif Intell 5(7):22\u201327","journal-title":"Int J Interact Multimed Artif Intell"},{"issue":"9","key":"9503_CR44","doi-asserted-by":"publisher","first-page":"1035","DOI":"10.3390\/electronics10091035","volume":"10","author":"M Rivera-Acosta","year":"2021","unstructured":"Rivera-Acosta M, Ruiz-Varela JM, Cisneros SO, Dominguez JR (2021) Spelling correction real-time American sign language alphabet translation system based on YOLO network and LSTM. Electronics 10(9):1035","journal-title":"Electronics"},{"issue":"2","key":"9503_CR45","first-page":"1","volume":"69","author":"J Gangrade","year":"2020","unstructured":"Gangrade J, Bharti J (2020) Vision-based hand gesture recognition for indian sign language using convolution neural network. IETE J Res 69(2):1\u201310","journal-title":"IETE J Res"},{"key":"9503_CR46","doi-asserted-by":"publisher","first-page":"181340","DOI":"10.1109\/ACCESS.2020.3028072","volume":"8","author":"OM Sincan","year":"2020","unstructured":"Sincan OM, Keles HY (2020) AUTSL: a large scale multi-modal turkish sign language dataset and baseline methods. IEEE Access 8:181340\u2013181355","journal-title":"IEEE Access"},{"issue":"1","key":"9503_CR47","first-page":"527","volume":"36","author":"T \u00d6zcan","year":"2021","unstructured":"\u00d6zcan T, Ba\u015ft\u00fcrk A (2021) ERUSLR: a new Turkish sign language dataset and its recognition using hyperparameter. J Fac Eng Archit Gazi Univ 36(1):527\u2013542","journal-title":"J Fac Eng Archit Gazi Univ"},{"issue":"2","key":"9503_CR48","first-page":"2755","volume":"71","author":"R Khan","year":"2022","unstructured":"Khan R, Wong WS, Ullah I, Algarni F, Haq MIU, Barawi MHB, Khan MA (2022) Evaluating the efficiency of CBAM-resnet using Malaysian sign language. Comput Mater Contin 71(2):2755\u20132772","journal-title":"Comput Mater Contin"},{"key":"9503_CR49","doi-asserted-by":"publisher","DOI":"10.1155\/2022\/3247781","author":"Y Huang","year":"2022","unstructured":"Huang Y, Huang J, Wu X, Jia Y (2022) Dynamic sign language recognition based on CBAM with autoencoder time series neural network. Mob Inform Syst. https:\/\/doi.org\/10.1155\/2022\/3247781","journal-title":"Mob Inform Syst"},{"key":"9503_CR50","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2021.104519","volume":"134","author":"I Pacal","year":"2021","unstructured":"Pacal I, Karaboga D (2021) A robust real-time deep learning based automatic polyp detection system. Comput Biol Med 134:104519","journal-title":"Comput Biol Med"}],"container-title":["Neural Computing and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-024-09503-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00521-024-09503-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-024-09503-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,13]],"date-time":"2024-04-13T20:10:20Z","timestamp":1713039020000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00521-024-09503-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,15]]},"references-count":50,"journal-issue":{"issue":"14","published-print":{"date-parts":[[2024,5]]}},"alternative-id":["9503"],"URL":"https:\/\/doi.org\/10.1007\/s00521-024-09503-6","relation":{},"ISSN":["0941-0643","1433-3058"],"issn-type":[{"value":"0941-0643","type":"print"},{"value":"1433-3058","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,15]]},"assertion":[{"value":"7 March 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 January 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 February 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"We have no conflicts of interest to declare.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}