{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,7]],"date-time":"2026-08-07T15:22:41Z","timestamp":1786116161381,"version":"3.56.0"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"12","license":[{"start":{"date-parts":[[2024,9,20]],"date-time":"2024-09-20T00:00:00Z","timestamp":1726790400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,9,20]],"date-time":"2024-09-20T00:00:00Z","timestamp":1726790400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100012704","name":"University of Agder","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100012704","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Ambient Intell Human Comput"],"published-print":{"date-parts":[[2024,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Hand gesture recognition has gained a lot of attention in computer vision due to multiple applications. Further, most of the existing works utilized RGB data for hand gesture recognition. However, RGB cameras mainly depend on lighting, angles, and other factors including skin color which impacts the accuracy. Thus, we propose a methodology for video hand gesture recognition using thermal data in this work. Initially, we created a dataset of short video sequences captured from a thermal camera. Thereafter, a lightweight convolutional neural network model (CNN) is proposed for hand gesture recognition. Further, the performance of the proposed CNN model is evaluated on different sizes of the dataset consisting of 15, 10, and 5 frames per sequence. Results show that the proposed model achieves an accuracy of <jats:inline-formula><jats:tex-math>$$97\\% \\pm (0.05)$$<\/jats:tex-math><\/jats:inline-formula>, <jats:inline-formula><jats:tex-math>$$96\\% \\pm (0.05)$$<\/jats:tex-math><\/jats:inline-formula>, and <jats:inline-formula><jats:tex-math>$$87\\% \\pm (0.1)$$<\/jats:tex-math><\/jats:inline-formula> on the dataset consisting of 15, 10, and 5 frames per sequence, respectively.<\/jats:p>","DOI":"10.1007\/s12652-024-04851-6","type":"journal-article","created":{"date-parts":[[2024,9,23]],"date-time":"2024-09-23T08:02:25Z","timestamp":1727078545000},"page":"3849-3860","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Thermal video-based hand gestures recognition using lightweight CNN"],"prefix":"10.1007","volume":"15","author":[{"given":"Simen","family":"Birkeland","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lin Julie","family":"Fjeldvik","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nadia","family":"Noori","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sreenivasa Reddy","family":"Yeduri","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1023-2118","authenticated-orcid":false,"given":"Linga Reddy","family":"Cenkeramaddi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,9,20]]},"reference":[{"key":"4851_CR1","doi-asserted-by":"publisher","first-page":"149266","DOI":"10.1109\/ACCESS.2021.3124931","volume":"9","author":"MA Al-Asadi","year":"2021","unstructured":"Al-Asadi MA, Tasdem\u00edr S (2021) Empirical comparisons for combining balancing and feature selection strategies for characterizing football players using fifa video game system. IEEE Access 9:149266\u2013149286. https:\/\/doi.org\/10.1109\/ACCESS.2021.3124931","journal-title":"IEEE Access"},{"key":"4851_CR2","doi-asserted-by":"publisher","first-page":"22631","DOI":"10.1109\/ACCESS.2022.3154767","volume":"10","author":"MA Al-Asadi","year":"2022","unstructured":"Al-Asadi MA, Tasdem\u0131r S (2022) Predict the value of football players using fifa video game data and machine learning techniques. IEEE Access 10:22631\u201322645. https:\/\/doi.org\/10.1109\/ACCESS.2022.3154767","journal-title":"IEEE Access"},{"key":"4851_CR3","doi-asserted-by":"crossref","unstructured":"Ballow JM, Dey S (2022) Real-time hand gesture identification in thermal images. In: International conference on image analysis and processing. Springer, pp 491\u2013502","DOI":"10.1007\/978-3-031-06430-2_41"},{"issue":"23","key":"4851_CR4","doi-asserted-by":"publisher","first-page":"26602","DOI":"10.1109\/JSEN.2021.3119977","volume":"21","author":"DS Breland","year":"2021","unstructured":"Breland DS, Dayal A, Jha A, Yalavarthy PK, Pandey OJ, Cenkeramaddi LR (2021a) Robust hand gestures recognition using a deep cnn and thermal images. IEEE Sens J 21(23):26602\u201326614. https:\/\/doi.org\/10.1109\/JSEN.2021.3119977","journal-title":"IEEE Sens J"},{"issue":"9","key":"4851_CR5","doi-asserted-by":"publisher","first-page":"10445","DOI":"10.1109\/JSEN.2021.3061608","volume":"21","author":"DS Breland","year":"2021","unstructured":"Breland DS, Skriubakken SB, Dayal A, Jha A, Yalavarthy PK, Cenkeramaddi LR (2021b) Deep learning-based sign language digits recognition from thermal images with edge computing system. IEEE Sens J 21(9):10445\u201310453. https:\/\/doi.org\/10.1109\/JSEN.2021.3061608","journal-title":"IEEE Sens J"},{"key":"4851_CR6","doi-asserted-by":"publisher","first-page":"160025","DOI":"10.1109\/ACCESS.2020.3020141","volume":"8","author":"X Bu","year":"2020","unstructured":"Bu X (2020) Human motion gesture recognition algorithm in video based on convolutional neural features of training images. IEEE Access 8:160025\u2013160039. https:\/\/doi.org\/10.1109\/ACCESS.2020.3020141","journal-title":"IEEE Access"},{"issue":"13","key":"4851_CR7","doi-asserted-by":"publisher","first-page":"5429","DOI":"10.1109\/JSEN.2018.2834968","volume":"18","author":"K Czuszy\u0144ski","year":"2018","unstructured":"Czuszy\u0144ski K, Rumi\u0144ski J, Kwa\u015bniewska A (2018) Gesture recognition with the linear optical sensor and recurrent neural networks. IEEE Sens J 18(13):5429\u20135438. https:\/\/doi.org\/10.1109\/JSEN.2018.2834968","journal-title":"IEEE Sens J"},{"issue":"23","key":"4851_CR8","doi-asserted-by":"publisher","first-page":"15537","DOI":"10.1007\/s11042-015-2505-9","volume":"75","author":"J Ding","year":"2016","unstructured":"Ding J, Chang CW (2016) An adaptive hidden Markov model-based gesture recognition approach using kinect to simplify large-scale video data processing for humanoid robot imitation. Multimed Tools Appl 75(23):15537\u201315551","journal-title":"Multimed Tools Appl"},{"issue":"9","key":"4851_CR9","doi-asserted-by":"publisher","first-page":"12035","DOI":"10.1007\/s12652-022-03753-9","volume":"14","author":"AK Dubey","year":"2023","unstructured":"Dubey AK (2023) Enhanced hand-gesture recognition by improved beetle swarm optimized probabilistic neural network for human-computer interaction. J Ambient Intell Humaniz Comput 14(9):12035\u201312048","journal-title":"J Ambient Intell Humaniz Comput"},{"issue":"7","key":"4851_CR10","doi-asserted-by":"publisher","first-page":"7205","DOI":"10.1007\/s12652-020-02396-y","volume":"12","author":"R Elakkiya","year":"2021","unstructured":"Elakkiya R (2021) Retracted article: machine learning based sign language recognition: a review and its research frontier. J Ambient Intell Humaniz Comput 12(7):7205\u20137224","journal-title":"J Ambient Intell Humaniz Comput"},{"key":"4851_CR11","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2019.112829","volume":"139","author":"A Elboushaki","year":"2020","unstructured":"Elboushaki A, Hannane R, Afdel K, Koutti L (2020) Multid-cnn: a multi-dimensional feature learning approach based on deep convolutional networks for gesture recognition in rgb-d image sequences. Expert Syst Appl 139:112829","journal-title":"Expert Syst Appl"},{"issue":"23","key":"4851_CR12","doi-asserted-by":"publisher","first-page":"27026","DOI":"10.1109\/JSEN.2021.3123443","volume":"21","author":"D Fan","year":"2021","unstructured":"Fan D, Lu H, Xu S, Cao S (2021) Multi-task and multi-modal learning for rgb dynamic gesture recognition. IEEE Sens J 21(23):27026\u201327036. https:\/\/doi.org\/10.1109\/JSEN.2021.3123443","journal-title":"IEEE Sens J"},{"key":"4851_CR13","unstructured":"Flir T (2023) Lwir micro thermal camera module lepton.https:\/\/www.flir.com\/products\/lepton\/. Accessed 23 Mar 2023"},{"issue":"18","key":"4851_CR14","doi-asserted-by":"publisher","first-page":"17421","DOI":"10.1109\/JSEN.2021.3059685","volume":"22","author":"Q Gao","year":"2022","unstructured":"Gao Q, Chen Y, Ju Z, Liang Y (2022) Dynamic hand gesture recognition based on 3d hand pose estimation for human\u2013robot interaction. IEEE Sens J 22(18):17421\u201317430. https:\/\/doi.org\/10.1109\/JSEN.2021.3059685","journal-title":"IEEE Sens J"},{"issue":"3","key":"4851_CR15","doi-asserted-by":"publisher","first-page":"2601","DOI":"10.1007\/s12652-022-04506-4","volume":"14","author":"K Gupta","year":"2023","unstructured":"Gupta K, Singh A, Yeduri SR, Srinivas M, Cenkeramaddi LR (2023) Hand gestures recognition using edge computing system based on vision transformer and lightweight cnn. J Ambient Intell Humaniz Comput 14(3):2601\u20132615","journal-title":"J Ambient Intell Humaniz Comput"},{"issue":"15","key":"4851_CR16","doi-asserted-by":"publisher","first-page":"1701","DOI":"10.1016\/j.patrec.2004.06.016","volume":"25","author":"H Kang","year":"2004","unstructured":"Kang H, Woo Lee C, Jung K (2004) Recognition-based gesture spotting in video games. Pattern Recognit Lett 25(15):1701\u20131714. https:\/\/doi.org\/10.1016\/j.patrec.2004.06.016","journal-title":"Pattern Recognit Lett"},{"issue":"14","key":"4851_CR17","doi-asserted-by":"publisher","first-page":"14610","DOI":"10.1109\/JSEN.2022.3181518","volume":"22","author":"DG Le\u00f3n","year":"2022","unstructured":"Le\u00f3n DG, Gr\u00f6li J, Yeduri SR, Rossier D, Mosqueron R, Pandey OJ, Cenkeramaddi LR (2022) Video hand gestures recognition using depth camera and lightweight cnn. IEEE Sens J 22(14):14610\u201314619. https:\/\/doi.org\/10.1109\/JSEN.2022.3181518","journal-title":"IEEE Sens J"},{"key":"4851_CR18","doi-asserted-by":"publisher","unstructured":"Li Y, Miao Q, Tian K, Fan Y, Xu X, Li R, Song J (2016) Large-scale gesture recognition with a fusion of rgb-d data based on the c3d model. In: 2016 23rd international conference on pattern recognition (ICPR). Cancun, Mexico, pp 25\u201330. https:\/\/doi.org\/10.1109\/ICPR.2016.7899602","DOI":"10.1109\/ICPR.2016.7899602"},{"issue":"6","key":"4851_CR19","doi-asserted-by":"publisher","first-page":"1898","DOI":"10.1109\/JSEN.2014.2306094","volume":"14","author":"K Liu","year":"2014","unstructured":"Liu K, Chen C, Jafari R, Kehtarnavaz N (2014) Fusion of inertial and depth sensor data for robust hand gesture recognition. IEEE Sens J 14(6):1898\u20131903. https:\/\/doi.org\/10.1109\/JSEN.2014.2306094","journal-title":"IEEE Sens J"},{"key":"4851_CR20","doi-asserted-by":"publisher","unstructured":"Liu JQ, Furusawa K, Tsujinaga S, Tateyama T, Iwamoto Y, Chen YW (2019) Mahg-rgbd: A multi-angle view hand gesture rgb-d dataset for deep learning based gesture recognition and baseline evaluations. In: 2019 IEEE international conference on consumer electronics (ICCE). Las Vegas, NV, USA, pp 1\u20134. https:\/\/doi.org\/10.1109\/ICCE.2019.8661941","DOI":"10.1109\/ICCE.2019.8661941"},{"key":"4851_CR21","doi-asserted-by":"crossref","unstructured":"Miao Q, Li Y, Ouyang W, Ma Z, Xu X, Shi W, Cao X (2017) Multimodal gesture recognition based on the resc3d network. In: Proceedings of the IEEE international conference on computer vision (ICCV) workshops. Venice, Italy","DOI":"10.1109\/ICCVW.2017.360"},{"issue":"8","key":"4851_CR22","doi-asserted-by":"publisher","first-page":"73","DOI":"10.3390\/jimaging6080073","volume":"6","author":"M Oudah","year":"2020","unstructured":"Oudah M, Al-Naji A, Chahl J (2020) Hand gesture recognition based on computer vision: a review of techniques. J Imaging 6(8):73","journal-title":"J Imaging"},{"key":"4851_CR23","doi-asserted-by":"publisher","first-page":"6793","DOI":"10.1007\/s12652-020-02314-2","volume":"12","author":"P Parvathy","year":"2021","unstructured":"Parvathy P, Subramaniam K, Prasanna Venkatesan G, Karthikaikumar P, Varghese J, Jayasankar T (2021) Development of hand gesture recognition system using machine learning. J Ambient Intell Humaniz Comput 12:6793\u20136800","journal-title":"J Ambient Intell Humaniz Comput"},{"key":"4851_CR24","doi-asserted-by":"publisher","unstructured":"Patsadu O, Nukoolkit C, Watanapa B (2012) Human gesture recognition using kinect camera. In: 2012 ninth international conference on computer science and software engineering (JCSSE). Bangkok, Thailand, pp 28\u201332. https:\/\/doi.org\/10.1109\/JCSSE.2012.6261920","DOI":"10.1109\/JCSSE.2012.6261920"},{"key":"4851_CR25","doi-asserted-by":"publisher","unstructured":"Peng B, Qian G, Rajko S (2008) View-invariant full-body gesture recognition from video. In: 2008 19th international conference on pattern recognition. Tampa, FL, USA, pp 1\u20135. https:\/\/doi.org\/10.1109\/ICPR.2008.4761681","DOI":"10.1109\/ICPR.2008.4761681"},{"key":"4851_CR26","doi-asserted-by":"crossref","unstructured":"Ravikumar S, Kavitha D (2021) Iot based autonomous car driver scheme based on anfis and black widow optimization. J Ambient Intell Humaniz Comput 12:1\u201314","DOI":"10.1007\/s12652-020-02725-1"},{"key":"4851_CR27","doi-asserted-by":"crossref","unstructured":"Schneider P, Memmesheimer R, Kramer I, Paulus D (2019) Gesture recognition in rgb videos using human body keypoints and dynamic time warping. In: RoboCup 2019: Robot World Cup XXIII 23. Springer, pp 281\u2013293","DOI":"10.1007\/978-3-030-35699-6_22"},{"key":"4851_CR28","doi-asserted-by":"publisher","unstructured":"Wu C, Shao S, Tunc C, Hariri S (2020) Video anomaly detection using pre-trained deep convolutional neural nets and context mining. In: 2020 IEEE\/ACS 17th international conference on computer systems and applications (AICCSA). Antalya, Turkey, pp 1\u20138. https:\/\/doi.org\/10.1109\/AICCSA50499.2020.9316538","DOI":"10.1109\/AICCSA50499.2020.9316538"},{"key":"4851_CR29","doi-asserted-by":"publisher","DOI":"10.1016\/j.image.2019.115688","volume":"81","author":"S Xu","year":"2020","unstructured":"Xu S, Liang L, Ji C (2020) Gesture recognition for human-machine interaction in table tennis video based on deep semantic understanding. Signal Process Image Commun 81:115688. https:\/\/doi.org\/10.1016\/j.image.2019.115688","journal-title":"Signal Process Image Commun"},{"key":"4851_CR30","doi-asserted-by":"publisher","unstructured":"Yakkati RR, Yeduri SR, Cenkeramaddi LR (2021) Hand gesture classification using grayscale thermal images and convolutional neural network. In: 2021 IEEE international symposium on smart electronic systems (iSES). Jaipur, India, pp 111\u2013116. https:\/\/doi.org\/10.1109\/iSES52644.2021.00035","DOI":"10.1109\/iSES52644.2021.00035"},{"key":"4851_CR31","doi-asserted-by":"publisher","first-page":"5569","DOI":"10.1007\/s12652-020-01913-3","volume":"11","author":"X Zhou","year":"2020","unstructured":"Zhou X, Qi W, Ovur SE, Zhang L, Hu Y, Su H, Ferrigno G, De Momi E (2020) A novel muscle-computer interface for hand gesture recognition using depth vision. J Ambient Intell Humaniz Comput 11:5569\u20135580","journal-title":"J Ambient Intell Humaniz Comput"}],"container-title":["Journal of Ambient Intelligence and Humanized Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12652-024-04851-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12652-024-04851-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12652-024-04851-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,23]],"date-time":"2024-10-23T06:27:03Z","timestamp":1729664823000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12652-024-04851-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,20]]},"references-count":31,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2024,12]]}},"alternative-id":["4851"],"URL":"https:\/\/doi.org\/10.1007\/s12652-024-04851-6","relation":{},"ISSN":["1868-5137","1868-5145"],"issn-type":[{"value":"1868-5137","type":"print"},{"value":"1868-5145","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,20]]},"assertion":[{"value":"23 September 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 August 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 September 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}