{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T22:09:21Z","timestamp":1740175761273,"version":"3.37.3"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2023,12,12]],"date-time":"2023-12-12T00:00:00Z","timestamp":1702339200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,12,12]],"date-time":"2023-12-12T00:00:00Z","timestamp":1702339200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Scientic Research Foundation of Hebei University for Distinguished Young Scholars","award":["521100221081"],"award-info":[{"award-number":["521100221081"]}]},{"name":"Scientic Research Foundation of Colleges and Universities in Hebei Province","award":["QN2022107"],"award-info":[{"award-number":["QN2022107"]}]},{"DOI":"10.13039\/501100005064","name":"Science and Technology Program of Hebei Province","doi-asserted-by":"crossref","award":["22370301D"],"award-info":[{"award-number":["22370301D"]}],"id":[{"id":"10.13039\/501100005064","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Central Government Guides Local Science and Technology Development Fund Projects","award":["236Z0301G"],"award-info":[{"award-number":["236Z0301G"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2024,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Hand gesture segmentation is an essential step to recognize hand gestures for human\u2013robot interaction. However, complex backgrounds and the variety of gesture shapes cause low semantic segmentation accuracy in the existing lightweight methods because of imprecise features and imbalance between branches. To remedy the above problems, we propose a new segmentation structure for hand gestures. Based on the structure, a novel tri-branch lightweight segmentation network (BLSNet), is proposed for gesture segmentation. Corresponding to the structure parts, three branches are employed to achieve local features, boundaries and semantic hand features. In the boundary branch, to extract multiscale features of hand gesture contours, a novel multi-scale depth-wise strip convolution (MDSC) module is proposed based on gesture boundaries for directionality. For hand boundary details, we propose a new boundary weight (BW) module based on boundary attention. To identify hand location, a semantic branch with continuous downsampling is used to address complex backgrounds. We use the Ghost bottleneck as the building block for the entire BLSNet network. To verify the effectiveness of the proposed network, corresponding experiments have been conducted based on OUHANDS and HGR1 datasets, and the experimental results demonstrate that the proposed method is superior to contrast methods.<\/jats:p>","DOI":"10.1007\/s40747-023-01292-0","type":"journal-article","created":{"date-parts":[[2023,12,12]],"date-time":"2023-12-12T04:30:50Z","timestamp":1702355450000},"page":"2703-2715","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Blsnet: a tri-branch lightweight network for gesture segmentation against cluttered backgrounds"],"prefix":"10.1007","volume":"10","author":[{"given":"Guoyu","family":"Zhou","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7345-1422","authenticated-orcid":false,"given":"Zhenchao","family":"Cui","sequence":"additional","affiliation":[]},{"given":"Jing","family":"Qi","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,12,12]]},"reference":[{"issue":"4","key":"1292_CR1","doi-asserted-by":"publisher","first-page":"5339","DOI":"10.1109\/LRA.2020.3007462","volume":"5","author":"J Mi\u0161eikis","year":"2020","unstructured":"Mi\u0161eikis J, Caroni P, Duchamp P, Gasser A, Marko R, Mi\u0161eikien\u0117 N, Zwilling F, Castelbajac C, Eicher L, Fr\u00fch M, Fr\u00fch H (2020) Lio-a personal robot assistant for human\u2013robot interaction and care applications. IEEE Robot Autom Lett 5(4):5339\u20135346. https:\/\/doi.org\/10.1109\/LRA.2020.3007462","journal-title":"IEEE Robot Autom Lett"},{"key":"1292_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2023\/2201330","volume":"2023","author":"J Qi","year":"2023","unstructured":"Qi J, Ma L, Cui Z, Yu Y (2023) Computer vision-based hand gesture recognition for human-robot interaction: a review. Complex Intell Syst 2023:1\u201326","journal-title":"Complex Intell Syst"},{"key":"1292_CR3","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1016\/j.neucom.2017.12.016","volume":"282","author":"D Zhou","year":"2018","unstructured":"Zhou D, Shi M, Chao F, Lin C-M, Yang L, Shang C, Zhou C (2018) Use of human gestures for controlling a mobile robot via adaptive CMAC network and fuzzy logic controller. Neurocomputing 282:218\u2013231","journal-title":"Neurocomputing"},{"key":"1292_CR4","doi-asserted-by":"publisher","first-page":"198","DOI":"10.1016\/j.neucom.2019.02.066","volume":"390","author":"Q Gao","year":"2020","unstructured":"Gao Q, Liu J, Ju Z (2020) Robust real-time hand detection and localization for space human-robot interaction based on deep learning. Neurocomputing 390:198\u2013206","journal-title":"Neurocomputing"},{"issue":"4","key":"1292_CR5","doi-asserted-by":"publisher","first-page":"461","DOI":"10.1109\/TSMCC.2008.923862","volume":"38","author":"L Dipietro","year":"2008","unstructured":"Dipietro L, Sabatini AM, Dario P (2008) A survey of glove-based systems and their applications. IEEE Trans Syst Man Cybern Part C (Appl Rev) 38(4):461\u2013482","journal-title":"IEEE Trans Syst Man Cybern Part C (Appl Rev)"},{"key":"1292_CR6","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s10462-012-9356-9","volume":"43","author":"SS Rautaray","year":"2015","unstructured":"Rautaray SS, Agrawal A (2015) Vision based hand gesture recognition for human\u2013computer interaction: a survey. Artif Intell Rev 43:1\u201354","journal-title":"Artif Intell Rev"},{"key":"1292_CR7","doi-asserted-by":"publisher","first-page":"152","DOI":"10.1016\/j.cviu.2015.08.004","volume":"141","author":"PK Pisharady","year":"2015","unstructured":"Pisharady PK, Saerbeck M (2015) Recent methods and databases in vision-based hand gesture recognition: a review. Comput Vis Image Underst 141:152\u2013165","journal-title":"Comput Vis Image Underst"},{"key":"1292_CR8","doi-asserted-by":"publisher","first-page":"424","DOI":"10.1016\/j.neucom.2018.11.038","volume":"331","author":"H Tang","year":"2019","unstructured":"Tang H, Liu H, Xiao W, Sebe N (2019) Fast and robust dynamic hand gesture recognition via key frames extraction and feature fusion. Neurocomputing 331:424\u2013433","journal-title":"Neurocomputing"},{"issue":"8","key":"1292_CR9","doi-asserted-by":"publisher","first-page":"700","DOI":"10.1049\/iet-cvi.2018.5796","volume":"13","author":"A Dadashzadeh","year":"2019","unstructured":"Dadashzadeh A, Targhi AT, Tahmasbi M, Mirmehdi M (2019) Hgr-net: a fusion network for hand gesture segmentation and recognition. IET Comput Vis 13(8):700\u2013707","journal-title":"IET Comput Vis"},{"key":"1292_CR10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2021\/1783246","volume":"2021","author":"Y Luo","year":"2021","unstructured":"Luo Y, Cui G, Li D (2021) An improved gesture segmentation method for gesture recognition based on CNN and YCBCR. J Electr Comput Eng 2021:1\u20139","journal-title":"J Electr Comput Eng"},{"key":"1292_CR11","doi-asserted-by":"crossref","unstructured":"Aithal CN, Ishwarya P, Sneha S, Yashvardhan C, Kumar D, Suresh K (2021) Hand gesture recognition in complex background. In: International conference on cognition and recognition. Springer, London, pp 243\u2013257","DOI":"10.1007\/978-3-031-22405-8_19"},{"key":"1292_CR12","doi-asserted-by":"crossref","unstructured":"Zheng Y, Zheng P (2015) Hand segmentation based on improved gaussian mixture model. In: 2015 international conference on computer science and applications (CSA). IEEE, London, pp 168\u2013171","DOI":"10.1109\/CSA.2015.14"},{"key":"1292_CR13","doi-asserted-by":"publisher","first-page":"404","DOI":"10.1016\/j.neucom.2013.12.023","volume":"133","author":"Y Chuang","year":"2014","unstructured":"Chuang Y, Chen L, Chen G (2014) Saliency-guided improvement for hand posture detection and recognition. Neurocomputing 133:404\u2013415","journal-title":"Neurocomputing"},{"key":"1292_CR14","doi-asserted-by":"crossref","unstructured":"Zhao Y, Song Z, Wu X (2012) Hand detection using multi-resolution hog features. In: 2012 IEEE international conference on robotics and biomimetics (ROBIO). IEEE, London, pp 1715\u20131720","DOI":"10.1109\/ROBIO.2012.6491215"},{"issue":"8","key":"1292_CR15","doi-asserted-by":"publisher","first-page":"1562","DOI":"10.1109\/TIM.2008.922070","volume":"57","author":"Q Chen","year":"2008","unstructured":"Chen Q, Georganas ND, Petriu EM (2008) Hand gesture recognition using Haar-like features and a stochastic context-free grammar. IEEE Trans Instrum Meas 57(8):1562\u20131571","journal-title":"IEEE Trans Instrum Meas"},{"issue":"11","key":"1292_CR16","doi-asserted-by":"publisher","first-page":"3592","DOI":"10.1109\/TIM.2011.2161140","volume":"60","author":"NH Dardas","year":"2011","unstructured":"Dardas NH, Georganas ND (2011) Real-time hand gesture detection and recognition using bag-of-features and support vector machine techniques. IEEE Trans Instrum Meas 60(11):3592\u20133607","journal-title":"IEEE Trans Instrum Meas"},{"key":"1292_CR17","doi-asserted-by":"crossref","unstructured":"Mocanu C, Suciu G (2019) Automatic recognition of hand gestures. In: 2019 11th international conference on electronics, computers and artificial intelligence (ECAI). IEEE, London, pp 1\u20135","DOI":"10.1109\/ECAI46879.2019.9041987"},{"issue":"6","key":"1292_CR18","first-page":"1","volume":"4","author":"Q-Y Zhang","year":"2009","unstructured":"Zhang Q-Y, Zhang M-Y, Hu J-Q (2009) Hand gesture contour tracking based on skin color probability and state estimation model. J Multimed 4(6):1","journal-title":"J Multimed"},{"issue":"28","key":"1292_CR19","doi-asserted-by":"publisher","first-page":"40311","DOI":"10.1007\/s11042-022-12870-8","volume":"81","author":"PA Popov","year":"2022","unstructured":"Popov PA, Lagani\u00e8re R (2022) Long hands gesture recognition system: 2 step gesture recognition with machine learning and geometric shape analysis. Multimed Tools Appl 81(28):40311\u201340342","journal-title":"Multimed Tools Appl"},{"key":"1292_CR20","doi-asserted-by":"crossref","unstructured":"Kang B, Tan K-H, Jiang N, Tai H-S, Tretter D, Nguyen T (2017) Hand segmentation for hand-object interaction from depth map. In: 2017 IEEE global conference on signal and information processing (GlobalSIP). IEEE, London, pp 259\u2013263","DOI":"10.1109\/GlobalSIP.2017.8308644"},{"key":"1292_CR21","doi-asserted-by":"crossref","unstructured":"Shotton J, Fitzgibbon A, Cook M, Sharp T, Finocchio M, Moore R, Kipman A, Blake A (2011) Real-time human pose recognition in parts from single depth images. In: CVPR 2011. IEEE, London, pp 1297\u20131304","DOI":"10.1109\/CVPR.2011.5995316"},{"key":"1292_CR22","doi-asserted-by":"publisher","first-page":"192527","DOI":"10.1109\/ACCESS.2020.3032140","volume":"8","author":"M Al-Hammadi","year":"2020","unstructured":"Al-Hammadi M, Muhammad G, Abdul W, Alsulaiman M, Bencherif MA, Alrayes TS, Mathkour H, Mekhtiche MA (2020) Deep learning-based approach for sign language gesture recognition with efficient hand gesture representation. IEEE Access 8:192527\u2013192542","journal-title":"IEEE Access"},{"key":"1292_CR23","first-page":"1","volume":"2022","author":"S Wang","year":"2022","unstructured":"Wang S, Zhang S, Zhang X, Geng Q (2022) A two-branch hand gesture recognition approach combining Atrous convolution and attention mechanism. Vis Comput 2022:1\u201314","journal-title":"Vis Comput"},{"issue":"2","key":"1292_CR24","doi-asserted-by":"publisher","first-page":"356","DOI":"10.3390\/s21020356","volume":"21","author":"G Benitez-Garcia","year":"2021","unstructured":"Benitez-Garcia G, Prudente-Tixteco L, Castro-Madrid LC, Toscano-Medina R, Olivares-Mercado J, Sanchez-Perez G, Villalba LJG (2021) Improving real-time hand gesture recognition with semantic segmentation. Sensors 21(2):356","journal-title":"Sensors"},{"key":"1292_CR25","first-page":"1","volume":"2023","author":"TL Dang","year":"2023","unstructured":"Dang TL, Pham TH, Dang QM, Monet N (2023) A lightweight architecture for hand gesture recognition. Multimed Tools Appl 2023:1\u201319","journal-title":"Multimed Tools Appl"},{"key":"1292_CR26","doi-asserted-by":"crossref","unstructured":"Dayananda Kumar N, Suresh K, Dinesh R (2021) Depth based static hand gesture segmentation and recognition. In: International conference on cognition and recognition. Springer, London, pp 125\u2013138","DOI":"10.1007\/978-3-031-22405-8_11"},{"key":"1292_CR27","doi-asserted-by":"crossref","unstructured":"Das SK, Lahkar R, Antariksha K, Das A, Bora A, Ganguly A (2023) Lightweight encoder\u2013decoder model for semantic segmentation of hand postures. In: Inventive computation and information technologies: proceedings of ICICIT 2022. Springer, London, pp 579\u2013591","DOI":"10.1007\/978-981-19-7402-1_41"},{"key":"1292_CR28","doi-asserted-by":"crossref","unstructured":"Zhao H, Qi X, Shen X, Shi J, Jia J (2018) Icnet for real-time semantic segmentation on high-resolution images. In: Proceedings of the European conference on computer vision (ECCV), pp 405\u2013420","DOI":"10.1007\/978-3-030-01219-9_25"},{"key":"1292_CR29","doi-asserted-by":"crossref","unstructured":"Li H, Xiong P, Fan H, Sun J (2019) Dfanet: deep feature aggregation for real-time semantic segmentation. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 9522\u20139531","DOI":"10.1109\/CVPR.2019.00975"},{"key":"1292_CR30","doi-asserted-by":"crossref","unstructured":"Mehta S, Rastegari M, Shapiro L, Hajishirzi H (2019) Espnetv2: a light-weight, power efficient, and general purpose convolutional neural network. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 9190\u20139200","DOI":"10.1109\/CVPR.2019.00941"},{"key":"1292_CR31","doi-asserted-by":"crossref","unstructured":"Mehta S, Rastegari M, Caspi A, Shapiro L, Hajishirzi H (2018) Espnet: efficient spatial pyramid of dilated convolutions for semantic segmentation. In: Proceedings of the European conference on computer vision (ECCV), pp 552\u2013568","DOI":"10.1007\/978-3-030-01249-6_34"},{"key":"1292_CR32","doi-asserted-by":"crossref","unstructured":"Yu C, Wang J, Peng C, Gao C, Yu G, Sang N (2018) Bisenet: bilateral segmentation network for real-time semantic segmentation. In: Proceedings of the European conference on computer vision (ECCV), pp 325\u2013341","DOI":"10.1007\/978-3-030-01261-8_20"},{"key":"1292_CR33","unstructured":"Hong Y, Pan H, Sun W, Jia Y (2021) Deep dual-resolution networks for real-time and accurate semantic segmentation of road scenes. arXiv Preprint arXiv:2101.06085"},{"key":"1292_CR34","unstructured":"Du S, Lee J, Li H, Wang L, Zhai X (2019) Gradient descent finds global minima of deep neural networks. In: International conference on machine learning. PMLR, pp 1675\u20131685"},{"key":"1292_CR35","doi-asserted-by":"crossref","unstructured":"Han K, Wang Y, Tian Q, Guo J, Xu C, Xu C (2020) Ghostnet: more features from cheap operations. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 1580\u20131589","DOI":"10.1109\/CVPR42600.2020.00165"},{"key":"1292_CR36","unstructured":"Chen L-C, Papandreou G, Schroff F, Adam H (2017) Rethinking Atrous convolution for semantic image segmentation. arXiv Preprint arXiv:1706.05587"},{"key":"1292_CR37","doi-asserted-by":"crossref","unstructured":"Xu J, Xiong Z, Bhattacharyya SP (2023) Pidnet: a real-time semantic segmentation network inspired by PID controllers. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, pp 19529\u201319539","DOI":"10.1109\/CVPR52729.2023.01871"},{"key":"1292_CR38","doi-asserted-by":"crossref","unstructured":"Deng R, Shen C, Liu S, Wang H, Liu X (2018) Learning to predict crisp boundaries. In: Proceedings of the European conference on computer vision (ECCV), pp 562\u2013578","DOI":"10.1007\/978-3-030-01231-1_35"},{"key":"1292_CR39","doi-asserted-by":"publisher","first-page":"3051","DOI":"10.1007\/s11263-021-01515-2","volume":"129","author":"C Yu","year":"2021","unstructured":"Yu C, Gao C, Wang J, Yu G, Shen C, Sang N (2021) Bisenet v2: bilateral network with guided aggregation for real-time semantic segmentation. Int J Comput Vis 129:3051\u20133068","journal-title":"Int J Comput Vis"},{"key":"1292_CR40","doi-asserted-by":"crossref","unstructured":"Matilainen M, Sangi P, Holappa J, Silv\u00e9n O (2016) Ouhands database for hand detection and pose recognition. In: 2016 6th international conference on image processing theory, tools and applications (IPTA). IEEE, pp 1\u20135","DOI":"10.1109\/IPTA.2016.7821025"},{"key":"1292_CR41","unstructured":"Baranyi P. Database for hand gesture recognition. https:\/\/sun.aei.polsl.pl\/~mkawulok\/gestures\/"},{"key":"1292_CR42","first-page":"12077","volume":"34","author":"E Xie","year":"2021","unstructured":"Xie E, Wang W, Yu Z, Anandkumar A, Alvarez JM, Luo P (2021) Segformer: simple and efficient design for semantic segmentation with transformers. Adv Neural Inf Process Syst 34:12077\u201312090","journal-title":"Adv Neural Inf Process Syst"},{"key":"1292_CR43","unstructured":"Peng J, Liu Y, Tang S, Hao Y, Chu L, Chen G, Wu Z, Chen Z, Yu Z, Du Y, et al (2022) Pp-liteseg: a superior real-time semantic segmentation model. arXiv Preprint arXiv:2204.02681"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01292-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-023-01292-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-023-01292-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,30]],"date-time":"2024-03-30T15:33:36Z","timestamp":1711812816000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-023-01292-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,12]]},"references-count":43,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,4]]}},"alternative-id":["1292"],"URL":"https:\/\/doi.org\/10.1007\/s40747-023-01292-0","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"type":"print","value":"2199-4536"},{"type":"electronic","value":"2198-6053"}],"subject":[],"published":{"date-parts":[[2023,12,12]]},"assertion":[{"value":"21 May 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 November 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 December 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no conflict of interest to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}