{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,23]],"date-time":"2025-10-23T17:07:00Z","timestamp":1761239220604,"version":"build-2065373602"},"reference-count":50,"publisher":"Wiley","issue":"2","license":[{"start":{"date-parts":[[2024,12,15]],"date-time":"2024-12-15T00:00:00Z","timestamp":1734220800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000781","name":"European Research Council","doi-asserted-by":"publisher","award":["816006"],"award-info":[{"award-number":["816006"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["advanced.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Advanced Intelligent Systems"],"published-print":{"date-parts":[[2025,2]]},"abstract":"<jats:p>Touchscreens are essential parts of many electronics in daily lives of sighted people in the digital information era. On the other hand, visually impaired users rely on tactile displays as one of the key communication devices to interact with the digital world. However, due to their working mechanism and the uneven surface of tactile displays, one of the key features of screens for sighted users is surprisingly challenging to implement: precision touch input. To overcome this, a hand gesture recognition system is developed using a frequency\u2010modulated continuous wave millimeter\u2010wave radar. A multifeature encoder method is used to obtain the range and velocity information from the radar to translate the data into spectrogram images. Gesture recognition is implemented for common input gestures: single\/double\u2010click, swipe\u2010right\/left, scroll\u2010up\/down, zoom\u2010in\/out, and rotate\u2010anticlockwise\/clockwise. The gesture recognition and classification are based on machine learning, support vector machines, deep learning, and convolutional neural network approaches. The chosen model You\u2010Only\u2010Look\u2010Once (YOLOv8) shows a high accuracy of 97.1% by iterating only 30\u2009epochs with only 500 collected data samples per gesture. This research paves the way toward using radar sensors not only for tactile displays but also for other digital devices in human\u2013computer interaction.<\/jats:p>","DOI":"10.1002\/aisy.202400663","type":"journal-article","created":{"date-parts":[[2024,12,16]],"date-time":"2024-12-16T01:36:14Z","timestamp":1734312974000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Hand Gesture Recognition Using Frequency\u2010Modulated Continuous Wave Radar on Tactile Displays for the Visually Impaired"],"prefix":"10.1002","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0009-0009-1518-5582","authenticated-orcid":false,"given":"Ahmed","family":"Hamza","sequence":"first","affiliation":[{"name":"Laboratory of Process Technology NeptunLab Department of Microsystem Engineering (IMTEK) University of Freiburg  79110 Freiburg im Breisgau Germany"},{"name":"Freiburg Materials Research Center (FMF) University of Freiburg  Stefan\u2010Meier\u2010Stra\u00dfe 21 79104 Freiburg im Breisgau Germany"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-3052-196X","authenticated-orcid":false,"given":"Santosh Kumar","family":"Prabhulingaiah","sequence":"additional","affiliation":[{"name":"Laboratory of Process Technology NeptunLab Department of Microsystem Engineering (IMTEK) University of Freiburg  79110 Freiburg im Breisgau Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2583-1532","authenticated-orcid":false,"given":"Pegah","family":"Pezeshkpour","sequence":"additional","affiliation":[{"name":"Laboratory of Process Technology NeptunLab Department of Microsystem Engineering (IMTEK) University of Freiburg  79110 Freiburg im Breisgau Germany"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3955-0291","authenticated-orcid":false,"given":"Bastian E.","family":"Rapp","sequence":"additional","affiliation":[{"name":"Laboratory of Process Technology NeptunLab Department of Microsystem Engineering (IMTEK) University of Freiburg  79110 Freiburg im Breisgau Germany"},{"name":"Freiburg Materials Research Center (FMF) University of Freiburg  Stefan\u2010Meier\u2010Stra\u00dfe 21 79104 Freiburg im Breisgau Germany"},{"name":"Cluster of Excellence livMatS@ FIT \u2010 Freiburg Center of Interactive Materials and Bioinspired Technologies University of Freiburg  Georges\u2010K\u00f6hler\u2010Allee 105 79110 Freiburg im Breisgau Germany"}]}],"member":"311","published-online":{"date-parts":[[2024,12,15]]},"reference":[{"volume-title":"World Report on Vision","year":"2019","author":"W. H. Organization","key":"e_1_2_8_2_1"},{"key":"e_1_2_8_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-08596-8_102"},{"key":"e_1_2_8_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNSRE.2007.891375"},{"key":"e_1_2_8_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3053723"},{"key":"e_1_2_8_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/0020-7373(91)90037-8"},{"key":"e_1_2_8_7_1","doi-asserted-by":"crossref","unstructured":"L. G.Motti N.Vigouroux P.Gorce inProc. of the 25th Conf. on l\u2019Interaction Homme\u2010Machine Association for Computing Machinery New York NYNovember2013 Talence Franc pp.125\u2013134.","DOI":"10.1145\/2534903.2534920"},{"key":"e_1_2_8_8_1","doi-asserted-by":"crossref","unstructured":"J. A.Turner G. J.Ritchie inProc. of the May 5\u20107 1970 Spring Joint Computer Conf. Association for Computing Machinery New York NY1970 pp.613\u2013620.","DOI":"10.1145\/1476936.1477029"},{"key":"e_1_2_8_9_1","doi-asserted-by":"publisher","DOI":"10.1088\/0964-1726\/6\/5\/004"},{"key":"e_1_2_8_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/28.55954"},{"key":"e_1_2_8_11_1","doi-asserted-by":"publisher","DOI":"10.1002\/j.2637-496X.2010.tb00229.x"},{"key":"e_1_2_8_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-UFFC.1987.26932"},{"key":"e_1_2_8_13_1","doi-asserted-by":"publisher","DOI":"10.1889\/1.3069525"},{"key":"e_1_2_8_14_1","doi-asserted-by":"publisher","DOI":"10.3390\/s21144776"},{"key":"e_1_2_8_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TED.2011.2162844"},{"key":"e_1_2_8_16_1","first-page":"12","volume":"6","author":"Bhalla M. R.","year":"2010","journal-title":"Int. J. Comput. Appl."},{"key":"e_1_2_8_17_1","doi-asserted-by":"publisher","DOI":"10.1002\/aisy.202100046"},{"key":"e_1_2_8_18_1","doi-asserted-by":"publisher","DOI":"10.1002\/aisy.202100091"},{"key":"e_1_2_8_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMM.2014.2374357"},{"key":"e_1_2_8_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMTT.2016.2610427"},{"key":"e_1_2_8_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-13-0776-8_33"},{"key":"e_1_2_8_22_1","doi-asserted-by":"publisher","DOI":"10.3390\/jimaging6080073"},{"key":"e_1_2_8_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ergon.2017.02.004"},{"key":"e_1_2_8_24_1","doi-asserted-by":"crossref","unstructured":"Z.Ren J.Yuan Z.Zhang inProc. of the 19th ACM Int. Conf. on Multimedia Association for Computing Machinery New York NY November2011 pp.1093\u20131096.","DOI":"10.1145\/2072298.2071946"},{"key":"e_1_2_8_25_1","doi-asserted-by":"publisher","DOI":"10.3390\/s20020564"},{"key":"e_1_2_8_26_1","doi-asserted-by":"publisher","DOI":"10.1175\/BAMS-D-14-00173.1"},{"key":"e_1_2_8_27_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0239892"},{"key":"e_1_2_8_28_1","doi-asserted-by":"publisher","DOI":"10.3390\/s130506636"},{"key":"e_1_2_8_29_1","doi-asserted-by":"publisher","DOI":"10.1049\/iet-rsn.2018.5126"},{"key":"e_1_2_8_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/JMW.2020.3033616"},{"key":"e_1_2_8_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/22.643858"},{"key":"e_1_2_8_32_1","unstructured":"M.Zlatanski P.Sommer F.Zurfluh G. L.Madonna in2018 IEEE Int. Conf. on Intelligence and Safety for Robotics (ISR) China August2018 pp.19\u201325."},{"key":"e_1_2_8_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/LRA.2021.3068916"},{"key":"e_1_2_8_34_1","doi-asserted-by":"crossref","unstructured":"C.Stetco B.Ubezio S.M\u00fchlbacher\u2010Karrer H.Zangl in2020 IEEE Int. Conf. on Robotics and Automation (ICRA) Paris (Virtual) May\u2010August2020 pp.10452\u201310458.","DOI":"10.1109\/ICRA40945.2020.9197180"},{"key":"e_1_2_8_35_1","doi-asserted-by":"publisher","DOI":"10.1002\/rob.21770"},{"key":"e_1_2_8_36_1","doi-asserted-by":"publisher","DOI":"10.3390\/s130404527"},{"key":"e_1_2_8_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMTT.2013.2256924"},{"key":"e_1_2_8_38_1","doi-asserted-by":"publisher","DOI":"10.1002\/aisy.202100209"},{"key":"e_1_2_8_39_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMTT.2021.3087166"},{"key":"e_1_2_8_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSTSP.2021.3118888"},{"key":"e_1_2_8_41_1","doi-asserted-by":"publisher","DOI":"10.1002\/rob.20166"},{"key":"e_1_2_8_42_1","doi-asserted-by":"publisher","DOI":"10.3390\/rs13030527"},{"key":"e_1_2_8_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/COMST.2022.3177305"},{"key":"e_1_2_8_44_1","doi-asserted-by":"publisher","DOI":"10.3390\/s23125605"},{"key":"e_1_2_8_45_1","unstructured":"Z.Tong R.Renter M.Fujimoto inIET Int. Radar Conf. 2015 Hangzhou October2015 pp.1\u20134."},{"key":"e_1_2_8_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2020.2994292"},{"key":"e_1_2_8_47_1","doi-asserted-by":"crossref","unstructured":"S.Bi X.Jiang X.Gao X.Liu in2019 IEEE 20th Wireless and Microwave Technology Conf. (WAMICON) Cocoa Beach FL USA April2019 pp.1\u20134.","DOI":"10.1109\/WAMICON.2019.8765442"},{"key":"e_1_2_8_48_1","doi-asserted-by":"publisher","DOI":"10.1007\/b95439"},{"key":"e_1_2_8_49_1","doi-asserted-by":"publisher","DOI":"10.1038\/nbt1206-1565"},{"key":"e_1_2_8_50_1","doi-asserted-by":"publisher","DOI":"10.3390\/make5040083"},{"key":"e_1_2_8_51_1","doi-asserted-by":"crossref","unstructured":"J.Redmon S.Divvala R.Girshick A.Farhadi in2016 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR) Las Vegas Nevada USA June2016 pp.779\u2013788.","DOI":"10.1109\/CVPR.2016.91"}],"container-title":["Advanced Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/aisy.202400663","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,7]],"date-time":"2025-10-07T23:52:36Z","timestamp":1759881156000},"score":1,"resource":{"primary":{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/10.1002\/aisy.202400663"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,15]]},"references-count":50,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,2]]}},"alternative-id":["10.1002\/aisy.202400663"],"URL":"https:\/\/doi.org\/10.1002\/aisy.202400663","archive":["Portico"],"relation":{},"ISSN":["2640-4567","2640-4567"],"issn-type":[{"type":"print","value":"2640-4567"},{"type":"electronic","value":"2640-4567"}],"subject":[],"published":{"date-parts":[[2024,12,15]]},"assertion":[{"value":"2024-08-02","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-12-15","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"2400663"}}