{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T14:21:02Z","timestamp":1784816462240,"version":"3.55.0"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2022,12,26]],"date-time":"2022-12-26T00:00:00Z","timestamp":1672012800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,12,26]],"date-time":"2022-12-26T00:00:00Z","timestamp":1672012800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100009092","name":"Universidad de Alicante","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100009092","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Virtual Reality"],"published-print":{"date-parts":[[2023,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper presents an augmented reality application to assist with myoelectric prostheses control for people with limb amputations. For that, we use the low-cost Myo armband coupled with low-level signal processing methods specifically built to control filters\u2019 levels and processing chain. In particular, we use deep learning techniques to process the signals and to accurately identify seven different hand gestures. From that, we have built an augmented reality projection of a hand based on AprilTag markers that displays the gesture identified by the deep learning techniques. With the aim to properly train the gesture recognition system, we have built our own dataset with nine subjects. This dataset was combined with one publicly available to work with the data of 24 subjects in total. Finally, three different deep learning architectures have been comparatively studied, achieving high accuracy values (being 95.56% the best one). This validates our hypothesis that it is possible to have an adaptive platform able to fast learn personalized hand\/arm gestures while projecting a virtual hand in real-time. This can reduce the adaptation time to myoelectric prostheses and improve the acceptance levels.<\/jats:p>","DOI":"10.1007\/s10055-022-00741-4","type":"journal-article","created":{"date-parts":[[2022,12,26]],"date-time":"2022-12-26T19:03:08Z","timestamp":1672081388000},"page":"3469-3483","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["A low-cost AR application to control arm prosthesis"],"prefix":"10.1007","volume":"27","author":[{"given":"Alvaro","family":"Sanchez-Rocamora","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4495-6912","authenticated-orcid":false,"given":"Ester","family":"Martinez-Martin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Angelo","family":"Costa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,12,26]]},"reference":[{"key":"741_CR1","unstructured":"adafruit: Inside Myo. https:\/\/learn.adafruit.com\/myo-armband-teardown (2016)"},{"key":"741_CR2","doi-asserted-by":"publisher","DOI":"10.3389\/fneur.2018.00067","author":"E Ambron","year":"2018","unstructured":"Ambron E, Miller A, Kuchenbecker KJ, Buxbaum LJ, Coslett HB (2018) Immersive low-cost virtual reality treatment for phantom limb pain: evidence from two cases. Front Neurol. https:\/\/doi.org\/10.3389\/fneur.2018.00067","journal-title":"Front Neurol"},{"issue":"12","key":"741_CR3","doi-asserted-by":"publisher","first-page":"1100","DOI":"10.1177\/15459683211054164","volume":"35","author":"E Ambron","year":"2021","unstructured":"Ambron E, Buxbaum LJ, Miller A, Stoll H, Kuchenbecker KJ, Coslett HB (2021) Virtual reality treatment displaying the missing leg improves phantom limb pain: a small clinical trial. Neurorehabil Neural Repair 35(12):1100\u20131111. https:\/\/doi.org\/10.1177\/15459683211054164","journal-title":"Neurorehabil Neural Repair"},{"issue":"3","key":"741_CR4","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1080\/03093640600994581","volume":"31","author":"EA Biddiss","year":"2007","unstructured":"Biddiss EA, Chau TT (2007) Upper limb prosthesis use and abandonment: a survey of the last 25 years. Prosthet Orthot Int 31(3):236\u2013257. https:\/\/doi.org\/10.1080\/03093640600994581","journal-title":"Prosthet Orthot Int"},{"key":"741_CR5","doi-asserted-by":"publisher","unstructured":"Braza DW, Martin JNY (2020) Chapter 119\u2014upper limb amputations. In: Essentials of physical medicine and rehabilitation (4th edn), Elsevier, Philadelphia, pp 651\u2013657. https:\/\/doi.org\/10.1016\/B978-0-323-54947-9.00119-X","DOI":"10.1016\/B978-0-323-54947-9.00119-X"},{"key":"741_CR6","first-page":"751","volume-title":"Intell Comput Methodol","author":"D Buongiorno","year":"2019","unstructured":"Buongiorno D, Cascarano GD, Brunetti A, De Feudis I, Bevilacqua V (2019) A survey on deep learning in electromyographic signal analysis. In: Huang D-S, Huang Z-K, Hussain A (eds) Intell Comput Methodol. Springer, Cham, pp 751\u2013761"},{"issue":"7\u20138","key":"741_CR7","first-page":"3","volume":"14","author":"BL Chau","year":"2017","unstructured":"Chau BL, Phelan I, Ta PA, Humbert SE, Hata J, Tran DA (2017) Immersive virtual reality therapy with myoelectric control for treatment-resistant phantom limb pain: case report. Innov Clin Neurosci 14(7\u20138):3\u20137","journal-title":"Innov Clin Neurosci"},{"key":"741_CR8","doi-asserted-by":"crossref","unstructured":"Cho K, van Merrienboer B, Bahdanau D, Bengio Y (2014) On the properties of neural machine translation: encoder-decoder approaches. arXiv. https:\/\/arxiv.org\/abs\/1409.1259","DOI":"10.3115\/v1\/W14-4012"},{"issue":"4","key":"741_CR9","doi-asserted-by":"publisher","first-page":"760","DOI":"10.1109\/TNSRE.2019.2896269","volume":"27","author":"U C\u00f4t\u00e9-Allard","year":"2019","unstructured":"C\u00f4t\u00e9-Allard U, Fall CL, Drouin A, Campeau-Lecours A, Gosselin C, Glette K, Laviolette F, Gosselin B (2019) Deep learning for electromyographic hand gesture signal classification using transfer learning. IEEE Trans Neural Syst Rehabil Eng 27(4):760\u2013771. https:\/\/doi.org\/10.1109\/TNSRE.2019.2896269","journal-title":"IEEE Trans Neural Syst Rehabil Eng"},{"issue":"4","key":"741_CR10","doi-asserted-by":"publisher","first-page":"595","DOI":"10.3233\/NRE-171447","volume":"40","author":"J Dunn","year":"2017","unstructured":"Dunn J, Yeo E, Moghaddampour P, Chau B, Humbert S (2017) Virtual and augmented reality in the treatment of phantom limb pain: a literature review. NeuroRehabilitation 40(4):595\u2013601. https:\/\/doi.org\/10.3233\/NRE-171447","journal-title":"NeuroRehabilitation"},{"issue":"3","key":"741_CR11","doi-asserted-by":"publisher","first-page":"458","DOI":"10.3390\/s17030458","volume":"17","author":"Y Du","year":"2017","unstructured":"Du Y, Jin W, Wei W, Hu Y, Geng W (2017) Surface EMG-based inter-session gesture recognition enhanced by deep domain adaptation. Sensors 17(3):458","journal-title":"Sensors"},{"issue":"8","key":"741_CR12","doi-asserted-by":"publisher","first-page":"0220899","DOI":"10.1371\/journal.pone.0220899","volume":"14","author":"AW Franzke","year":"2019","unstructured":"Franzke AW, Kristoffersen MB, Bongers RM, Murgia A, Pobatschnig B, Unglaube F, van der Sluis CK (2019) Users\u2019 and therapists\u2019 perceptions of myoelectric multi-function upper limb prostheses with conventional and pattern recognition control. PLoS ONE 14(8):0220899. https:\/\/doi.org\/10.1371\/journal.pone.0220899","journal-title":"PLoS ONE"},{"key":"741_CR13","doi-asserted-by":"publisher","first-page":"481","DOI":"10.1016\/j.patcog.2015.09.023","volume":"51","author":"S Garrido-Jurado","year":"2016","unstructured":"Garrido-Jurado S, Mu\u00f1oz-Salinas R, Madrid-Cuevas FJ, Medina-Carnicer R (2016) Generation of fiducial marker dictionaries using mixed integer linear programming. Pattern Recognit 51:481\u2013491. https:\/\/doi.org\/10.1016\/j.patcog.2015.09.023","journal-title":"Pattern Recognit"},{"key":"741_CR14","doi-asserted-by":"publisher","DOI":"10.1186\/s12984-021-00878-4","author":"A Heerschop","year":"2021","unstructured":"Heerschop A, van der Sluis CK, Bongers RM (2021) Transfer of mode switching performance: from training to upper-limb prosthesis use. J NeuroEng Rehabil. https:\/\/doi.org\/10.1186\/s12984-021-00878-4","journal-title":"J NeuroEng Rehabil"},{"issue":"8","key":"741_CR15","doi-asserted-by":"publisher","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","volume":"9","author":"S Hochreiter","year":"1997","unstructured":"Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735\u20131780","journal-title":"Neural Comput"},{"key":"741_CR16","doi-asserted-by":"publisher","unstructured":"Koskim\u00e4ki H, Siirtola P, R\u00f6ning J (2017) MyoGym: introducing an open gym data set for activity recognition collected using myo armband. In: UbiComp\u201917: proceedings of the 2017 ACM international joint conference on pervasive and ubiquitous computing and proceedings of the 2017 ACM international symposium on wearable computers, pp 537\u2013546. https:\/\/doi.org\/10.1145\/3123024.3124400","DOI":"10.1145\/3123024.3124400"},{"issue":"2","key":"741_CR17","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1177\/0309364620972258","volume":"45","author":"CL McDonald","year":"2020","unstructured":"McDonald CL, Westcott-McCoy S, Weaver MR, Haagsma J, Kartin D (2020) Global prevalence of traumatic non-fatal limb amputation. Prosthet Orthot Int 45(2):105\u2013114. https:\/\/doi.org\/10.1177\/0309364620972258","journal-title":"Prosthet Orthot Int"},{"key":"741_CR18","doi-asserted-by":"publisher","DOI":"10.3390\/s20226451","author":"N Nasri","year":"2020","unstructured":"Nasri N, Orts-Escolano S, Cazorla M (2020) An SEMG-controlled 3d game for rehabilitation therapies: real-time time hand gesture recognition using deep learning techniques. Sensors. https:\/\/doi.org\/10.3390\/s20226451","journal-title":"Sensors"},{"key":"741_CR19","doi-asserted-by":"publisher","unstructured":"Olson E (2011) AprilTag: a robust and flexible visual fiducial system. In: Proceedings of the IEEE international conference on robotics and automation (ICRA), Shanghai, China, May 2011. IEEE, pp 3400\u20133407. https:\/\/doi.org\/10.1109\/ICRA.2011.5979561","DOI":"10.1109\/ICRA.2011.5979561"},{"key":"741_CR20","doi-asserted-by":"publisher","unstructured":"Phelan I, Arden M, Matsangidou M, Carrion-Plaza A, Lindley S (2021) Designing a virtual reality myoelectric prosthesis training system for amputees. In: Extended abstracts of the 2021 CHI conference on human factors in computing systems. CHI EA \u201921. Association for Computing Machinery, New York, NY, USA. https:\/\/doi.org\/10.1145\/3411763.3443454","DOI":"10.1145\/3411763.3443454"},{"key":"741_CR21","doi-asserted-by":"publisher","first-page":"0186132","DOI":"10.1371\/journal.pone.0186132","volume":"12","author":"S Pizzolato","year":"2017","unstructured":"Pizzolato S, Tagliapietra L, Cognolato M, Reggiani M, M\u00fcller H, Atzori M (2017) Comparison of six electromyography acquisition setups on hand movement classification tasks. PLoS ONE 12:0186132. https:\/\/doi.org\/10.1371\/journal.pone.0186132","journal-title":"PLoS ONE"},{"key":"741_CR22","doi-asserted-by":"publisher","DOI":"10.3390\/s20040969","author":"B Rim","year":"2020","unstructured":"Rim B, Sung N-J, Min S, Hong M (2020) Deep learning in physiological signal data: a survey. Sensors. https:\/\/doi.org\/10.3390\/s20040969","journal-title":"Sensors"},{"key":"741_CR23","doi-asserted-by":"publisher","first-page":"38","DOI":"10.1016\/j.imavis.2018.05.004","volume":"76","author":"FJ Romero-Ramirez","year":"2018","unstructured":"Romero-Ramirez FJ, Mu\u00f1oz-Salinas R, Medina-Carnicer R (2018) Speeded up detection of squared fiducial markers. Image Vis Comput 76:38\u201347. https:\/\/doi.org\/10.1016\/j.imavis.2018.05.004","journal-title":"Image Vis Comput"},{"issue":"10","key":"741_CR24","doi-asserted-by":"publisher","first-page":"2051","DOI":"10.1093\/pm\/pnz121","volume":"20","author":"T Rutledge","year":"2019","unstructured":"Rutledge T, Velez D, Depp C, McQuaid JR, Wong G, Jones RCW, Atkinson JH, Giap B, Quan A, Giap H (2019) A virtual reality intervention for the treatment of phantom limb pain: development and feasibility results. Pain Med 20(10):2051\u20132059. https:\/\/doi.org\/10.1093\/pm\/pnz121","journal-title":"Pain Med"},{"key":"741_CR25","doi-asserted-by":"publisher","DOI":"10.1080\/09638288.2020.1866684","author":"S Salminger","year":"2020","unstructured":"Salminger S, Stino H, Pichler LH, Gstoettner C, Sturma A, Mayer JA, Szivak M, Aszmann OC (2020) Current rates of prosthetic usage in upper-limb amputees\u2014have innovations had an impact on device acceptance? Disabil Rehabil. https:\/\/doi.org\/10.1080\/09638288.2020.1866684","journal-title":"Disabil Rehabil"},{"key":"741_CR26","doi-asserted-by":"publisher","unstructured":"Semmlow JL, Griffel B (2014) Biosignal and medical image processing, 3rd edn. CRC Press, Boca Raton. ISBN: 9780429099656. https:\/\/doi.org\/10.1201\/b16584","DOI":"10.1201\/b16584"},{"key":"741_CR27","doi-asserted-by":"publisher","DOI":"10.3389\/fneur.2020.00876","author":"X Tong","year":"2020","unstructured":"Tong X, Wang X, Cai Y, Gromala D, Williamson O, Fan B, Wei K (2020) I dreamed of my hands and arms moving again: a case series investigating the effect of immersive virtual reality on phantom limb pain alleviation. Front Neurol. https:\/\/doi.org\/10.3389\/fneur.2020.00876","journal-title":"Front Neurol"},{"key":"741_CR28","doi-asserted-by":"crossref","unstructured":"Wang J, Olson E (2016) AprilTag 2: efficient and robust fiducial detection. In: Proceedings of the IEEE\/RSJ international conference on intelligent robots and systems (IROS)","DOI":"10.1109\/IROS.2016.7759617"},{"issue":"3","key":"741_CR29","doi-asserted-by":"publisher","first-page":"512","DOI":"10.1109\/JAS.2021.1003865","volume":"8","author":"D Xiong","year":"2021","unstructured":"Xiong D, Zhang D, Zhao X, Zhao Y (2021) Deep learning for EMG-based human-machine interaction: a review. IEEE\/CAA J Autom Sin 8(3):512\u2013533. https:\/\/doi.org\/10.1109\/JAS.2021.1003865","journal-title":"IEEE\/CAA J Autom Sin"},{"issue":"3","key":"741_CR30","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1080\/03093640208726650","volume":"26","author":"K Yi\u011fiter","year":"2002","unstructured":"Yi\u011fiter K, \u015eener G, Erbah\u00e7eci F, Bayar K, \u00dclger OG, Akdo\u011fan S (2002) A comparison of traditional prosthetic training versus proprioceptive neuromuscular facilitation resistive gait training with trans-femoral amputees. Prosthet Orthot Int 26(3):213\u2013217. https:\/\/doi.org\/10.1080\/03093640208726650","journal-title":"Prosthet Orthot Int"}],"container-title":["Virtual Reality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10055-022-00741-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10055-022-00741-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10055-022-00741-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,29]],"date-time":"2023-11-29T10:06:25Z","timestamp":1701252385000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10055-022-00741-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,26]]},"references-count":30,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2023,12]]}},"alternative-id":["741"],"URL":"https:\/\/doi.org\/10.1007\/s10055-022-00741-4","relation":{},"ISSN":["1359-4338","1434-9957"],"issn-type":[{"value":"1359-4338","type":"print"},{"value":"1434-9957","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,26]]},"assertion":[{"value":"18 February 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 December 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 December 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}