{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T21:25:21Z","timestamp":1783545921820,"version":"3.55.0"},"reference-count":64,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,6,29]],"date-time":"2023-06-29T00:00:00Z","timestamp":1687996800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>Individuals who have suffered neurotrauma like a stroke or brachial plexus injury often experience reduced limb functionality. Soft robotic exoskeletons have been successful in assisting rehabilitative treatment and improving activities of daily life but restoring dexterity for tasks such as playing musical instruments has proven challenging. This research presents a soft robotic hand exoskeleton coupled with machine learning algorithms to aid in relearning how to play the piano by \u2018feeling\u2019 the difference between correct and incorrect versions of the same song. The exoskeleton features piezoresistive sensor arrays with 16 taxels integrated into each fingertip. The hand exoskeleton was created as a single unit, with polyvinyl acid (PVA) used as a stent and later dissolved to construct the internal pressure chambers for the five individually actuated digits. Ten variations of a song were produced, one that was correct and nine containing rhythmic errors. To classify these song variations, Random Forest (RF), K-Nearest Neighbor (KNN), and Artificial Neural Network (ANN) algorithms were trained with data from the 80 taxels combined from the tactile sensors in the fingertips. Feeling the differences between correct and incorrect versions of the song was done with the exoskeleton independently and while the exoskeleton was worn by a person. Results demonstrated that the ANN algorithm had the highest classification accuracy of 97.13% \u00b1 2.00% with the human subject and 94.60% \u00b1 1.26% without. These findings highlight the potential of the smart exoskeleton to aid disabled individuals in relearning dexterous tasks like playing musical instruments.<\/jats:p>","DOI":"10.3389\/frobt.2023.1212768","type":"journal-article","created":{"date-parts":[[2023,6,29]],"date-time":"2023-06-29T05:31:17Z","timestamp":1688016677000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":19,"title":["Feeling the beat: a smart hand exoskeleton for learning to play musical instruments"],"prefix":"10.3389","volume":"10","author":[{"given":"Maohua","family":"Lin","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rudy","family":"Paul","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Moaed","family":"Abd","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James","family":"Jones","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Darryl","family":"Dieujuste","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Harvey","family":"Chim","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Erik D.","family":"Engeberg","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2023,6,29]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"4324","DOI":"10.3390\/s21134324","article-title":"Hierarchical tactile sensation integration from prosthetic fingertips enables multi-texture surface recognition","volume":"21","author":"Abd","year":"2021","journal-title":"Sensors"},{"key":"B2","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1016\/j.robot.2017.10.010","article-title":"The design and mathematical modelling of novel extensor bending pneumatic artificial muscles (EBPAMs) for soft exoskeletons","volume":"99","author":"Al-Fahaam","year":"2018","journal-title":"Robotics Aut. Syst."},{"key":"B3","doi-asserted-by":"crossref","first-page":"491","DOI":"10.1109\/ICSAE.2016.7810241","article-title":"Wrist rehabilitation exoskeleton robot based on pneumatic soft actuators","volume-title":"2016 international conference for students on applied engineering (ICSAE)","author":"Al-Fahaam","year":"2016"},{"key":"B4","doi-asserted-by":"publisher","first-page":"1213","DOI":"10.1017\/s0263574714001891","article-title":"Functional and usability assessment of a robotic exoskeleton arm to support activities of daily life","volume":"32","author":"Ambrosini","year":"2014","journal-title":"Robotica"},{"key":"B5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/ETFA.2015.7301464","article-title":"Motion control of a novel robotic wrist exoskeleton via pneumatic muscle actuators","volume-title":"2015 IEEE 20th conference on emerging technologies and factory automation (ETFA)","author":"Andrikopoulos","year":"2015"},{"key":"B6","doi-asserted-by":"crossref","first-page":"3902","DOI":"10.1109\/ICRA.2013.6631126","article-title":"A new hand exoskeleton device for rehabilitation using a three-layered sliding spring mechanism","volume-title":"2013 IEEE international conference on robotics and automation","author":"Arata","year":"2013"},{"key":"B7","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1108\/ijicc-10-2013-0043","article-title":"A pediatric robotic thumb exoskeleton for at-home rehabilitation: The isolated orthosis for thumb actuation (IOTA)","volume":"7","author":"Aubin","year":"2014","journal-title":"Int. J. Intelligent Comput. Cybern."},{"key":"B8","article-title":"Use of artificial neural network in pattern recognition","volume":"4","author":"Basu","year":"2010","journal-title":"Int. J. Softw. Eng. Its Appl."},{"key":"B9","doi-asserted-by":"publisher","first-page":"eaau0323","DOI":"10.1126\/science.aau0323","article-title":"Machine learning for data-driven discovery in solid Earth geoscience","volume":"363","author":"Bergen","year":"2019"},{"key":"B10","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/a:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"B11","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1186\/s12984-018-0391-x","article-title":"Assisting hand function after spinal cord injury with a fabric-based soft robotic glove","volume":"15","author":"Cappello","year":"2018","journal-title":"J. NeuroEngineering Rehabilitation"},{"key":"B12","doi-asserted-by":"publisher","first-page":"6353","DOI":"10.1109\/jsen.2022.3149988","article-title":"Effect of conductive thread and stitching parameters on the sensing performance of stitch-based pressure sensors for smart textile applications","volume":"22","author":"Choudhry","year":"2022","journal-title":"IEEE Sensors J."},{"key":"B13","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1177\/0278364915592961","article-title":"A novel type of compliant and underactuated robotic hand for dexterous grasping","volume":"35","author":"Deimel","year":"2016","journal-title":"Int. J. Rob. Res."},{"key":"B14","doi-asserted-by":"publisher","first-page":"2905","DOI":"10.3390\/polym12122905","article-title":"Polyethylene-carbon composite (Velostat\u00ae) based tactile sensor","volume":"12","author":"Dzedzickis","year":"2020","journal-title":"Polymers"},{"key":"B15","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/IROS.2018.8593666","article-title":"Soft biomimetic prosthetic hand: Design, manufacturing and preliminary examination","volume-title":"2018 IEEE\/RSJ international conference on intelligent robots and systems (IROS)","author":"Fras","year":"2018"},{"key":"B16","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1177\/001872087101300204","article-title":"The adult human hand: Some anthropometric and biomechanical considerations","volume":"13","author":"Garrett","year":"1971","journal-title":"Hum. Factors"},{"key":"B17","doi-asserted-by":"crossref","first-page":"731","DOI":"10.1109\/ROBOT.2008.4543292","article-title":"EMG-based control of an exoskeleton robot for human forearm and wrist motion assist","volume-title":"2008 IEEE international conference on robotics and automation","author":"Gopura","year":"2008"},{"key":"B18","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1016\/j.robot.2015.10.001","article-title":"Developments in hardware systems of active upper-limb exoskeleton robots: A review","volume":"75","author":"Gopura","year":"2016","journal-title":"Robotics Aut. Syst."},{"key":"B19","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1111\/dmcn.12304","article-title":"Pathophysiology of impaired hand function in children with unilateral cerebral palsy","volume":"55","author":"Gordon","year":"2013","journal-title":"Dev. Med. Child Neurology"},{"key":"B20","doi-asserted-by":"crossref","first-page":"815","DOI":"10.1109\/BIOROB.2016.7523728","article-title":"Sensorized soft robotic glove for continuous passive motion therapy","volume-title":"2016 6th IEEE international conference on biomedical robotics and biomechatronics (BioRob)","author":"Haghshenas-Jaryani","year":"2016"},{"key":"B21","doi-asserted-by":"publisher","first-page":"2107902","DOI":"10.1002\/adma.202107902","article-title":"Flexible electronics and devices as human\u2013machine interfaces for medical robotics","volume":"34","author":"Heng","year":"2022","journal-title":"Adv. Mat."},{"key":"B22","doi-asserted-by":"publisher","first-page":"591","DOI":"10.1682\/jrrd.2006.05.0044","article-title":"Principle and design of a mobile arm support for people with muscular weakness","volume":"43","author":"Herder","year":"2006","journal-title":"J. Rehabilitation Res. Dev."},{"key":"B23","doi-asserted-by":"publisher","first-page":"e0254524","DOI":"10.1371\/journal.pone.0254524","article-title":"A pneumatic random-access memory for controlling soft robots","volume":"16","author":"Hoang","year":"2021","journal-title":"Plos One"},{"key":"B24","doi-asserted-by":"publisher","first-page":"1000","DOI":"10.1109\/lra.2016.2530793","article-title":"The soft-sixthfinger: A wearable emg controlled robotic extra-finger for grasp compensation in chronic stroke patients","volume":"1","author":"Hussain","year":"2016","journal-title":"IEEE Robotics Automation Lett."},{"key":"B25","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1109\/MRA.2014.2362863","article-title":"Exo-glove: A wearable robot for the hand with a soft tendon routing system","volume":"22","author":"In","year":"2015","journal-title":"IEEE Robot. Autom. Mag."},{"key":"B26","doi-asserted-by":"publisher","first-page":"2121","DOI":"10.1016\/j.apmr.2008.04.022","article-title":"Effect of a gravity-compensating orthosis on reaching after stroke: Evaluation of the therapy assistant WREX","volume":"89","author":"Iwamuro","year":"2008","journal-title":"Archives Phys. Med. rehabilitation"},{"key":"B27","doi-asserted-by":"publisher","first-page":"697","DOI":"10.1109\/tro.2011.2178151","article-title":"Connecting a human limb to an exoskeleton","volume":"28","author":"Jarrass\u00e9","year":"2011","journal-title":"IEEE Trans. Robotics"},{"key":"B28","doi-asserted-by":"publisher","first-page":"947","DOI":"10.3389\/fnhum.2014.00947","article-title":"Robotic exoskeletons: A perspective for the rehabilitation of arm coordination in stroke patients","volume":"8","author":"Jarrass\u00e9","year":"2014","journal-title":"Front. Hum. Neurosci."},{"key":"B29","doi-asserted-by":"publisher","first-page":"976","DOI":"10.1109\/tnsre.2017.2676765","article-title":"Robust control of a cable-driven soft exoskeleton joint for intrinsic human-robot interaction","volume":"25","author":"Jarrett","year":"2017","journal-title":"IEEE Trans. Neural Syst. Rehabilitation Eng."},{"key":"B30","doi-asserted-by":"crossref","first-page":"3750","DOI":"10.1109\/ICRA.2016.7487562","article-title":"Development of a polymer-based tendon-driven wearable robotic hand","volume-title":"2016 IEEE international conference on robotics and automation (ICRA)","author":"Kang","year":"2016"},{"key":"B31","doi-asserted-by":"publisher","first-page":"7405205050p1","DOI":"10.5014\/ajot.2020.029454","article-title":"Stretching and splinting interventions for poststroke spasticity, hand function, and functional tasks: A systematic review","volume":"74","author":"Kerr","year":"2020","journal-title":"Am. J. Occup. Ther."},{"key":"B32","doi-asserted-by":"publisher","first-page":"1064","DOI":"10.1109\/tsmcb.2012.2185843","article-title":"An EMG-based control for an upper-limb power-assist exoskeleton robot","volume":"42","author":"Kiguchi","year":"2012","journal-title":"IEEE Trans. Syst. Man, Cybern. Part B Cybern."},{"key":"B33","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1186\/s12984-019-0570-4","article-title":"Bimanual coordination deficits in hands following stroke and their relationship with motor and functional performance","volume":"16","author":"Lai","year":"2019","journal-title":"J. Neuroengineering Rehabilitation"},{"key":"B34","doi-asserted-by":"crossref","first-page":"726","DOI":"10.1109\/ICORR.2017.8009334","article-title":"The eWrist\u2014a wearable wrist exoskeleton with sEMG-based force control for stroke rehabilitation","volume-title":"2017 international conference on rehabilitation robotics (ICORR)","author":"Lambelet","year":"2017"},{"key":"B35","doi-asserted-by":"publisher","first-page":"140","DOI":"10.1109\/toh.2015.2417570","article-title":"An EMG-controlled robotic hand exoskeleton for bilateral rehabilitation","volume":"8","author":"Leonardis","year":"2015","journal-title":"IEEE Trans. Haptics"},{"key":"B36","doi-asserted-by":"publisher","first-page":"111957","DOI":"10.1016\/j.sna.2020.111957","article-title":"High-force soft pneumatic actuators based on novel casting method for robotic applications","volume":"306","author":"Li","year":"2020","journal-title":"Sensors Actuators A Phys."},{"key":"B37","doi-asserted-by":"publisher","first-page":"066001","DOI":"10.1088\/1748-3190\/aad8d4","article-title":"Bio-inspired upper limb soft exoskeleton to reduce stroke-induced complications","volume":"13","author":"Li","year":"2018","journal-title":"Bioinspiration Biomimetics"},{"key":"B38","doi-asserted-by":"publisher","first-page":"1043","DOI":"10.1109\/JBHI.2013.2286455","article-title":"sEMG-based joint force control for an upper-limb power-assist exoskeleton robot","volume":"18","author":"Li","year":"2013","journal-title":"IEEE J. Biomed. Health Inf."},{"key":"B39","doi-asserted-by":"publisher","first-page":"112221","DOI":"10.1016\/j.sna.2020.112221","article-title":"Compliant underwater manipulator with integrated tactile sensor for nonlinear force feedback control of an SMA actuation system","volume":"315","author":"Lin","year":"2020","journal-title":"Sensors Actuators A Phys."},{"key":"B40","doi-asserted-by":"publisher","first-page":"S242","DOI":"10.1097\/phm.0b013e31826bcedb","article-title":"Robotic approaches for rehabilitation of hand function after stroke","volume":"91","author":"Lum","year":"2012","journal-title":"Am. J. Phys. Med. Rehabilitation"},{"key":"B41","doi-asserted-by":"crossref","first-page":"1015","DOI":"10.1109\/ICMA.2010.5588077","article-title":"Wire-driven mechanism for finger rehabilitation device","volume-title":"2010 IEEE international conference on mechatronics and automation","author":"Mohamaddan","year":"2010"},{"key":"B42","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-021-91702-5","article-title":"Soft pneumatic elbow exoskeleton reduces the muscle activity, metabolic cost and fatigue during holding and carrying of loads","volume":"11","author":"Nassour","year":"2021","journal-title":"Sci. Rep."},{"key":"B43","doi-asserted-by":"publisher","first-page":"976","DOI":"10.1109\/lra.2016.2528296","article-title":"Design and characterization of a lightweight and fully portable remote actuation system for use with a hand exoskeleton","volume":"1","author":"Nycz","year":"2016","journal-title":"IEEE Robotics Automation Lett."},{"key":"B44","doi-asserted-by":"crossref","first-page":"3889","DOI":"10.1109\/EMBC.2015.7319243","article-title":"Modeling and design of a tendon actuated soft robotic exoskeleton for hemiparetic upper limb rehabilitation","volume-title":"2015 37th annual international conference of the IEEE engineering in medicine and biology society (EMBC)","author":"Nycz","year":"2015"},{"key":"B45","doi-asserted-by":"crossref","first-page":"1672","DOI":"10.1109\/ICORR.2017.8009488","article-title":"A soft wearable robot for the shoulder: Design, characterization, and preliminary testing","volume-title":"2017 international conference on rehabilitation robotics (ICORR)","author":"O'neill","year":"2017"},{"key":"B46","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1109\/BIOROB.2018.8487677","article-title":"A vibrotactile feedback device for balance rehabilitation in the EksoGT\u2122 robotic exoskeleton","volume-title":"2018 7th IEEE international conference on biomedical robotics and biomechatronics (biorob)","author":"Pan","year":"2018"},{"key":"B47","doi-asserted-by":"publisher","first-page":"2123","DOI":"10.1007\/s00221-019-05580-5","article-title":"Dynamic bimanual force control in chronic stroke: Contribution of non-paretic and paretic hands","volume":"237","author":"Patel","year":"2019","journal-title":"Exp. Brain Res."},{"key":"B48","doi-asserted-by":"crossref","first-page":"1518","DOI":"10.1109\/BioRob.2012.6290676","article-title":"Index finger rehabilitation\/assistive device","volume-title":"2012 4th IEEE RAS and EMBS international conference on biomedical robotics and biomechatronics (BioRob)","author":"Polotto","year":"2012"},{"key":"B49","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1016\/j.robot.2014.08.014","article-title":"Soft robotic glove for combined assistance and at-home rehabilitation","volume":"73","author":"Polygerinos","year":"2015","journal-title":"Rob. Auton. Syst."},{"key":"B50","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1109\/memb.2010.936548","article-title":"Rehabilitation exoskeletal robotics","volume":"29","author":"Pons","year":"2010","journal-title":"IEEE Eng. Med. Biol. Mag."},{"key":"B51","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1017\/s0263574714000034","article-title":"Development of a whole arm wearable robotic exoskeleton for rehabilitation and to assist upper limb movements","volume":"33","author":"Rahman","year":"2015","journal-title":"Robotica"},{"key":"B52","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1682\/jrrd.2005.04.0070","article-title":"Passive exoskeletons for assisting limb movement","volume":"43","author":"Rahman","year":"2006","journal-title":"J. Rehabilitation Res. Dev."},{"key":"B53","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1109\/tnsre.2013.2250521","article-title":"Wrist rehabilitation in chronic stroke patients by means of adaptive, progressive robot-aided therapy","volume":"22","author":"Squeri","year":"2013","journal-title":"IEEE Trans. Neural Syst. Rehabilitation Eng."},{"key":"B54","doi-asserted-by":"publisher","first-page":"698","DOI":"10.1038\/s41586-019-1234-z","article-title":"Learning the signatures of the human grasp using a scalable tactile glove","volume":"569","author":"Sundaram","year":"2019"},{"key":"B55","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1109\/toh.2020.2993445","article-title":"Soft exoskeleton glove with human anatomical architecture: Production of dexterous finger movements and skillful piano performance","volume":"13","author":"Takahashi","year":"2020","journal-title":"IEEE Trans. Haptics"},{"key":"B56","doi-asserted-by":"publisher","first-page":"606","DOI":"10.1109\/tmrb.2021.3100625","article-title":"Review: Hand exoskeleton systems, clinical rehabilitation practices, and future prospects","volume":"3","author":"Tran","year":"2021","journal-title":"IEEE Trans. Med. Robotics Bionics"},{"key":"B57","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1109\/RoboSoft54090.2022.9762138","article-title":"Data-driven simulation framework for expressive piano playing by anthropomorphic hand with variable passive properties","volume-title":"2022 IEEE 5th international conference on soft robotics (RoboSoft)","author":"Wang","year":"2022"},{"key":"B58","doi-asserted-by":"publisher","first-page":"2100165","DOI":"10.1002\/aisy.202100165","article-title":"Control strategies for soft robot systems","volume":"4","author":"Wang","year":"2022","journal-title":"Adv. Intell. Syst."},{"key":"B59","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1016\/j.mechmachtheory.2015.12.010","article-title":"A novel motion-coupling design for a jointless tendon-driven finger exoskeleton for rehabilitation","volume":"99","author":"Yang","year":"2016","journal-title":"Mech. Mach. Theory"},{"key":"B60","doi-asserted-by":"publisher","first-page":"1600018","DOI":"10.1002\/admt.201600018","article-title":"Flexible and stretchable strain sensing actuator for wearable soft robotic applications","volume":"1","author":"Yeo","year":"2016","journal-title":"Adv. Mater. Technol."},{"key":"B61","doi-asserted-by":"publisher","first-page":"2007428","DOI":"10.1002\/adfm.202007428","article-title":"Wearable soft technologies for haptic sensing and feedback","volume":"31","author":"Yin","year":"2021","journal-title":"Adv. Funct. Mat."},{"key":"B63","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2990508","article-title":"Learning k for knn classification","volume":"8","author":"Zhang","year":"","journal-title":"ACM Trans. Intelligent Syst."},{"key":"B62","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2990508","article-title":"Learning k for knn classification","volume":"8","author":"Zhang","year":"","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"B64","doi-asserted-by":"publisher","first-page":"eaai7529","DOI":"10.1126\/scirobotics.aai7529","article-title":"Optoelectronically innervated soft prosthetic hand via stretchable optical waveguides","volume":"1","author":"Zhao","year":"2016","journal-title":"Sci. Robotics"}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2023.1212768\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,29]],"date-time":"2023-06-29T05:31:32Z","timestamp":1688016692000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2023.1212768\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,29]]},"references-count":64,"alternative-id":["10.3389\/frobt.2023.1212768"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2023.1212768","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,29]]},"article-number":"1212768"}}