{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T14:34:11Z","timestamp":1780583651839,"version":"3.54.1"},"reference-count":43,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2016,3,18]],"date-time":"2016-03-18T00:00:00Z","timestamp":1458259200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61403215"],"award-info":[{"award-number":["61403215"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100006606","name":"Natural Science Foundation of Tianjin","doi-asserted-by":"publisher","award":["13JCYBJC36600"],"award-info":[{"award-number":["13JCYBJC36600"]}],"id":[{"id":"10.13039\/501100006606","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National High-Tech R&amp;D Program of China (863 Program)","award":["2012AA041403"],"award-info":[{"award-number":["2012AA041403"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Disabilities after neural injury, such as stroke, bring tremendous burden to patients, families and society. Besides the conventional constrained-induced training with a paretic arm, bilateral rehabilitation training involves both the ipsilateral and contralateral sides of the neural injury, fitting well with the fact that both arms are needed in common activities of daily living (ADLs), and can promote good functional recovery. In this work, the fusion of a gesture sensor and a haptic sensor with force feedback capabilities has enabled a bilateral rehabilitation training therapy. The Leap Motion gesture sensor detects the motion of the healthy hand, and the omega.7 device can detect and assist the paretic hand, according to the designed cooperative task paradigm, as much as needed, with active force feedback to accomplish the manipulation task. A virtual scenario has been built up, and the motion and force data facilitate instantaneous visual and audio feedback, as well as further analysis of the functional capabilities of the patient. This task-oriented bimanual training paradigm recruits the sensory, motor and cognitive aspects of the patient into one loop, encourages the active involvement of the patients into rehabilitation training, strengthens the cooperation of both the healthy and impaired hands, challenges the dexterous manipulation capability of the paretic hand, suits easy of use at home or centralized institutions and, thus, promises effective potentials for rehabilitation training.<\/jats:p>","DOI":"10.3390\/s16030395","type":"journal-article","created":{"date-parts":[[2016,3,18]],"date-time":"2016-03-18T13:31:03Z","timestamp":1458307863000},"page":"395","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["Fusion of Haptic and Gesture Sensors for Rehabilitation of Bimanual Coordination and Dexterous Manipulation"],"prefix":"10.3390","volume":"16","author":[{"given":"Ningbo","family":"Yu","sequence":"first","affiliation":[{"name":"Institute of Robotics and Automatic Information Systems, Nankai University, Tianjin 300353, China"},{"name":"Tianjin Key Laboratory of Intelligent Robotics, Nankai University, Tianjin 300353, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chang","family":"Xu","sequence":"additional","affiliation":[{"name":"Institute of Robotics and Automatic Information Systems, Nankai University, Tianjin 300353, China"},{"name":"Tianjin Key Laboratory of Intelligent Robotics, Nankai University, Tianjin 300353, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huanshuai","family":"Li","sequence":"additional","affiliation":[{"name":"Institute of Robotics and Automatic Information Systems, Nankai University, Tianjin 300353, China"},{"name":"Tianjin Key Laboratory of Intelligent Robotics, Nankai University, Tianjin 300353, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kui","family":"Wang","sequence":"additional","affiliation":[{"name":"Institute of Robotics and Automatic Information Systems, Nankai University, Tianjin 300353, China"},{"name":"Tianjin Key Laboratory of Intelligent Robotics, Nankai University, Tianjin 300353, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Liancheng","family":"Wang","sequence":"additional","affiliation":[{"name":"Rehabilitation Center, Tianjin Hospital, Tianjin 300211, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingtai","family":"Liu","sequence":"additional","affiliation":[{"name":"Institute of Robotics and Automatic Information Systems, Nankai University, Tianjin 300353, China"},{"name":"Tianjin Key Laboratory of Intelligent Robotics, Nankai University, Tianjin 300353, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2016,3,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1016\/S1474-4422(13)70305-3","article-title":"Three-dimensional, task-specific robot therapy of the arm after stroke: A multicentre, parallel-group randomised trial","volume":"13","author":"Blanco","year":"2014","journal-title":"Lancet Neurol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"e18","DOI":"10.1161\/CIR.0b013e3182009701","article-title":"Heart disease and stroke statistics-2011 update: A report from the American Heart Association","volume":"123","author":"Roger","year":"2011","journal-title":"Circulation"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1310\/9KFM-KF81-P9A4-5WW0","article-title":"Robotic devices for movement therapy after stroke: Current status and challenges to clinical acceptance","volume":"8","author":"Lum","year":"2002","journal-title":"Top. Stroke Rehabil."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Yu, N., Wang, K., and Liu, J. (2014, January 5\u201310). Dexterous haptic interaction for functional rehabilitation and assessment of the upper limb. Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO), Bali, Indonesia.","DOI":"10.1109\/ROBIO.2014.7090521"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"14518","DOI":"10.1073\/pnas.222536799","article-title":"The role of ipsilateral premotor cortex in hand movement after stroke","volume":"99","author":"Rushworth","year":"2002","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1177\/1545968310370748","article-title":"Kinematic variables quantifying upper-extremity performance after stroke during reaching and drinking from a glass","volume":"25","author":"Murphy","year":"2011","journal-title":"Neurorehabil. Neural Repair"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"945","DOI":"10.1177\/1545968309338190","article-title":"Comparison of bilateral and unilateral training for upper extremity hemiparesis in stroke","volume":"23","author":"Stoykov","year":"2009","journal-title":"Neurorehabil. Neural Repair"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"16046","DOI":"10.3390\/s121216046","article-title":"Implementation of human-machine synchronization control for active rehabilitation using an inertia sensor","volume":"12","author":"Song","year":"2012","journal-title":"Sensors"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/J148v20n01_01","article-title":"Motor control and motor learning: Implications for treatment of individuals post stroke","volume":"20","author":"Gilmore","year":"2001","journal-title":"Phys. Occup. Ther. Geriatr."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1109\/86.662623","article-title":"Robot-aided neurorehabilitation","volume":"6","author":"Krebs","year":"1998","journal-title":"IEEE Trans. Rehabil. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1310\/tsr1506-521","article-title":"Functional restoration for the stroke survivor: Informing the efforts of engineers","volume":"15","author":"Patton","year":"2008","journal-title":"Top. Stroke Rehabil."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"6677","DOI":"10.3390\/s140406677","article-title":"An upper-limb power-assist exoskeleton using proportional myoelectric control","volume":"14","author":"Tang","year":"2014","journal-title":"Sensors"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wu, C., Yang, C., Chen, M., Lin, K., and Wu, L. (2013). Unilateral versus bilateral robot-assisted rehabilitation on arm-trunk control and functions post stroke: A randomized controlled trial. J. Neuroeng. Rehabil., 10.","DOI":"10.1186\/1743-0003-10-35"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2095","DOI":"10.1001\/jama.296.17.2095","article-title":"Effect of constraint-induced movement therapy on upper extremity function 3 to 9 months after stroke: The EXCITE randomized clinical trial","volume":"296","author":"Wolf","year":"2006","journal-title":"JAMA"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1109\/86.279267","article-title":"Robotic assist devices for bimanual physical therapy: Preliminary experiments","volume":"1","author":"Lum","year":"1993","journal-title":"IEEE Trans. Rehabil. Eng."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1109\/TOH.2012.39","article-title":"Simultaneous perception of forces and motions using bimanual interactions","volume":"5","author":"McAmis","year":"2012","journal-title":"IEEE Trans. Haptics"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"29","DOI":"10.3233\/NRE-2008-23104","article-title":"Bilateral arm training: Why and who benefits?","volume":"23","author":"Waller","year":"2008","journal-title":"NeuroRehabilitation"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1177\/1545968310380685","article-title":"Bilateral and unilateral arm training improve motor function through differing neuroplastic mechanisms: A single-blinded randomized controlled trial","volume":"25","author":"Whitall","year":"2011","journal-title":"Neurorehabil. Neural Repair"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"20097","DOI":"10.3390\/s150820097","article-title":"A framework to automate assessment of upper-limb motor function impairment: A feasibility study","volume":"15","author":"Otten","year":"2015","journal-title":"Sensors"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2613","DOI":"10.1161\/STROKEAHA.113.001969","article-title":"Unilateral versus bilateral upper limb training after stroke: The upper limb training after stroke clinical trial","volume":"44","author":"Peper","year":"2013","journal-title":"Stroke"},{"key":"ref_21","first-page":"663","article-title":"Development of robots for rehabilitation therapy: The Palo Alto VA\/Stanford experience","volume":"37","author":"Burgar","year":"2000","journal-title":"J. Rehabil. Res. Dev."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"952","DOI":"10.1053\/apmr.2001.33101","article-title":"Robot-assisted movement training compared with conventional therapy techniques for the rehabilitation of upper-limb motor function after stroke","volume":"83","author":"Lum","year":"2002","journal-title":"Arch. Phys. Med. Rehabil."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1016\/S0003-9993(02)04954-7","article-title":"Robot-assisted arm trainer for the passive and active practice of bilateral forearm and wrist movements in hemiparetic subjects","volume":"84","author":"Hesse","year":"2003","journal-title":"Arch. Phys. Med. Rehabil."},{"key":"ref_24","first-page":"9","article-title":"Combined transcranial direct current stimulation and robot-assisted arm training in subacute stroke patients: A pilot study","volume":"25","author":"Hesse","year":"2007","journal-title":"Restor. Neurol. Neurosci."},{"key":"ref_25","first-page":"99","article-title":"Effects of compliant coupling on cooperative and bimanual task performance","volume":"1","author":"McAmis","year":"2013","journal-title":"J. Rehabil. Rob."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1109\/7333.948460","article-title":"Virtual reality-enhanced stroke rehabilitation","volume":"9","author":"Jack","year":"2001","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"634","DOI":"10.1109\/TNSRE.2013.2293673","article-title":"Gesture therapy: An upper limb virtual reality-based motor rehabilitation platform","volume":"22","author":"Sucar","year":"2014","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Li, S., Frisoli, A., Avizzano, C.A., Ruffaldi, E., Lugo-Villeda, L., and Bergamasco, M. (2009, January 19\u201323). Bimanual haptic-desktop platform for upper-limb post-stroke rehabilitation: Practical trials. Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO), Guilin, China.","DOI":"10.1109\/ROBIO.2009.5420694"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"6380","DOI":"10.3390\/s130506380","article-title":"Analysis of the accuracy and robustness of the leap motion controller","volume":"13","author":"Weichert","year":"2013","journal-title":"Sensors"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Yu, N., Xu, C., Wang, K., Yang, Z., and Liu, J. (2015, January 8\u201312). Gesture-based telemanipulation of a humanoid robot for home service tasks. Proceedings of the IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER), Shenyang, China.","DOI":"10.1109\/CYBER.2015.7288241"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Xu, C., Li, H., Wang, K., Liu, J., and Yu, N. (2015, January 6\u20139). A bilateral rehabilitation method for arm coordination and manipulation function with gesture and haptic interfaces. Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO), Zhuhai, China.","DOI":"10.1109\/ROBIO.2015.7418785"},{"key":"ref_32","unstructured":"Bassily, D., Georgoulas, C., Guettler, J., Linner, T., and Bock, T. (2014, January 2\u20133). Intuitive and adaptive robotic arm manipulation using the leap motion controller. Proceedings of the 41st International Symposium on Robotics (ISR\/Robotik), Munich, Germany."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"3702","DOI":"10.3390\/s140203702","article-title":"An analysis of the precision and reliability of the leap motion sensor and its suitability for static and dynamic tracking","volume":"14","author":"Guna","year":"2014","journal-title":"Sensors"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"McNeely, W.A., Puterbaugh, K.D., and Troy, J.J. (2005, January 31). Six degree-of-freedom haptic rendering using voxel sampling. Proceedings of ACM SIGGRAPH Courses, New York, NY, USA.","DOI":"10.1145\/1198555.1198605"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Morris, D., Tan, H., Barbagli, F., Chang, T., and Salisbury, K. (2007, January 22\u201324). Haptic feedback enhances force skill learning. Proceedings of the Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC), Tsukuba, Japan.","DOI":"10.1109\/WHC.2007.65"},{"key":"ref_36","unstructured":"Fluet, M.C., Lambercy, O., and Gassert, R. (July, January 29). Upper limb assessment using a virtual peg insertion test. Proceedings of the IEEE International Conference on Rehabilitation Robotics (ICORR), Zurich, Switzerland."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1038\/415429a","article-title":"Humans integrate visual and haptic information in a statistically optimal fashion","volume":"415","author":"Ernst","year":"2002","journal-title":"Nature"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"446","DOI":"10.1038\/35106566","article-title":"The central nervous system stabilizes unstable dynamics by learning optimal impedance","volume":"414","author":"Burdet","year":"2001","journal-title":"Nature"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1653","DOI":"10.1016\/j.jbiomech.2007.01.022","article-title":"Manipulating the edge of instability","volume":"40","author":"Venkadesan","year":"2007","journal-title":"J. Biomech."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"235","DOI":"10.1080\/00222895.1984.10735319","article-title":"The timing of natural prehension movements","volume":"16","author":"Jeannerod","year":"1984","journal-title":"J. Mot. Behav."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"726","DOI":"10.1038\/nrn1744","article-title":"The neuroscience of grasping","volume":"6","author":"Castiello","year":"2005","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Metzger, J., Lambercy, O., Califfi, A., Dinacci, D., Petrillo, C., Rossi, P., Conti, F.M., and Gassert, R. (2014). Assessment-driven selection and adaptation of exercise difficulty in robot-assisted therapy: A pilot study with a hand rehabilitation robot. J. Neuroeng. Rehabil., 11.","DOI":"10.1186\/1743-0003-11-154"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1583","DOI":"10.1152\/jn.00320.2013","article-title":"Developmental improvements in dynamic control of fingertip forces last throughout childhood and into adolescence","volume":"110","author":"Dayanidhi","year":"2013","journal-title":"J. Neurophysiol."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/3\/395\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:20:55Z","timestamp":1760210455000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/16\/3\/395"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,3,18]]},"references-count":43,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2016,3]]}},"alternative-id":["s16030395"],"URL":"https:\/\/doi.org\/10.3390\/s16030395","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2016,3,18]]}}}