{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T13:45:53Z","timestamp":1774964753588,"version":"3.50.1"},"reference-count":52,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2024,8,7]],"date-time":"2024-08-07T00:00:00Z","timestamp":1722988800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000780","name":"SUN\u2014the European Union\u2019s Horizon Europe research and innovation program","doi-asserted-by":"publisher","award":["101092612"],"award-info":[{"award-number":["101092612"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>Manipulation involves both fine tactile feedback, with dynamic transients perceived by fingerpad mechanoreceptors, and kinaesthetic force feedback, involving the whole hand musculoskeletal structure. In teleoperation experiments, these fundamental aspects are usually divided between different setups at the operator side: those making use of lightweight gloves and optical tracking systems, oriented toward tactile-only feedback, and those implementing exoskeletons or grounded manipulators as haptic devices delivering kinaesthetic force feedback. At the level of hand interfaces, exoskeletons providing kinaesthetic force feedback undergo a trade-off between maximum rendered forces and bandpass of the embedded actuators, making these systems unable to properly render tactile feedback. To overcome these limitations, here, we investigate a full upper limb exoskeleton, covering all the upper limb body segments from shoulder to finger phalanxes, coupled with linear voice coil actuators at the fingertips. These are developed to render wide-bandwidth tactile feedback together with the kinaesthetic force feedback provided by the hand exoskeleton. We investigate the system in a pick-and-place teleoperation task, under two different feedback conditions (visual-only and visuo-haptic). The performance based on measured interaction forces and the number of correct trials are evaluated and compared. The study demonstrates the overall feasibility and effectiveness of a complex full upper limb exoskeleton (seven limb-actuated DoFs plus five hand DoFs) capable of combined kinaesthetic and tactile haptic feedback. Quantitative results show significant performance improvements when haptic feedback is provided, in particular for the mean and peak exerted forces, and for the correct rate of the pick-and-place task.<\/jats:p>","DOI":"10.3390\/robotics13080119","type":"journal-article","created":{"date-parts":[[2024,8,8]],"date-time":"2024-08-08T07:01:25Z","timestamp":1723100485000},"page":"119","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Hand Teleoperation with Combined Kinaesthetic and Tactile Feedback: A Full Upper Limb Exoskeleton Interface Enhanced by Tactile Linear Actuators"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8612-7085","authenticated-orcid":false,"given":"Daniele","family":"Leonardis","sequence":"first","affiliation":[{"name":"IIM Instute, Scuola Superiore Sant\u2019Anna of Pisa Italy, Via Alamanni 13b, 56010 Ghezzano, PI, Italy"}]},{"given":"Massimiliano","family":"Gabardi","sequence":"additional","affiliation":[{"name":"IIM Instute, Scuola Superiore Sant\u2019Anna of Pisa Italy, Via Alamanni 13b, 56010 Ghezzano, PI, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0331-7006","authenticated-orcid":false,"given":"Simone","family":"Marcheschi","sequence":"additional","affiliation":[{"name":"IIM Instute, Scuola Superiore Sant\u2019Anna of Pisa Italy, Via Alamanni 13b, 56010 Ghezzano, PI, Italy"}]},{"given":"Michele","family":"Barsotti","sequence":"additional","affiliation":[{"name":"IIM Instute, Scuola Superiore Sant\u2019Anna of Pisa Italy, Via Alamanni 13b, 56010 Ghezzano, PI, Italy"}]},{"given":"Francesco","family":"Porcini","sequence":"additional","affiliation":[{"name":"IIM Instute, Scuola Superiore Sant\u2019Anna of Pisa Italy, Via Alamanni 13b, 56010 Ghezzano, PI, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6183-0804","authenticated-orcid":false,"given":"Domenico","family":"Chiaradia","sequence":"additional","affiliation":[{"name":"IIM Instute, Scuola Superiore Sant\u2019Anna of Pisa Italy, Via Alamanni 13b, 56010 Ghezzano, PI, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7126-4113","authenticated-orcid":false,"given":"Antonio","family":"Frisoli","sequence":"additional","affiliation":[{"name":"IIM Instute, Scuola Superiore Sant\u2019Anna of Pisa Italy, Via Alamanni 13b, 56010 Ghezzano, PI, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2024,8,7]]},"reference":[{"key":"ref_1","unstructured":"(2023, July 15). Da Vinci. Intuitive Surgical Systems. Available online: https:\/\/www.intuitive.com\/en-us\/products-and-services\/da-vinci\/systems."},{"key":"ref_2","unstructured":"(2023, July 15). KHG, Kerntechnische Hilfsdienst GmbH. Available online: https:\/\/khgmbh.de."},{"key":"ref_3","unstructured":"Ministry of Defence, UK (2023, July 15). British Army Receives Pioneering Bomb Disposal Robots, Available online: https:\/\/www.gov.uk\/government\/news\/british-army-receives-pioneering-bomb-disposal-robots."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1012","DOI":"10.1109\/JPROC.2022.3180052","article-title":"Haptic feedback and force-based teleoperation in surgical robotics","volume":"110","author":"Patel","year":"2022","journal-title":"Proc. IEEE"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Porcini, F., Chiaradia, D., Marcheschi, S., Solazzi, M., and Frisoli, A. (August, January 31). Evaluation of an Exoskeleton-based Bimanual Teleoperation Architecture with Independently Passivated Slave Devices. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France.","DOI":"10.1109\/ICRA40945.2020.9197079"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1109\/THMS.2014.2303983","article-title":"Application of adaptive controllers in teleoperation systems: A survey","volume":"44","author":"Chan","year":"2014","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_7","unstructured":"Anderson, R., and Spong, M. (1989, January 14\u201319). Asymptotic stability for force reflecting teleoperators with time delays. Proceedings of the 1989 International Conference on Robotics and Automation, Scottsdale, AZ, USA."},{"key":"ref_8","unstructured":"Lawrence, D.A. (1992, January 16\u201318). Stability and transparency in bilateral teleoperation. Proceedings of the 31st IEEE Conference on Decision and Control, Tucson, AZ, USA."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1177\/0278364907084590","article-title":"Model-mediated telemanipulation","volume":"27","author":"Mitra","year":"2008","journal-title":"Int. J. Robot. Res."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Pacchierotti, C., Scheggi, S., Prattichizzo, D., and Misra, S. (2016). Haptic feedback for microrobotics applications: A review. Front. Robot. AI, 3.","DOI":"10.3389\/frobt.2016.00053"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"496","DOI":"10.1109\/TASE.2013.2245122","article-title":"A review of haptic feedback teleoperation systems for micromanipulation and microassembly","volume":"10","author":"Bolopion","year":"2013","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Hulin, T., Hertkorn, K., Kremer, P., Sch\u00e4tzle, S., Artigas, J., Sagardia, M., Zacharias, F., and Preusche, C. (2011, January 9\u201313). The DLR bimanual haptic device with optimized workspace. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980066"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"104338","DOI":"10.1016\/j.robot.2022.104338","article-title":"Bimanual telemanipulation with force and haptic feedback through an anthropomorphic avatar system","volume":"161","author":"Lenz","year":"2023","journal-title":"Robot. Auton. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Luo, R., Wang, C., Keil, C., Nguyen, D., Mayne, H., Alt, S., Schwarm, E., Mendoza, E., Pad\u0131r, T., and Whitney, J.P. (2023, January 1\u20135). Team Northeastern\u2019s approach to ANA XPRIZE Avatar final testing: A holistic approach to telepresence and lessons learned. Proceedings of the 2023 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Detroit, MI, USA.","DOI":"10.1109\/IROS55552.2023.10341475"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Park, S., Kim, J., Lee, H., Jo, M., Gong, D., Ju, D., Won, D., Kim, S., Oh, J., and Jang, H. (2023). A Whole-Body Integrated AVATAR System: Implementation of Telepresence With Intuitive Control and Immersive Feedback. IEEE Robot. Autom. Mag., 2\u201310.","DOI":"10.1109\/MRA.2023.3328512"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Cisneros-Lim\u00f3n, R., Dallard, A., Benallegue, M., Kaneko, K., Kaminaga, H., Gergondet, P., Tanguy, A., Singh, R.P., Sun, L., and Chen, Y. (2024). A cybernetic avatar system to embody human telepresence for connectivity, exploration, and skill transfer. Int. J. Soc. Robot., 1\u201328.","DOI":"10.1007\/s12369-023-01096-9"},{"key":"ref_17","unstructured":"Marques, J.M., Peng, J.C., Naughton, P., Zhu, Y., Nam, J.S., and Hauser, K. (June, January 29). Commodity Telepresence with Team AVATRINA\u2019s Nursebot in the ANA Avatar XPRIZE Finals. Proceedings of the 2nd Workshop Toward Robot Avatars, IEEE International Conference on Robotics and Automation (ICRA), London, UK."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1002\/rob.21895","article-title":"Remote mobile manipulation with the centauro robot: Full-body telepresence and autonomous operator assistance","volume":"37","author":"Klamt","year":"2019","journal-title":"J. Field Robot."},{"key":"ref_19","unstructured":"Mallwitz, M., Will, N., Teiwes, J., and Kirchner, E.A. (2015, January 11\u201313). The capio active upper body exoskeleton and its application for teleoperation. Proceedings of the 13th Symposium on Advanced Space Technologies in Robotics and Automation. ESA\/Estec Symposium on Advanced Space Technologies in Robotics and Automation (ASTRA-2015), Noordwijk, The Netherlands."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Sarac, M., Solazzi, M., Leonardis, D., Sotgiu, E., Bergamasco, M., and Frisoli, A. (2017). Design of an underactuated hand exoskeleton with joint estimation. Advances in Italian Mechanism Science, Springer.","DOI":"10.1007\/978-3-319-48375-7_11"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1109\/TOH.2018.2879812","article-title":"Toward whole-hand kinesthetic feedback: A survey of force feedback gloves","volume":"12","author":"Wang","year":"2018","journal-title":"IEEE Trans. Haptics"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Baik, S., Park, S., and Park, J. (2020). Haptic glove using tendon-driven soft robotic mechanism. Front. Bioeng. Biotechnol., 8.","DOI":"10.3389\/fbioe.2020.541105"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Hosseini, M., Seng\u00fcl, A., Pane, Y., De Schutter, J., and Bruyninck, H. (2018, January 27\u201331). Exoten-glove: A force-feedback haptic glove based on twisted string actuation system. Proceedings of the 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Nanjing, China.","DOI":"10.1109\/ROMAN.2018.8525637"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"3450","DOI":"10.1109\/TRO.2022.3172498","article-title":"So-EAGlove: VR haptic glove rendering softness sensation with force-tunable electrostatic adhesive brakes","volume":"38","author":"Xiong","year":"2022","journal-title":"IEEE Trans. Robot."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1109\/TOH.2019.2908636","article-title":"Passive force-feedback gloves with joint-based variable impedance using layer jamming","volume":"12","author":"Zhang","year":"2019","journal-title":"IEEE Trans. Haptics"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1007\/BF00236209","article-title":"Responses in glabrous skin mechanoreceptors during precision grip in humans","volume":"66","author":"Westling","year":"1987","journal-title":"Exp. Brain Res."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1007\/s10055-006-0021-y","article-title":"Identification of real objects under conditions similar to those in haptic displays: Providing spatially distributed information at the contact areas is more important than increasing the number of areas","volume":"9","author":"Jansson","year":"2006","journal-title":"Virtual Real."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1113\/jphysiol.1992.sp019142","article-title":"Independent control of human finger-tip forces at individual digits during precision lifting","volume":"450","author":"Edin","year":"1992","journal-title":"J. Physiol."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Preechayasomboon, P., and Rombokas, E. (2021). Haplets: Finger-worn wireless and low-encumbrance vibrotactile haptic feedback for virtual and augmented reality. Front. Virtual Real., 2.","DOI":"10.3389\/frvir.2021.738613"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1038\/s41928-022-00765-3","article-title":"A wireless haptic interface for programmable patterns of touch across large areas of the skin","volume":"5","author":"Jung","year":"2022","journal-title":"Nat. Electron."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1109\/TOH.2023.3266432","article-title":"Perceptual Localization Performance of the Whole Hand Vibrotactile Funneling Illusion","volume":"16","author":"Luo","year":"2023","journal-title":"IEEE Trans. Haptics"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1314","DOI":"10.1109\/TNSRE.2015.2500586","article-title":"Non-invasive, temporally discrete feedback of object contact and release improves grasp control of closed-loop myoelectric transradial prostheses","volume":"24","author":"Clemente","year":"2015","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Minamizawa, K., Fukamachi, S., Kajimoto, H., Kawakami, N., and Tachi, S. (2007, January 5\u20139). Gravity grabber: Wearable haptic display to present virtual mass sensation. Proceedings of the SIGGRAPH07: Special Interest Group on Computer Graphics and Interactive Techniques Conference, San Diego, CA, USA.","DOI":"10.1145\/1278280.1278289"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1109\/TOH.2017.2672969","article-title":"Three-dimensional skin deformation as force substitution: Wearable device design and performance during haptic exploration of virtual environments","volume":"10","author":"Schorr","year":"2017","journal-title":"IEEE Trans. Haptics"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1109\/TOH.2021.3104216","article-title":"Haptigami: A fingertip haptic interface with vibrotactile and 3-DoF cutaneous force feedback","volume":"15","author":"Giraud","year":"2021","journal-title":"IEEE Trans. Haptics"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1109\/TOH.2019.2921565","article-title":"Human\u2013robot team interaction through wearable haptics for cooperative manipulation","volume":"12","author":"Salvietti","year":"2019","journal-title":"IEEE Trans. Haptics"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1109\/TOH.2011.31","article-title":"Tool contact acceleration feedback for telerobotic surgery","volume":"4","author":"McMahan","year":"2011","journal-title":"IEEE Trans. Haptics"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"384","DOI":"10.1109\/TOH.2015.2445770","article-title":"Displaying sensed tactile cues with a fingertip haptic device","volume":"8","author":"Pacchierotti","year":"2015","journal-title":"IEEE Trans. Haptics"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"594","DOI":"10.1109\/TOH.2023.3274388","article-title":"A Mechanical Hand-Tracking System with Tactile Feedback Designed for Telemanipulation","volume":"16","author":"Palagi","year":"2023","journal-title":"IEEE Trans. Haptics"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Liarokapis, M.V., Artemiadis, P.K., and Kyriakopoulos, K.J. (2013, January 25\u201328). Telemanipulation with the DLR\/HIT II robot hand using a dataglove and a low cost force feedback device. Proceedings of the 21st Mediterranean Conference on Control and Automation, Platanias, Greece.","DOI":"10.1109\/MED.2013.6608758"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Martinez-Hernandez, U., Szollosy, M., Boorman, L.W., Kerdegari, H., and Prescott, T.J. (2017). Towards a wearable interface for immersive telepresence in robotics. Interactivity, Game Creation, Design, Learning, and Innovation, Proceedings of the 5th International Conference, ArtsIT 2016, and First International Conference, DLI 2016, Esbjerg, Denmark, 2\u20133 May 2016, Springer. Proceedings 5.","DOI":"10.1007\/978-3-319-55834-9_8"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Bimbo, J., Pacchierotti, C., Aggravi, M., Tsagarakis, N., and Prattichizzo, D. (2017, January 24\u201328). Teleoperation in cluttered environments using wearable haptic feedback. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8206180"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"103161","DOI":"10.1016\/j.mechatronics.2024.103161","article-title":"Innovative Multi Vibrotactile-Skin Stretch (MuViSS) haptic device for sensory motor feedback from a robotic prosthetic hand","volume":"99","author":"Campanelli","year":"2024","journal-title":"Mechatronics"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"760","DOI":"10.1109\/TOH.2023.3322559","article-title":"Tactile Feedback in Upper Limb Prosthetics: A Pilot Study on Trans-Radial Amputees Comparing Different Haptic Modalities","volume":"16","author":"Barontini","year":"2023","journal-title":"IEEE Trans. Haptics"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Pirondini, E., Coscia, M., Marcheschi, S., Roas, G., Salsedo, F., Frisoli, A., Bergamasco, M., and Micera, S. (2014). Evaluation of a new exoskeleton for upper limb post-stroke neuro-rehabilitation: Preliminary results. Replace, Repair, Restore, Relieve\u2013Bridging Clinical and Engineering Solutions in Neurorehabilitation, Springer.","DOI":"10.1007\/978-3-319-08072-7_91"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"2152","DOI":"10.1109\/LRA.2018.2810943","article-title":"WRES: A novel 3 DoF WRist ExoSkeleton with tendon-driven differential transmission for neuro-rehabilitation and teleoperation","volume":"3","author":"Buongiorno","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"2322","DOI":"10.1109\/LRA.2018.2807580","article-title":"Design and evaluation of a novel 5 DoF underactuated thumb-exoskeleton","volume":"3","author":"Gabardi","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Gabardi, M., Solazzi, M., Leonardis, D., and Frisoli, A. (2016, January 8\u201311). A new wearable fingertip haptic interface for the rendering of virtual shapes and surface features. Proceedings of the 2016 IEEE Haptics Symposium (HAPTICS), Philadelphia, PA, USA.","DOI":"10.1109\/HAPTICS.2016.7463168"},{"key":"ref_49","unstructured":"(2024, May 27). UR5, Universal Robots. Available online: https:\/\/www.universal-robots.com\/products\/ur5-robot\/."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1623","DOI":"10.1007\/s11012-020-01188-0","article-title":"CORA hand: A 3D printed robotic hand designed for robustness and compliance","volume":"55","author":"Leonardis","year":"2020","journal-title":"Meccanica"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1513","DOI":"10.1152\/jn.1988.60.4.1513","article-title":"Grip force adjustments evoked by load force perturbations of a grasped object","volume":"60","author":"Cole","year":"1988","journal-title":"J. Neurophysiol."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1109\/TOH.2016.2640291","article-title":"A 3-RSR haptic wearable device for rendering fingertip contact forces","volume":"10","author":"Leonardis","year":"2016","journal-title":"IEEE Trans. Haptics"}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/13\/8\/119\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:31:41Z","timestamp":1760110301000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/13\/8\/119"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,7]]},"references-count":52,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["robotics13080119"],"URL":"https:\/\/doi.org\/10.3390\/robotics13080119","relation":{},"ISSN":["2218-6581"],"issn-type":[{"value":"2218-6581","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,7]]}}}