{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T02:51:52Z","timestamp":1771469512450,"version":"3.50.1"},"reference-count":35,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2022,11,12]],"date-time":"2022-11-12T00:00:00Z","timestamp":1668211200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100009473","name":"University of M\u00e1laga, the Ministerio de Ciencia, Innovaci\u00f3n y Universidades, Gobierno de Espa\u00f1a","doi-asserted-by":"publisher","award":["RTI2018-093421-B-I00"],"award-info":[{"award-number":["RTI2018-093421-B-I00"]}],"id":[{"id":"10.13039\/100009473","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100009473","name":"University of M\u00e1laga, the Ministerio de Ciencia, Innovaci\u00f3n y Universidades, Gobierno de Espa\u00f1a","doi-asserted-by":"publisher","award":["BES-2016-078237"],"award-info":[{"award-number":["BES-2016-078237"]}],"id":[{"id":"10.13039\/100009473","id-type":"DOI","asserted-by":"publisher"}]},{"name":"European Commission","award":["RTI2018-093421-B-I00"],"award-info":[{"award-number":["RTI2018-093421-B-I00"]}]},{"name":"European Commission","award":["BES-2016-078237"],"award-info":[{"award-number":["BES-2016-078237"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>There are physical Human\u2013Robot Interaction (pHRI) applications where the robot has to grab the human body, such as rescue or assistive robotics. Being able to precisely estimate the grasping location when grabbing a human limb is crucial to perform a safe manipulation of the human. Computer vision methods provide pre-grasp information with strong constraints imposed by the field environments. Force-based compliant control, after grasping, limits the amount of applied strength. On the other hand, valuable tactile and proprioceptive information can be obtained from the pHRI gripper, which can be used to better know the features of the human and the contact state between the human and the robot. This paper presents a novel dataset of tactile and kinesthetic data obtained from a robot gripper that grabs a human forearm. The dataset is collected with a three-fingered gripper with two underactuated fingers and a fixed finger with a high-resolution tactile sensor. A palpation procedure is performed to record the shape of the forearm and to recognize the bones and muscles in different sections. Moreover, an application for the use of the database is included. In particular, a fusion approach is used to estimate the actual grasped forearm section using both kinesthetic and tactile information on a regression deep-learning neural network. First, tactile and kinesthetic data are trained separately with Long Short-Term Memory (LSTM) neural networks, considering the data are sequential. Then, the outputs are fed to a Fusion neural network to enhance the estimation. The experiments conducted show good results in training both sources separately, with superior performance when the fusion approach is considered.<\/jats:p>","DOI":"10.3390\/s22228752","type":"journal-article","created":{"date-parts":[[2022,11,14]],"date-time":"2022-11-14T04:30:52Z","timestamp":1668400252000},"page":"8752","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Dataset with Tactile and Kinesthetic Information from a Human Forearm and Its Application to Deep Learning"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0006-6811","authenticated-orcid":false,"given":"Francisco","family":"Pastor","sequence":"first","affiliation":[{"name":"Robotics and Mechatronics Group, Escuela de Ingenier\u00edas Industriales, University of Malaga, 29071 M\u00e1laga, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1372-1395","authenticated-orcid":false,"given":"Da-hui","family":"Lin-Yang","sequence":"additional","affiliation":[{"name":"Robotics and Mechatronics Group, Escuela de Ingenier\u00edas Industriales, University of Malaga, 29071 M\u00e1laga, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5960-3453","authenticated-orcid":false,"given":"Jes\u00fas M.","family":"G\u00f3mez-de-Gabriel","sequence":"additional","affiliation":[{"name":"Robotics and Mechatronics Group, Escuela de Ingenier\u00edas Industriales, University of Malaga, 29071 M\u00e1laga, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3432-3230","authenticated-orcid":false,"given":"Alfonso J.","family":"Garc\u00eda-Cerezo","sequence":"additional","affiliation":[{"name":"Robotics and Mechatronics Group, Escuela de Ingenier\u00edas Industriales, University of Malaga, 29071 M\u00e1laga, Spain"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,11,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/j.promfg.2017.07.133","article-title":"Collaborative robots in e-waste management","volume":"11","author":"Renteria","year":"2017","journal-title":"Procedia Manuf."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1002\/rcs.1468","article-title":"Technical review of the da Vinci surgical telemanipulator","volume":"9","author":"Freschi","year":"2013","journal-title":"Int. J. Med. Robot. Comput. Assist. Surg."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1159\/000099863","article-title":"The Cyberknife: A frameless robotic system for radiosurgery","volume":"69","author":"Adler","year":"1997","journal-title":"Stereotact. Funct. Neurosurg."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kragic, D., Gustafson, J., Karaoguz, H., Jensfelt, P., and Krug, R. (2018, January 13\u201319). Interactive, Collaborative Robots: Challenges and Opportunities. Proceedings of the Twenty-Seventh International Joint Conference on Artificial Intelligence (IJCAI-18), Stockholm, Sweden.","DOI":"10.24963\/ijcai.2018\/3"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Ding, H., Schipper, M., and Matthias, B. (2013, January 24\u201326). Collaborative behavior design of industrial robots for multiple human-robot collaboration. Proceedings of the IEEE ISR 2013, Seoul, Korea.","DOI":"10.1109\/ISR.2013.6695707"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"G\u00f3mez-de Gabriel, J.M., Gandarias, J.M., P\u00e9rez-Maldonado, F.J., Garc\u00eda-N\u00fa\u00f1cz, F.J., Fern\u00e1ndez-Garc\u00eda, E.J., and Garc\u00eda-Cerezo, A.J. (2018, January 1\u20135). Methods for autonomous wristband placement with a search-and-rescue aerial manipulator. Proceedings of the 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.","DOI":"10.1109\/IROS.2018.8594202"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Hebbar, V., and Langbort, C. (2021). A Model for Tacit Communication in Collaborative Human-UAV Search-and-Rescue. Entropy, 23.","DOI":"10.3390\/e23081027"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Gull, M.A., Bai, S., and Bak, T. (2020). A review on design of upper limb exoskeletons. Robotics, 9.","DOI":"10.3390\/robotics9010016"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Stilli, A., Cremoni, A., Bianchi, M., Ridolfi, A., Gerii, F., Vannetti, F., Wurdemann, H.A., Allotta, B., and Althoefer, K. (2018, January 24\u201328). AirExGlove\u2014A novel pneumatic exoskeleton glove for adaptive hand rehabilitation in post-stroke patients. Proceedings of the 2018 IEEE International Conference on Soft Robotics (RoboSoft), Livorno, Italy.","DOI":"10.1109\/ROBOSOFT.2018.8405388"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kokubu, S., Wang, Y., Tort\u00f3s Vinocour, P.E., Lu, Y., Huang, S., Nishimura, R., Hsueh, Y.H., and Yu, W. (2022). Evaluation of Fiber-Reinforced Modular Soft Actuators for Individualized Soft Rehabilitation Gloves. Actuators, 11.","DOI":"10.3390\/act11030084"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"247","DOI":"10.2147\/MDER.S91102","article-title":"Myoelectric control of prosthetic hands: State-of-the-art review","volume":"9","author":"Geethanjali","year":"2016","journal-title":"Med. Devices"},{"key":"ref_12","first-page":"45","article-title":"An exoskeleton arm optimal configuration determination using inverse kinematics and genetic algorithm","volume":"21","year":"2019","journal-title":"Acta Bioeng. Biomech."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1619","DOI":"10.1109\/TRO.2020.3003230","article-title":"A review of tactile information: Perception and action through touch","volume":"36","author":"Li","year":"2020","journal-title":"IEEE Trans. Robot."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TRO.2009.2033627","article-title":"Tactile sensing\u2014From humans to humanoids","volume":"26","author":"Dahiya","year":"2009","journal-title":"IEEE Trans. Robot."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1439","DOI":"10.3758\/APP.71.7.1439","article-title":"Haptic perception: A tutorial","volume":"71","author":"Lederman","year":"2009","journal-title":"Atten. Percept. Psychophys."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1016\/j.mechatronics.2017.11.002","article-title":"Robotic tactile perception of object properties: A review","volume":"48","author":"Luo","year":"2017","journal-title":"Mechatronics"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"921","DOI":"10.1038\/nmat4731","article-title":"Robots with a sense of touch","volume":"15","author":"Bartolozzi","year":"2016","journal-title":"Nat. Mater."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2005902","DOI":"10.1002\/adma.202005902","article-title":"Recent progress in flexible tactile sensors for human-interactive systems: From sensors to advanced applications","volume":"33","author":"Pyo","year":"2021","journal-title":"Adv. Mater."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"5001","DOI":"10.1109\/JSEN.2015.2432127","article-title":"Novel tactile-sift descriptor for object shape recognition","volume":"15","author":"Luo","year":"2015","journal-title":"IEEE Sens. J."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"6872","DOI":"10.1109\/JSEN.2019.2912968","article-title":"CNN-based methods for object recognition with high-resolution tactile sensors","volume":"19","author":"Gandarias","year":"2019","journal-title":"IEEE Sens. J."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"656","DOI":"10.1109\/TIM.2016.2514779","article-title":"Object recognition using tactile measurements: Kernel sparse coding methods","volume":"65","author":"Liu","year":"2016","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Pastor, F., Gandarias, J.M., Garc\u00eda-Cerezo, A.J., and G\u00f3mez-de Gabriel, J.M. (2019). Using 3D convolutional neural networks for tactile object recognition with robotic palpation. Sensors, 19.","DOI":"10.3390\/s19245356"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zapata-Impata, B.S., Gil, P., and Torres, F. (2019). Learning spatio temporal tactile features with a ConvLSTM for the direction of slip detection. Sensors, 19.","DOI":"10.3390\/s19030523"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ballesteros, J., Pastor, F., G\u00f3mez-de Gabriel, J.M., Gandarias, J.M., Garc\u00eda-Cerezo, A.J., and Urdiales, C. (2020). Proprioceptive Estimation of Forces Using Underactuated Fingers for Robot-Initiated pHRI. Sensors, 20.","DOI":"10.3390\/s20102863"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Gandarias, J.M., Pastor, F., Mu\u00f1oz-Ram\u00edrez, A.J., Garc\u00eda-Cerezo, A.J., and G\u00f3mez-de Gabriel, J.M. (2019, January 3\u20138). Underactuated gripper with forearm roll estimation for human limbs manipulation in rescue robotics. Proceedings of the 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China.","DOI":"10.1109\/IROS40897.2019.8967953"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1109\/TOH.2016.2521378","article-title":"Single-grasp object classification and feature extraction with simple robot hands and tactile sensors","volume":"9","author":"Spiers","year":"2016","journal-title":"IEEE Trans. Haptics"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"231","DOI":"10.1109\/LRA.2020.3038377","article-title":"Bayesian and neural inference on lstm-based object recognition from tactile and kinesthetic information","volume":"6","author":"Pastor","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Wang, P., Liu, J., Hou, F., Chen, D., Xia, Z., and Guo, S. (October, January 27). Organization and understanding of a tactile information dataset TacAct for physical human-robot interaction. Proceedings of the 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic.","DOI":"10.1109\/IROS51168.2021.9636389"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"698","DOI":"10.1038\/s41586-019-1234-z","article-title":"Learning the signatures of the human grasp using a scalable tactile glove","volume":"569","author":"Sundaram","year":"2019","journal-title":"Nature"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"668","DOI":"10.1177\/0278364920907688","article-title":"Pressure distribution classification and segmentation of human hands in contact with the robot body","volume":"39","author":"Albini","year":"2020","journal-title":"Int. J. Robot. Res."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Kerzel, M., Strahl, E., Gaede, C., Gasanov, E., and Wermter, S. (2019, January 14\u201319). Neuro-robotic haptic object classification by active exploration on a novel dataset. Proceedings of the 2019 International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary.","DOI":"10.1109\/IJCNN.2019.8852359"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1525\/abt.2021.83.1.71","article-title":"BioDigital: Powering the World\u2019s Understanding of the Human Body","volume":"83","author":"Sack","year":"2021","journal-title":"Am. Biol. Teach."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"925","DOI":"10.1177\/02783640122068191","article-title":"Feature detection for haptic exploration with robotic fingers","volume":"20","author":"Okamura","year":"2001","journal-title":"Int. J. Robot. Res."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhang, F., Lai, C., and Chen, W. (2022). Weather Radar Echo Extrapolation Method Based on Deep Learning. Atmosphere, 13.","DOI":"10.3390\/atmos13050815"},{"key":"ref_35","first-page":"1","article-title":"Convolutional LSTM network: A machine learning approach for precipitation nowcasting","volume":"28","author":"Shi","year":"2015","journal-title":"Adv. Neural Inf. Process. Syst."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/22\/8752\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:17:02Z","timestamp":1760145422000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/22\/8752"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,12]]},"references-count":35,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2022,11]]}},"alternative-id":["s22228752"],"URL":"https:\/\/doi.org\/10.3390\/s22228752","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,12]]}}}