{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T16:25:23Z","timestamp":1776183923093,"version":"3.50.1"},"reference-count":42,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T00:00:00Z","timestamp":1731974400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["22K14212"],"award-info":[{"award-number":["22K14212"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurorobot."],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>When humans grasp an object, they are capable of recognizing its characteristics, such as its stiffness and shape, through the sensation of their hands. They can also determine their level of confidence in the estimated object properties. In this study, we developed a method for multi-fingered hands to estimate both physical and geometric properties, such as the stiffness and shape of an object. Their confidence levels were measured using proprioceptive signals, such as joint angles and velocity.<\/jats:p><\/jats:sec><jats:sec><jats:title>Method<\/jats:title><jats:p>We have developed a learning framework based on probabilistic inference that does not necessitate hyperparameters to maintain equilibrium between the estimation of diverse types of properties. Using this framework, we have implemented recurrent neural networks that estimate the stiffness and shape of grasped objects with their uncertainty in real time.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We demonstrated that the trained neural networks are capable of representing the confidence level of estimation that includes the degree of uncertainty and task difficulty in the form of variance and entropy.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>We believe that this approach will contribute to reliable state estimation. Our approach would also be able to combine with flexible object manipulation and probabilistic inference-based decision making.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fnbot.2024.1466630","type":"journal-article","created":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T06:15:16Z","timestamp":1731996916000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Learning-based object's stiffness and shape estimation with confidence level in multi-fingered hand grasping"],"prefix":"10.3389","volume":"18","author":[{"given":"Kyo","family":"Kutsuzawa","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Minami","family":"Matsumoto","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dai","family":"Owaki","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mitsuhiro","family":"Hayashibe","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2024,11,19]]},"reference":[{"key":"B1","doi-asserted-by":"crossref","first-page":"1985","DOI":"10.1109\/IROS.2013.6696620","article-title":"\u201cTeleimpedance control of a synergy-driven anthropomorphic hand,\u201d","volume-title":"2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems","author":"Ajoudani","year":"2013"},{"key":"B2","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1177\/0278364919887447","article-title":"Learning dexterous in-hand manipulation","volume":"39","author":"Andrychowicz","year":"2020","journal-title":"Int. J. Rob. Res"},{"key":"B3","doi-asserted-by":"publisher","first-page":"96","DOI":"10.3390\/electronics10010096","article-title":"Gaining a sense of touch object stiffness estimation using a soft gripper and neural networks","volume":"10","author":"Bednarek","year":"2021","journal-title":"Electronics"},{"key":"B4","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1109\/NER.2015.7146724","article-title":"\u201cHaptic slam for context-aware robotic hand prosthetics - simultaneous inference of hand pose and object shape using particle filters,\u201d","volume-title":"2015 7th International IEEE\/EMBS Conference on Neural Engineering (NER)","author":"Behbahani","year":"2015"},{"key":"B5","doi-asserted-by":"publisher","first-page":"4749","DOI":"10.1109\/LRA.2022.3152244","article-title":"Force-based simultaneous mapping and object reconstruction for robotic manipulation","volume":"7","author":"Bimbo","year":"2022","journal-title":"IEEE Robot. Automat. Lett"},{"key":"B6","first-page":"1","article-title":"\u201cWire grasping by using proximity and tactile sensors,\u201d","author":"Cirillo","year":"2022","journal-title":"2022 IEEE 5th International Conference on Industrial Cyber-Physical Systems (ICPS) (Coventry: IEEE)"},{"key":"B7","doi-asserted-by":"publisher","first-page":"92","DOI":"10.1016\/j.conengprac.2013.11.002","article-title":"Online stiffness estimation for robotic tasks with force observers","volume":"24","author":"Coutinho","year":"2014","journal-title":"Control Eng. Pract"},{"key":"B8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TRO.2009.2033627","article-title":"Tactile sensing\u2014from humans to humanoids","volume":"26","author":"Dahiya","year":"2010","journal-title":"IEEE Transact. Robot"},{"key":"B9","first-page":"853","article-title":"Transforming neural-net output levels to probability distributions","volume":"3","author":"Denker","year":"1990","journal-title":"Adv. Neur. Inf. Process. Syst"},{"key":"B10","doi-asserted-by":"publisher","first-page":"951","DOI":"10.1109\/LRA.2021.3056066","article-title":"Predictive uncertainty estimation using deep learning for soft robot multimodal sensing","volume":"6","author":"Ding","year":"2021","journal-title":"IEEE Robot. Automat. Lett"},{"key":"B11","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.robot.2012.07.021","article-title":"Design of a flexible tactile sensor for classification of rigid and deformable objects","volume":"62","author":"Drimus","year":"2014","journal-title":"Robot. Auton. Syst"},{"key":"B12","doi-asserted-by":"publisher","first-page":"862","DOI":"10.1016\/j.neubiorev.2016.06.022","article-title":"Active inference and learning","volume":"68","author":"Friston","year":"2016","journal-title":"Neurosci. Biobehav. Rev"},{"key":"B13","doi-asserted-by":"crossref","first-page":"536","DOI":"10.1109\/ICRA.2016.7487176","article-title":"\u201cDeep learning for tactile understanding from visual and haptic data,\u201d","author":"Gao","year":"2016","journal-title":"2016 IEEE International Conference on Robotics and Automation (ICRA) (Stockholm: IEEE)"},{"key":"B14","doi-asserted-by":"publisher","first-page":"1513","DOI":"10.1007\/s10462-023-10562-9","article-title":"A survey of uncertainty in deep neural networks","volume":"56","author":"Gawlikowski","year":"2023","journal-title":"Artif. Intell. Rev"},{"key":"B15","first-page":"1861","article-title":"\u201cSoft actor-critic: off-policy maximum entropy deep reinforcement learning with a stochastic actor,\u201d","volume-title":"Proceedings of the 35th International Conference on Machine Learning (PMLR)","author":"Haarnoja","year":"2018"},{"key":"B16","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1016\/j.finel.2015.01.003","article-title":"Contact stiffness estimation in ANSYS using simplified models and artificial neural networks","volume":"97","author":"Hattori","year":"2015","journal-title":"Finite Elements Anal. Des"},{"key":"B17","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1016\/S0951-8320(96)00077-4","article-title":"Aleatory and epistemic uncertainty in probability elicitation with an example from hazardous waste management","volume":"54","author":"Hora","year":"1996","journal-title":"Reliabil. Eng. Syst. Saf"},{"key":"B18","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1007\/s10994-021-05946-3","article-title":"Aleatoric and epistemic uncertainty in machine learning: an introduction to concepts and methods","volume":"110","author":"H\u00fcllermeier","year":"2021","journal-title":"Mach. Learn"},{"key":"B19","doi-asserted-by":"publisher","first-page":"104461","DOI":"10.1016\/j.robot.2023.104461","article-title":"Online active and dynamic object shape exploration with a multi-fingered robotic hand","volume":"166","author":"Khadivar","year":"2023","journal-title":"Rob. Auton. Syst"},{"key":"B20","first-page":"23","article-title":"\u201cRobotic manipulation of elongated and elastic objects,\u201d","volume-title":"2019 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA)","author":"Kicki","year":"2019"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1312.6114","article-title":"Auto-encoding variational bayes","author":"Kingma","year":"2013","journal-title":"arXiv [preprint]"},{"key":"B22","doi-asserted-by":"crossref","first-page":"5227","DOI":"10.1109\/IECON.2017.8216904","article-title":"\u201cSequence-to-sequence models for trajectory deformation of dynamic manipulation,\u201d","volume-title":"IECON 2017 - 43rd Annual Conference of the IEEE Industrial Electronics Society","author":"Kutsuzawa","year":"2017"},{"key":"B23","doi-asserted-by":"publisher","first-page":"3606","DOI":"10.1109\/LRA.2018.2854958","article-title":"Sequence-to-sequence model for trajectory planning of nonprehensile manipulation including contact model","volume":"3","author":"Kutsuzawa","year":"2018","journal-title":"IEEE Robot. Automat. Lett."},{"key":"B24","doi-asserted-by":"publisher","first-page":"505","DOI":"10.1541\/ieejjia.9.505","article-title":"Simultaneous estimation of contact position and tool shape using an unscented particle filter","volume":"9","author":"Kutsuzawa","year":"2020","journal-title":"IEEJ J. Ind. Appl"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1805.00909","article-title":"Reinforcement learning and control as probabilistic inference: tutorial and review","author":"Levine","year":"2018","journal-title":"arXiv [preprint]"},{"key":"B26","doi-asserted-by":"publisher","first-page":"439","DOI":"10.1007\/s40799-018-0247-0","article-title":"A practical procedure for measuring the stiffness of foam like materials","volume":"42","author":"Marter","year":"2018","journal-title":"Exp. Tech"},{"key":"B27","doi-asserted-by":"crossref","first-page":"2645","DOI":"10.1109\/ROBOT.1994.351115","article-title":"\u201cParameter identification of contact conditions by active force sensing,\u201d","volume-title":"Proceedings of the 1994 IEEE International Conference on Robotics and Automation","author":"Mimura","year":"1994"},{"key":"B28","doi-asserted-by":"publisher","first-page":"259","DOI":"10.1109\/41.222648","article-title":"Torque sensorless control in multidegree-of-freedom manipulator","volume":"40","author":"Murakami","year":"1993","journal-title":"IEEE Transact. Ind. Electron"},{"key":"B29","first-page":"1101","article-title":"\u201cDeep dynamics models for learning dexterous manipulation,\u201d","volume-title":"3rd Conference on Robot Learning (CoRL 2019)","author":"Nagabandi","year":"2020"},{"key":"B30","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1109\/ICRA40945.2020.9196615","article-title":"\u201cTheoretical derivation and realization of adaptive grasping based on rotational incipient slip detection,\u201d","volume-title":"2020 IEEE International Conference on Robotics and Automation (ICRA)","author":"Narita","year":"2020"},{"key":"B31","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/ICNN.1994.374138","article-title":"\u201cEstimating the mean and variance of the target probability distribution,\u201d","author":"Nix","year":"1994","journal-title":"Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94)"},{"key":"B32","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1109\/3516.491410","article-title":"Motion control for advanced mechatronics","volume":"1","author":"Ohnishi","year":"1996","journal-title":"IEEE\/ASME Transact. Mechatron"},{"key":"B33","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1109\/TOH.2016.2521378","article-title":"Single-grasp object classification and feature extraction with simple robot hands and tactile sensors","volume":"9","author":"Spiers","year":"2016","journal-title":"IEEE Trans. Haptics"},{"key":"B34","doi-asserted-by":"crossref","first-page":"2620","DOI":"10.1109\/ICRA48506.2021.9561728","article-title":"\u201cUncertainty-aware self-supervised target-mass grasping of granular foods,\u201d","volume-title":"2021 IEEE International Conference on Robotics and Automation (ICRA)","author":"Takahashi","year":"2021"},{"key":"B35","doi-asserted-by":"crossref","first-page":"5026","DOI":"10.1109\/IROS.2012.6386109","article-title":"\u201cMuJoCo: a physics engine for model-based control,\u201d","volume-title":"2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems","author":"Todorov","year":"2012"},{"key":"B36","doi-asserted-by":"publisher","first-page":"444","DOI":"10.1109\/70.88059","article-title":"Object detection by tactile sensing method employing force\/torque information","volume":"5","author":"Tsujimura","year":"1989","journal-title":"IEEE Transact. Robot. Automat."},{"key":"B37","doi-asserted-by":"crossref","first-page":"7294","DOI":"10.1109\/ICRA40945.2020.9196640","article-title":"\u201cContact-based in-hand pose estimation using bayesian state estimation and particle filtering.\u201d","volume-title":"2020 IEEE International Conference on Robotics and Automation (ICRA)","author":"von Drigalski","year":"2020"},{"key":"B38","doi-asserted-by":"publisher","first-page":"3707","DOI":"10.3390\/s20133707","article-title":"Feature sensing and robotic grasping of objects with uncertain information: a review","volume":"20","author":"Wang","year":"2020","journal-title":"Sensors"},{"key":"B39","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1007\/s40534-016-0104-8","article-title":"Overview and outlook on railway track stiffness measurement","volume":"24","author":"Wang","year":"2016","journal-title":"J. Mod. Transport."},{"key":"B40","doi-asserted-by":"publisher","first-page":"1584","DOI":"10.1109\/TRO.2021.3060971","volume":"37","author":"Xu","year":"2021"},{"key":"B41","author":"Zakka","year":"2022"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.15607\/RSS.2023.XIX.016","article-title":"Learning fine-grained bimanual manipulation with low-cost hardware","author":"Zhao","year":"2023","journal-title":"arXiv [preprint]"}],"container-title":["Frontiers in Neurorobotics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2024.1466630\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,19]],"date-time":"2024-11-19T06:15:25Z","timestamp":1731996925000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2024.1466630\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,19]]},"references-count":42,"alternative-id":["10.3389\/fnbot.2024.1466630"],"URL":"https:\/\/doi.org\/10.3389\/fnbot.2024.1466630","relation":{},"ISSN":["1662-5218"],"issn-type":[{"value":"1662-5218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,19]]},"article-number":"1466630"}}