{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,18]],"date-time":"2025-12-18T06:50:19Z","timestamp":1766040619598,"version":"3.48.0"},"reference-count":29,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,12,18]],"date-time":"2025-12-18T00:00:00Z","timestamp":1766016000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100005825","name":"National Institute of Food and Agriculture","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100005825","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>When a passively compliant hand grasps an object, slip events are often accompanied by flexion or extension of the finger or finger joints. This paper investigates whether a combination of orientation change and slip-induced vibration at the fingertip, as sensed by an inertial measurement unit (IMU), can be used as a slip indicator. Using a tendon-driven hand, which achieves passive compliance through underactuation, we performed 195 manipulation trials involving both slip and non-slip conditions. We then labeled this data automatically using motion-tracking data, and trained a convolutional neural network (CNN) to detect the slip events. Our results show that slip can be successfully detected from IMU data, even in the presence of other disturbances. This remains the case when deploying the trained network on data from a different gripper performing a new manipulation task on a previously unseen object.<\/jats:p>","DOI":"10.3389\/frobt.2025.1698591","type":"journal-article","created":{"date-parts":[[2025,12,18]],"date-time":"2025-12-18T06:45:30Z","timestamp":1766040330000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Slip detection for compliant robotic hands using inertial signals and deep learning"],"prefix":"10.3389","volume":"12","author":[{"given":"Miranda","family":"Cravetz","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Purva","family":"Vyas","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cindy","family":"Grimm","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Joseph R.","family":"Davidson","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2025,12,18]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1525","DOI":"10.1121\/1.1456514","article-title":"Acoustics of friction","volume":"111","author":"Akay","year":"2002","journal-title":"J. Acoust. Soc. Am."},{"key":"B2","article-title":"Algorithms for hyper-parameter optimization","volume":"24","author":"Bergstra","year":"2011","journal-title":"Adv. Neural Information Processing Systems"},{"key":"B3","first-page":"115","article-title":"Making a science of model search: hyperparameter optimization in hundreds of dimensions for vision architectures","volume-title":"International conference on machine learning","author":"Bergstra","year":"2013"},{"key":"B4","doi-asserted-by":"crossref","first-page":"510","DOI":"10.1109\/ICAR.2015.7251504","article-title":"The ycb object and model set: towards common benchmarks for manipulation research","volume-title":"2015 international conference on advanced robotics (ICAR)","author":"Calli","year":"2015"},{"key":"B5","doi-asserted-by":"crossref","DOI":"10.1109\/IROS51168.2021.9636341","article-title":"Towards intelligent fruit picking with in-hand sensing","volume-title":"2021 IEEE\/RSJ int\u2019l conf. on intelligent robots and systems (IROS)","author":"Dischinger","year":"2021"},{"key":"B6","doi-asserted-by":"publisher","first-page":"404","DOI":"10.1177\/0278364914564703","article-title":"Slip classification for dynamic tactile array sensors","volume":"35","author":"Heyneman","year":"2016","journal-title":"Int. J. Robotics Res."},{"key":"B7","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1109\/robot.1989.99981","article-title":"Sensing skin acceleration for slip and texture perception","author":"Howe","year":"1989","journal-title":"Proc. 1989 Int. Conf. Robotics Automation"},{"key":"B8","doi-asserted-by":"publisher","first-page":"209","DOI":"10.1115\/1.3111079","article-title":"Friction-induced vibration, chatter, squeal, and chaos\u2014part i: mechanics of contact and friction","volume":"47","author":"Ibrahim","year":"1994","journal-title":"Appl. Mech. Rev."},{"key":"B9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/HUMANOIDS.2018.8624929","article-title":"Comparison of three hand pose reconstruction algorithms using inertial and magnetic measurement units","volume-title":"2018 IEEE-RAS 18th international conference on humanoid robots (Humanoids)","author":"Kieliba","year":"2018"},{"key":"B10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TMAG.2024.3427630","article-title":"Imu-enabled robotic finger force estimation with modular soft actuators and virtual linkages","volume":"60","author":"Lin","year":"2024","journal-title":"IEEE Trans. Magnetics"},{"key":"B11","doi-asserted-by":"crossref","first-page":"925","DOI":"10.1109\/RoboSoft54090.2022.9762175","article-title":"Gelsight fin ray: incorporating tactile sensing into a soft compliant robotic gripper","volume-title":"2022 IEEE 5th international conference on soft robotics (RoboSoft)","author":"Liu","year":"2022"},{"key":"B12","doi-asserted-by":"publisher","first-page":"108904","DOI":"10.1016\/j.compag.2024.108904","article-title":"Soft bionic gripper with tactile sensing and slip detection for damage-free grasping of fragile fruits and vegetables","volume":"220","author":"Liu","year":"2024","journal-title":"Comput. Electron. Agric."},{"key":"B13","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1007\/bf00242913","article-title":"Control of grip force during restraint of an object held between finger and thumb: responses of cutaneous afferents from the digits","volume":"108","author":"Macefield","year":"1996","journal-title":"Exp. Brain Research"},{"key":"B14","doi-asserted-by":"crossref","first-page":"438","DOI":"10.1109\/SII.2019.8700328","article-title":"Array of accelerometers as a dynamic vibro-tactile sensing for assessing the slipping noise","volume-title":"2019 IEEE\/SICE international symposium on system integration (SII)","author":"Massalim","year":"2019"},{"key":"B15","article-title":"Geometry3d: 3d computational geometrics library","author":"Minghao","year":"2020"},{"key":"B16","doi-asserted-by":"publisher","first-page":"531","DOI":"10.1109\/icra40945.2020.9196615","article-title":"Theoretical derivation and realization of adaptive grasping based on rotational incipient slip detection","author":"Narita","year":"2020","journal-title":"Proc. 2020 Int. Conf. Robotics Automation"},{"key":"B17","doi-asserted-by":"publisher","first-page":"2689","DOI":"10.3390\/s21082689","article-title":"Soft grippers for automatic crop harvesting: a review","volume":"21","author":"Navas","year":"2021","journal-title":"Sensors"},{"key":"B18","doi-asserted-by":"publisher","first-page":"736","DOI":"10.1177\/0278364913514466","article-title":"A compliant, underactuated hand for robust manipulation","volume":"33","author":"Odhner","year":"2014","journal-title":"Int. J. Robotics Res."},{"key":"B19","doi-asserted-by":"publisher","first-page":"1067","DOI":"10.1109\/tro.2011.2162271","article-title":"Human-inspired robotic grasp control with tactile sensing","volume":"27","author":"Romano","year":"2011","journal-title":"IEEE Trans. Robotics"},{"key":"B20","doi-asserted-by":"publisher","first-page":"73027","DOI":"10.1109\/access.2020.2987849","article-title":"Methods and sensors for slip detection in robotics: a survey","volume":"8","author":"Romeo","year":"2020","journal-title":"IEEE Access"},{"key":"B21","doi-asserted-by":"publisher","first-page":"25973","DOI":"10.1109\/jsen.2021.3119060","article-title":"Incipient slip detection method with vision-based tactile sensor based on distribution force and deformation","volume":"21","author":"Ruomin","year":"2021","journal-title":"IEEE Sensors J."},{"key":"B22","doi-asserted-by":"crossref","first-page":"2728","DOI":"10.1109\/ICRA.2015.7139569","article-title":"Low-cost, fast and accurate reconstruction of robotic and human postures via imu measurements","volume-title":"2015 IEEE international conference on robotics and automation (ICRA)","author":"Santaera","year":"2015"},{"key":"B23","doi-asserted-by":"publisher","first-page":"1707035","DOI":"10.1002\/adma.201707035","article-title":"Soft robotic grippers","volume":"30","author":"Shintake","year":"2018","journal-title":"Adv. Materials"},{"key":"B24","doi-asserted-by":"publisher","first-page":"11","DOI":"10.3390\/robotics5020011","article-title":"State of the art robotic grippers and applications","volume":"5","author":"Tai","year":"2016","journal-title":"Robotics"},{"key":"B25","first-page":"9225","article-title":"Predicting fruit-pick success using a grasp classifier trained on a physical proxy","volume-title":"IEEE\/RJS international conference on intelligent robots and systems","author":"Velasquez","year":"2022"},{"key":"B26","doi-asserted-by":"publisher","first-page":"106705","DOI":"10.1016\/j.ymssp.2020.106705","article-title":"Friction-induced stick-slip vibration and its experimental validation","volume":"142","author":"Wang","year":"2020","journal-title":"Mech. Syst. Signal Process."},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.48550\/arxiv.2309.14279","article-title":"Spring-imu fusion based proprioception for feedback control of soft manipulators","author":"Yu","year":"2023","journal-title":"IEEE\/ASME Transactions Mechatronics"},{"key":"B28","doi-asserted-by":"publisher","first-page":"2762","DOI":"10.3390\/s17122762","article-title":"Gelsight: high-resolution robot tactile sensors for estimating geometry and force","volume":"17","author":"Yuan","year":"2017","journal-title":"Sensors"},{"key":"B29","doi-asserted-by":"publisher","first-page":"5483","DOI":"10.3390\/s22155483","article-title":"Learning-based slip detection for robotic fruit grasping and manipulation under leaf interference","volume":"22","author":"Zhou","year":"2022","journal-title":"Sensors"}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2025.1698591\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,18]],"date-time":"2025-12-18T06:45:33Z","timestamp":1766040333000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2025.1698591\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,18]]},"references-count":29,"alternative-id":["10.3389\/frobt.2025.1698591"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2025.1698591","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,12,18]]},"article-number":"1698591"}}