{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T20:19:11Z","timestamp":1777407551660,"version":"3.51.4"},"reference-count":40,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,2,28]],"date-time":"2024-02-28T00:00:00Z","timestamp":1709078400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neurorobot."],"abstract":"<jats:p>Humanoid grasping is a critical ability for anthropomorphic hand, and plays a significant role in the development of humanoid robots. In this article, we present a deep learning-based control framework for humanoid grasping, incorporating the dynamic contact process among the anthropomorphic hand, the object, and the environment. This method efficiently eliminates the constraints imposed by inaccessible grasping points on both the contact surface of the object and the table surface. To mimic human-like grasping movements, an underactuated anthropomorphic hand is utilized, which is designed based on human hand data. The utilization of hand gestures, rather than controlling each motor separately, has significantly decreased the control dimensionality. Additionally, a deep learning framework is used to select gestures and grasp actions. Our methodology, proven both in simulation and on real robot, exceeds the performance of static analysis-based methods, as measured by the standard grasp metric <jats:italic>Q<\/jats:italic><jats:sub>1<\/jats:sub>. It expands the range of objects the system can handle, effectively grasping thin items such as cards on tables, a task beyond the capabilities of previous methodologies.<\/jats:p>","DOI":"10.3389\/fnbot.2024.1349752","type":"journal-article","created":{"date-parts":[[2024,2,28]],"date-time":"2024-02-28T05:17:56Z","timestamp":1709097476000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Deep learning-based control framework for dynamic contact processes in humanoid grasping"],"prefix":"10.3389","volume":"18","author":[{"given":"Shaowen","family":"Cheng","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yongbin","family":"Jin","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hongtao","family":"Wang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2024,2,28]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1177\/0278364919887447","article-title":"Learning dexterous in-hand manipulation","volume":"39","author":"Andrychowicz","year":"2020","journal-title":"Int. J. Rob. Res"},{"key":"B2","doi-asserted-by":"publisher","first-page":"1484","DOI":"10.1177\/0278364918802346","article-title":"Picking, grasping, or scooping small objects lying on flat surfaces: a design approach","volume":"37","author":"Babin","year":"2018","journal-title":"Int. J. Rob. Res"},{"key":"B3","doi-asserted-by":"publisher","first-page":"348","DOI":"10.1109\/ROBOT.2000.844081","article-title":"Robotic grasping and contact: a review","author":"Bicchi","year":"2000","journal-title":"Proceedings of the IEEE International Conference of Robotics Automation"},{"key":"B4","doi-asserted-by":"publisher","first-page":"364","DOI":"10.1126\/science.aat8414","article-title":"Trends and challenges in robot manipulation","volume":"80","author":"Billard","year":"2019","journal-title":"Science"},{"key":"B5","doi-asserted-by":"publisher","first-page":"771","DOI":"10.1631\/jzus.A2200216","article-title":"Anthropomorphic hand based on twisted-string-driven da Vinci's mechanism for approaching human dexterity and power of grasp","volume":"23","author":"Bin Jin","year":"2022","journal-title":"J. Zhejiang Univ. Sci. A"},{"key":"B6","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1109\/TRO.2013.2289018","article-title":"Data-driven grasp synthesis-A survey","volume":"30","author":"Bohg","year":"2014","journal-title":"IEEE Trans. Robot"},{"key":"B7","doi-asserted-by":"publisher","first-page":"768","DOI":"10.1177\/0278364913518998","article-title":"Adaptive synergies for the design and control of the Pisa\/IIT SoftHand","volume":"33","author":"Catalano","year":"2014","journal-title":"Int. J. Rob. Res"},{"key":"B8","doi-asserted-by":"publisher","first-page":"5886","DOI":"10.1109\/IROS.2010.5650454","article-title":"The thumb: guidelines for a robotic design","author":"Chalon","year":"2010","journal-title":"IEEE\/RSJ 2010 International Conference Intelligent Robotics Systems IROS 2010 - Conference Proceedings"},{"key":"B9","first-page":"297","article-title":"A system for general in-hand object re-orientation","author":"Chen","year":"2022","journal-title":"Proceedings of the 5th Conference on Robot Learning, volume 164 of Proceedings of Machine Learning Research"},{"key":"B10","doi-asserted-by":"publisher","first-page":"269","DOI":"10.1109\/70.34763","article-title":"On grasp choice, grasp models, and the design of hands for manufacturing tasks","volume":"5","author":"Cutkosky","year":"1989","journal-title":"IEEE Trans. Robot. Autom"},{"key":"B11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/AERO.2012.6187268","article-title":"Robonaut 2 - Initial activities on-board the ISS","volume-title":"2012 IEEE Aerospace Conference","author":"Diftler","year":"2012"},{"key":"B12","doi-asserted-by":"publisher","first-page":"1021","DOI":"10.1177\/0278364914559753","article-title":"Exploitation of environmental constraints in human and robotic grasping","volume":"34","author":"Eppner","year":"2015","journal-title":"Int. J. Rob. Res"},{"key":"B13","doi-asserted-by":"publisher","first-page":"180","DOI":"10.1007\/978-3-319-94568-2_12","article-title":"Robotic grasping and manipulation competition: competitor feedback and lessons learned","volume":"816","author":"Falco","year":"2018","journal-title":"Commun. Comput. Inf. Sci"},{"key":"B14","doi-asserted-by":"publisher","first-page":"3929","DOI":"10.1109\/TRO.2023.3281153","article-title":"AnyGrasp: robust and efficient grasp perception in spatial and temporal domains","volume":"39","author":"Fang","year":"2023","journal-title":"IEEE Trans. Robot"},{"key":"B15","first-page":"2290","article-title":"Planning optimal grasps","volume-title":"Proceedings 1992 IEEE International Conference of Robotics Automation","author":"Ferrari","year":"1999"},{"key":"B16","doi-asserted-by":"publisher","first-page":"S23","DOI":"10.1038\/d41586-018-05093-1","article-title":"A gripping problem","volume":"557","author":"Hodson","year":"2018","journal-title":"Nature"},{"key":"B17","doi-asserted-by":"publisher","first-page":"6808","DOI":"10.1109\/ICRA.2014.6907864","article-title":"Real-Time behaviour synthesis for dynamic hand-manipulation","author":"Kumar","year":"2014","journal-title":"Proceedings - IEEE International Conference of Robotics Automation"},{"key":"B18","doi-asserted-by":"publisher","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"B19","doi-asserted-by":"publisher","first-page":"705","DOI":"10.1177\/0278364914549607","article-title":"Deep learning for detecting robotic grasps","volume":"34","author":"Lenz","year":"2015","journal-title":"Int. J. Rob. Res"},{"key":"B20","doi-asserted-by":"publisher","first-page":"352","DOI":"10.1016\/j.robot.2015.09.008","article-title":"Dexterous grasping under shape uncertainty","volume":"75","author":"Li","year":"2016","journal-title":"Rob. Auton. Syst"},{"key":"B21","doi-asserted-by":"publisher","first-page":"1174","DOI":"10.1109\/LRA.2021.3138545","article-title":"Multifingered grasping based on multimodal reinforcement learning","volume":"7","author":"Liang","year":"2022","journal-title":"IEEE Robot. Autom. Lett"},{"key":"B22","doi-asserted-by":"publisher","first-page":"1518","DOI":"10.1109\/IROS40897.2019.8968115","article-title":"Generating grasp poses for a high-DOF gripper using neural networks","author":"Liu","year":"2019","journal-title":"IEEE International Conference Intelligence Robotics System"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.15607\/RSS.2020.XVI.066","article-title":"Deep differentiable grasp planner for high-Dof grippers","author":"Liu","year":"2020","journal-title":"arXiv preprint arXiv:2002.01530"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.15607\/RSS.2017.XIII.058","article-title":"Dex-Net 2.0: deep learning to plan Robust grasps with synthetic point clouds and analytic grasp metrics","author":"Mahler","year":"2017","journal-title":"arXiv preprint arXiv:1703.09312"},{"key":"B25","doi-asserted-by":"publisher","first-page":"eaau4984","DOI":"10.1126\/scirobotics.aau4984","article-title":"Learning ambidextrous robot grasping policies","volume":"4","author":"Mahler","year":"2019","journal-title":"Sci. Robot"},{"key":"B26","doi-asserted-by":"crossref","first-page":"6169","DOI":"10.1109\/ICRA48506.2021.9561802","article-title":"Learning dexterous grasping with object-centric visual affordances","volume-title":"2021 IEEE International Conference on Robotics and Automation (ICRA)","author":"Mandikal","year":"2021"},{"key":"B27","first-page":"228","article-title":"Optimal grasp planning of multi-fingered robotic hands: a review","volume":"14","author":"Miao","year":"2015","journal-title":"Appl. Comput. Math"},{"key":"B28","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1109\/MRA.2004.1371616","article-title":"Graspit: a versatile simulator for robotic grasping","volume":"11","author":"Miller","year":"2004","journal-title":"IEEE Robot. Autom. Mag"},{"key":"B29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1146\/annurev-control-060117-105003","article-title":"A century of robotic hands","volume":"2","author":"Piazza","year":"2019","journal-title":"Annu. Rev. Control. Robot. Auton. Syst"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.15607\/RSS.2018.XIV.049","article-title":"Learning complex dexterous manipulation with deep reinforcement learning and demonstrations","author":"Rajeswaran","year":"2018","journal-title":"arXiv preprint arXiv:1709.10087"},{"key":"B31","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1109\/ICRA.2012.6225068","article-title":"Power grasp planning for anthropomorphic robot hands","volume-title":"2012 IEEE International Conference of Robotics Automation","author":"Roa","year":"2012"},{"key":"B32","doi-asserted-by":"publisher","first-page":"10105","DOI":"10.1523\/JNEUROSCI.18-23-10105.1998","article-title":"Postural hand synergies for tool use","volume":"18","author":"Santello","year":"1998","journal-title":"J. Neurosci"},{"key":"B33","doi-asserted-by":"publisher","first-page":"677","DOI":"10.1177\/0278364913518357","article-title":"Development of a tendon-driven robotic finger for an anthropomorphic robotic hand","volume":"33","author":"Shirafuji","year":"2014","journal-title":"Int. J. Rob. Res"},{"key":"B34","doi-asserted-by":"publisher","first-page":"150","DOI":"10.1177\/0278364917694723","article-title":"The ocean one hands: an adaptive design for robust marine manipulation","volume":"36","author":"Stuart","year":"2017","journal-title":"Int. J. Rob. Res"},{"key":"B35","doi-asserted-by":"publisher","first-page":"5026","DOI":"10.1109\/IROS.2012.6386109","article-title":"MuJoCo: a physics engine for model-based control","author":"Todorov","year":"2012","journal-title":"IEEE International Conference Intelligence Robotics System"},{"key":"B36","doi-asserted-by":"publisher","first-page":"9932","DOI":"10.1109\/ICRA40945.2020.9197493","article-title":"Picking thin objects by tilt-and-pivot manipulation and its application to bin picking","author":"Tong","year":"2020","journal-title":"Proceedings - IEEE International Conference of Robotics Automation"},{"key":"B37","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1177\/17298806221095974","article-title":"A review on sensory perception for dexterous robotic manipulation","volume":"19","author":"Xia","year":"2022","journal-title":"Int. J. Adv. Robot. Syst"},{"key":"B38","doi-asserted-by":"publisher","first-page":"2817","DOI":"10.1109\/ICMA.2009.5246448","article-title":"Analysis and grasp strategy modeling for underactuated multi-fingered robot hand","author":"Yao","year":"2009","journal-title":"2009 IEEE International Conference of Mechatronics Automation ICMA 2009"},{"key":"B39","doi-asserted-by":"publisher","first-page":"8870","DOI":"10.1109\/ICRA40945.2020.9197146","article-title":"Design of a roller-based dexterous hand for object grasping and within-hand manipulation","author":"Yuan","year":"2020","journal-title":"Proceedings - IEEE International Conference of Robotics Automation"},{"key":"B40","doi-asserted-by":"publisher","first-page":"11577","DOI":"10.1109\/LRA.2022.3202638","article-title":"Prying grasp for picking thin object using thick fingertips","volume":"7","author":"Zhang","year":"2022","journal-title":"IEEE Robot. Autom. Lett"}],"container-title":["Frontiers in Neurorobotics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2024.1349752\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,28]],"date-time":"2024-02-28T05:18:03Z","timestamp":1709097483000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fnbot.2024.1349752\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,28]]},"references-count":40,"alternative-id":["10.3389\/fnbot.2024.1349752"],"URL":"https:\/\/doi.org\/10.3389\/fnbot.2024.1349752","relation":{},"ISSN":["1662-5218"],"issn-type":[{"value":"1662-5218","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,2,28]]},"article-number":"1349752"}}