{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T16:34:11Z","timestamp":1781886851137,"version":"3.54.5"},"reference-count":36,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2024,1,18]],"date-time":"2024-01-18T00:00:00Z","timestamp":1705536000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Robot grasping constitutes an essential capability in fulfilling the complexities of advanced industrial operations. This field has been extensively investigated to address a range of practical applications. However, the generation of a stable grasp remains challenging, principally due to the constraints imposed by object geometries and the diverse objectives of the tasks. In this work, we propose a novel learning from demonstration-based grasp-planning framework. This framework is designed to extract crucial human grasp skills, namely the contact region and approach direction, from a single demonstration. Then, it formulates an optimization problem that integrates the extracted skills to generate a stable grasp. Distinct from conventional methods that rely on learning implicit synergies through human demonstration or on mapping the dissimilar kinematics between human hands and robot grippers, our approach focuses on learning the intuitive human intent that involves the potential contact regions and the grasping approach direction. Furthermore, our optimization formulation is capable of identifying the optimal grasp by minimizing the surface fitting error between the demonstrated contact regions on the object and the gripper finger surface and imposing a penalty for any misalignment between the demonstrated and the gripper\u2019s approach directions. A series of experiments is conducted to verify the effectiveness of the proposed algorithm through both simulations and real-world scenarios.<\/jats:p>","DOI":"10.3390\/s24020618","type":"journal-article","created":{"date-parts":[[2024,1,18]],"date-time":"2024-01-18T11:28:46Z","timestamp":1705577326000},"page":"618","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Robot Grasp Planning: A Learning from Demonstration-Based Approach"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5955-9755","authenticated-orcid":false,"given":"Kaimeng","family":"Wang","sequence":"first","affiliation":[{"name":"FANUC Advanced Research Laboratory, FANUC America Corporation, Union City, CA 94587, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yongxiang","family":"Fan","sequence":"additional","affiliation":[{"name":"FANUC Advanced Research Laboratory, FANUC America Corporation, Union City, CA 94587, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ichiro","family":"Sakuma","sequence":"additional","affiliation":[{"name":"Department of Precision Engineering, The University of Tokyo, Tokyo 113-8654, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,1,18]]},"reference":[{"key":"ref_1","unstructured":"Zhang, H., Tang, J., Sun, S., and Lan, X. (2022). Robotic Grasping from Classical to Modern: A Survey. arXiv."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Saito, D., Sasabuchi, K., Wake, N., Takamatsu, J., Koike, H., and Ikeuchi, K. (2022). Task-grasping from human demonstration. arXiv.","DOI":"10.1109\/Humanoids53995.2022.10000167"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Mandikal, P., and Grauman, K. (June, January 30). Learning dexterous grasping with object-centric visual affordances. Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi\u2019an, China.","DOI":"10.1109\/ICRA48506.2021.9561802"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1177\/0278364914555544","article-title":"Robot grasp planning based on demonstrated grasp strategies","volume":"34","author":"Lin","year":"2015","journal-title":"Int. J. Robot. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1016\/j.mechatronics.2010.11.003","article-title":"Transferring human grasping synergies to a robot","volume":"21","author":"Geng","year":"2011","journal-title":"Mechatronics"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wang, K., Fan, Y., and Sakuma, I. (2023, January 3\u20135). Robot Grasp Planning from Human Demonstration. Proceedings of the 2023 15th International Conference on Computer and Automation Engineering (ICCAE), Sydney, Australia.","DOI":"10.1109\/ICCAE56788.2023.10111294"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Pinto, L., and Gupta, A. (2016, January 16\u201321). Supersizing self-supervision: Learning to grasp from 50k tries and 700 robot hours. Proceedings of the 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487517"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"4978","DOI":"10.1109\/LRA.2020.3004787","article-title":"Grasping in the wild: Learning 6dof closed-loop grasping from low-cost demonstrations","volume":"5","author":"Song","year":"2020","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Deng, Y., Guo, X., Wei, Y., Lu, K., Fang, B., Guo, D., Liu, H., and Sun, F. (2019, January 4\u20138). Deep reinforcement learning for robotic pushing and picking in cluttered environment. Proceedings of the 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China.","DOI":"10.1109\/IROS40897.2019.8967899"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Zhao, W., Queralta, J.P., and Westerlund, T. (2020, January 1\u20134). Sim-to-real transfer in deep reinforcement learning for robotics: A survey. Proceedings of the 2020 IEEE Symposium Series on Computational Intelligence (SSCI), Canberra, Australia.","DOI":"10.1109\/SSCI47803.2020.9308468"},{"key":"ref_11","first-page":"348","article-title":"Robotic grasping and contact: A review","volume":"Volume 1","author":"Bicchi","year":"2000","journal-title":"Proceedings of the 2000 ICRA, Millennium Conference, IEEE International Conference on Robotics and Automation"},{"key":"ref_12","unstructured":"Ciocarlie, M., Goldfeder, C., and Allen, P. (2007, January 30). Dexterous grasping via eigengrasps: A low-dimensional approach to a high-complexity problem. Proceedings of the Robotics: Science and Systems Manipulation Workshop-Sensing and Adapting to the Real World, Atlanta, GA, USA."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3995","DOI":"10.1109\/LRA.2019.2928210","article-title":"Efficient grasp planning and execution with multifingered hands by surface fitting","volume":"4","author":"Fan","year":"2019","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_14","unstructured":"Dai, W., Sun, Y., and Qian, X. (2013, January 3\u20137). Functional analysis of grasping motion. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"103860","DOI":"10.1016\/j.robot.2021.103860","article-title":"A comprehensive grasp taxonomy of continuum robots","volume":"145","author":"Mehrkish","year":"2021","journal-title":"Robot. Auton. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"104575","DOI":"10.1016\/j.mechmachtheory.2021.104575","article-title":"Grasp synthesis of continuum robots","volume":"168","author":"Mehrkish","year":"2022","journal-title":"Mech. Mach. Theory"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1109\/THMS.2015.2470657","article-title":"The grasp taxonomy of human grasp types","volume":"46","author":"Feix","year":"2015","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Corona, E., Pumarola, A., Alenya, G., Moreno-Noguer, F., and Rogez, G. (2020, January 13\u201319). Ganhand: Predicting human grasp affordances in multi-object scenes. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00508"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1007\/s43154-020-00021-6","article-title":"A survey on learning-based robotic grasping","volume":"1","author":"Kleeberger","year":"2020","journal-title":"Curr. Robot. Rep."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ozawa, R., and Ueda, N. (November, January 29). Supervisory control of a multi-fingered robotic hand system with data glove. Proceedings of the 2007 IEEE\/RSJ International Conference on Intelligent Robots and Systems, San Diego, CA, USA.","DOI":"10.1109\/IROS.2007.4398967"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Liu, H., Xie, X., Millar, M., Edmonds, M., Gao, F., Zhu, Y., Santos, V.J., Rothrock, B., and Zhu, S.C. (2017, January 24\u201328). A glove-based system for studying hand-object manipulation via joint pose and force sensing. Proceedings of the 2017 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.","DOI":"10.1109\/IROS.2017.8206575"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Lakshmipathy, A., Bauer, D., Bauer, C., and Pollard, N.S. (2022, January 23\u201327). Contact transfer: A direct, user-driven method for human to robot transfer of grasps and manipulations. Proceedings of the 2022 International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA.","DOI":"10.1109\/ICRA46639.2022.9811739"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Karunratanakul, K., Yang, J., Zhang, Y., Black, M.J., Muandet, K., and Tang, S. (2020, January 25\u201328). Grasping field: Learning implicit representations for human grasps. Proceedings of the 2020 International Conference on 3D Vision (3DV), Fukuoka, Japan.","DOI":"10.1109\/3DV50981.2020.00043"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wang, P., Manhardt, F., Minciullo, L., Garattoni, L., Meier, S., Navab, N., and Busam, B. (October, January 27). DemoGrasp: Few-shot learning for robotic grasping with human demonstration. Proceedings of the 2021 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic.","DOI":"10.1109\/IROS51168.2021.9636856"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1177\/0278364910370218","article-title":"Synthesizing grasp configurations with specified contact regions","volume":"30","author":"Rosales","year":"2011","journal-title":"Int. J. Robot. Res."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ekvall, S., and Kragic, D. (2007, January 10\u201314). Learning and evaluation of the approach vector for automatic grasp generation and planning. Proceedings of the 2007 IEEE International Conference on Robotics and Automation, Roma, Italy.","DOI":"10.1109\/ROBOT.2007.364205"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Hillenbrand, U., and Roa, M.A. (2012, January 7\u201312). Transferring functional grasps through contact warping and local replanning. Proceedings of the 2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Vilamoura-Algarve, Portugal.","DOI":"10.1109\/IROS.2012.6385989"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Brahmbhatt, S., Handa, A., Hays, J., and Fox, D. (2019, January 4\u20138). Contactgrasp: Functional multi-finger grasp synthesis from contact. Proceedings of the 2019 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China.","DOI":"10.1109\/IROS40897.2019.8967960"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2514","DOI":"10.3390\/s23052514","article-title":"Robot Programming from a Single Demonstration for High Precision Industrial Insertion","volume":"23","author":"Wang","year":"2023","journal-title":"Sensors"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1108\/IR-04-2022-0093","article-title":"Robot programming by demonstration with a monocular RGB camera","volume":"50","author":"Wang","year":"2023","journal-title":"Ind. Robot. Int. J. Robot. Res. Appl."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1109\/70.34763","article-title":"On grasp choice, grasp models, and the design of hands for manufacturing tasks","volume":"5","author":"Cutkosky","year":"1989","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Fan, Y., Lin, H.C., Tang, T., and Tomizuka, M. (2018, January 20\u201324). Grasp planning for customized grippers by iterative surface fitting. Proceedings of the 2018 IEEE 14th International Conference on Automation Science and Engineering (CASE), Munich, Germany.","DOI":"10.1109\/COASE.2018.8560361"},{"key":"ref_33","unstructured":"Van Den Bergen, G. (2001, January 22\u201324). Proximity queries and penetration depth computation on 3d game objects. Proceedings of the Game Developers Conference, San Jose, CA, USA."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Kaskman, R., Zakharov, S., Shugurov, I., and Ilic, S. (2019, January 27\u201328). Homebreweddb: Rgb-d dataset for 6d pose estimation of 3d objects. Proceedings of the IEEE\/CVF International Conference on Computer Vision Workshops, Seoul, Republic of Korea.","DOI":"10.1109\/ICCVW.2019.00338"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Xiang, Y., Schmidt, T., Narayanan, V., and Fox, D. (2017). Posecnn: A convolutional neural network for 6d object pose estimation in cluttered scenes. arXiv.","DOI":"10.15607\/RSS.2018.XIV.019"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Hodan, T., Haluza, P., Obdr\u017e\u00e1lek, \u0160., Matas, J., Lourakis, M., and Zabulis, X. (2017, January 24\u201331). T-LESS: An RGB-D dataset for 6D pose estimation of texture-less objects. Proceedings of the 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), Santa Rosa, CA, USA.","DOI":"10.1109\/WACV.2017.103"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/2\/618\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T13:49:45Z","timestamp":1760104185000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/24\/2\/618"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,1,18]]},"references-count":36,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2024,1]]}},"alternative-id":["s24020618"],"URL":"https:\/\/doi.org\/10.3390\/s24020618","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1,18]]}}}