{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T20:25:05Z","timestamp":1777494305713,"version":"3.51.4"},"reference-count":42,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2019,7,30]],"date-time":"2019-07-30T00:00:00Z","timestamp":1564444800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["IIS-1409823, IIS-1527794"],"award-info":[{"award-number":["IIS-1409823, IIS-1527794"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Institute for Disability, Independent Living, and Rehabilitation Research","award":["H133G120275"],"award-info":[{"award-number":["H133G120275"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>In this paper, we investigate the problem of grasping previously unseen objects in unstructured environments which are cluttered with multiple objects. Object geometry, reachability, and force-closure analysis are considered to address this problem. A framework is proposed for grasping unknown objects by localizing contact regions on the contours formed by a set of depth edges generated from a single-view 2D depth image. Specifically, contact regions are determined based on edge geometric features derived from analysis of the depth map data. Finally, the performance of the approach is successfully validated by applying it to scenes with both single and multiple objects, in both simulation and experiments. Using sequential processing in MATLAB running on a 4th-generation Intel Core Desktop, simulation results with the benchmark Object Segmentation Database show that the algorithm takes 281 ms on average to generate the 6D robot pose needed to attach with a pair of viable grasping edges that satisfy reachability and force-closure conditions. Experimental results in the Assistive Robotics Laboratory at UCF using a Kinect One sensor and a Baxter manipulator outfitted with a standard parallel gripper showcase the feasibility of the approach in grasping previously unseen objects from uncontrived multi-object settings.<\/jats:p>","DOI":"10.3390\/robotics8030063","type":"journal-article","created":{"date-parts":[[2019,7,30]],"date-time":"2019-07-30T11:15:56Z","timestamp":1564485356000},"page":"63","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["From Single 2D Depth Image to Gripper 6D Pose Estimation: A Fast and Robust Algorithm for Grabbing Objects in Cluttered Scenes"],"prefix":"10.3390","volume":"8","author":[{"given":"Amirhossein","family":"Jabalameli","sequence":"first","affiliation":[{"name":"Electrical and Computer Engineering Department, University of Central Florida (UCF), Orlando, FL 32816, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8458-1591","authenticated-orcid":false,"given":"Aman","family":"Behal","sequence":"additional","affiliation":[{"name":"Electrical and Computer Engineering Department, University of Central Florida (UCF), Orlando, FL 32816, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,7,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1109\/TRO.2013.2289018","article-title":"Data-Driven Grasp Synthesis\u2014A Survey","volume":"30","author":"Bohg","year":"2014","journal-title":"IEEE Trans. Robot."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"326","DOI":"10.1016\/j.robot.2011.07.016","article-title":"An overview of 3D object grasp synthesis algorithms","volume":"60","author":"Sahbani","year":"2012","journal-title":"Robot. Auton. Syst."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Nguyen, V.D. (1986, January 7\u201310). Constructing force-closure grasps. Proceedings of the 1986 IEEE International Conference on Robotics and Automation, San Francisco, CA, USA.","DOI":"10.1109\/ROBOT.1986.1087483"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1177\/027836499201100301","article-title":"Grasp Synthesis of Polygonal Objects Using a Three-Fingered Robot Hand","volume":"11","author":"Park","year":"1992","journal-title":"Proc. Int. J. Robot. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"904","DOI":"10.1109\/70.544773","article-title":"On the stability of grasped objects","volume":"12","author":"Howard","year":"1996","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_6","unstructured":"Okamura, A.M., Smaby, N., and Cutkosky, M.R. (2000, January 22\u201328). An overview of dexterous manipulation. Proceedings of the IEEE Conference on Robotics and Automation, San Francisco, CA, USA."},{"key":"ref_7","unstructured":"Bicchi, A., and Kumar, V. (2000, January 24\u201328). Robotic grasping and contact: A review. Proceedings of the 2000 ICRA Millennium Conference, Symposia Proceedings (Cat. No.00CH37065), San Francisco, CA, USA."},{"key":"ref_8","unstructured":"Diankov, R. (2010). Automated Construction of Robotic Manipulation Programs. [Ph.D. Dissertation, Carnegie Mellon University]."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Weisz, J., and Allen, P.K. (2012, January 14\u201318). Pose error robust grasping from contact wrench space metrics. Proceedings of the 2012 IEEE International Conference on Robotics and Automation, Saint Paul, MN, USA.","DOI":"10.1109\/ICRA.2012.6224697"},{"key":"ref_10","unstructured":"Miller, A.T., Knoop, S., Christensen, H.I., and Allen, P.K. (2003, January 14\u201319). Automatic grasp planning using shape primitives. Proceedings of the 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422), Taipei, Taiwan."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"H\u00fcbner, K., and Kragic, D. (2008, January 22\u201326). Selection of robot pre-grasps using box-based shape approximation. Proceedings of the 2008 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Nice, France.","DOI":"10.1109\/IROS.2008.4650722"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Przybylski, M., Asfour, T., and Dillmann, R. (2011, January 25\u201330). Planning grasps for robotic hands using a novel object representation based on the medial axis transform. Proceedings of the 2011 IEEE\/RSJ International Conference on Intelligent Robots and Systems, San Francisco, CA, USA.","DOI":"10.1109\/IROS.2011.6048625"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1790","DOI":"10.1109\/TPAMI.2009.64","article-title":"A Probabilistic Framework for 3D Visual Object Representation","volume":"31","author":"Detry","year":"2009","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"851","DOI":"10.1177\/0278364909105606","article-title":"Hand posture subspaces for dexterous robotic grasping","volume":"28","author":"Ciocarlie","year":"2009","journal-title":"Int. J. Robot. Res."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1177\/0278364907087172","article-title":"Robotic grasping of novel objects using vision","volume":"27","author":"Saxena","year":"2008","journal-title":"Int. J. Robot. Res."},{"key":"ref_16","unstructured":"Detry, R., Kraft, D., Kroemer, O., Bodenhagen, L., Peters, J., Kr\u00fcger, N., and Piater, J. (2009, January 5\u20137). Learning Grasp Affordance Densities. Proceedings of the 2009 IEEE 8th International Conference on Development and Learning, Shanghai, China."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Suzuki, T., and Oka, T. (2016, January 12\u201315). Grasping of unknown objects on a planar surface using a single depth image. Proceedings of the 2016 IEEE International Conference on Advanced Intelligent Mechatronics (AIM), Banff, AB, USA.","DOI":"10.1109\/AIM.2016.7576829"},{"key":"ref_18","unstructured":"ten Pas, A., and Platt, R. (2015). Using geometry to detect grasp poses in 3d point clouds. arXiv."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Jain, S., and Argall, B. (2016, January 16\u201321). Grasp detection for assistive robotic manipulation. Proceedings of the 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487348"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1050","DOI":"10.1109\/TMECH.2012.2195500","article-title":"Visual Grasp Planning for Unknown Objects Using a Multifingered Robotic Hand","volume":"18","author":"Lippiello","year":"2013","journal-title":"IEEE\/ASME Trans. Mechatronics"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1347","DOI":"10.1109\/TRO.2016.2596799","article-title":"Surface-Based Detection and 6-DoF Pose Estimation of 3-D Objects in Cluttered Scenes","volume":"32","author":"Teng","year":"2016","journal-title":"IEEE Trans. Robot."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"\u00dcckermann, A., Haschke, R., and Ritter, H. (2013, January 3\u20137). Realtime 3D segmentation for human-robot interaction. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan.","DOI":"10.1109\/IROS.2013.6696655"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Hsiao, K., Chitta, S., Ciocarlie, M., and Jones, E.G. (2010, January 18\u201322). Contact-reactive grasping of objects with partial shape information. Proceedings of the 2010 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan.","DOI":"10.1109\/IROS.2010.5649494"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1016\/j.mechatronics.2011.09.009","article-title":"Visual servoing on unknown objects","volume":"22","author":"Gratal","year":"2012","journal-title":"Mechatronics"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Parkhurst, E.L., Rupp, M.A., Jabalameli, A., Behal, A., and Smither, J.A. (2017, January 9\u201313). Compensations for an Assistive Robotic Interface. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, Austin, TX, USA.","DOI":"10.1177\/1541931213601929"},{"key":"ref_26","unstructured":"Rahmatizadeh, R., Abolghasemi, P., Boloni, L., Jabalameli, A., and Behal, A. (2016, January 16\u201318). Trajectory adaptation of robot arms for head-pose dependent assistive tasks. Proceedings of the Twenty-Ninth International Flairs Conference, Largo, FL, USA."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Ettehadi, N., and Behal, A. (2018, January 1\u20132). Implementation of Feeding Task via Learning from Demonstration. Proceedings of the Second IEEE International Conference on Robotic Computing (IRC), Laguna Hills, CA, USA.","DOI":"10.1109\/IRC.2018.00058"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Le\u00f3n, B., Morales, A., and Sancho-Bru, J. (2014). From Robot to Human Grasping Simulation, Springer.","DOI":"10.1007\/978-3-319-01833-1"},{"key":"ref_29","unstructured":"Carmo, D., and Manfredo, P. (2016). Differential Geometry of Curves and Surfaces: Revised and Updated Second Edition, Courier Dover Publications."},{"key":"ref_30","unstructured":"Stork, A. (2016). Representation and Learning for Robotic Grasping, Caging, and Planning. [Ph.D. Dissertation, KTH Royal Institute of Technology]."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","article-title":"A Computational Approach to Edge Detection","volume":"PAMI-8","author":"Canny","year":"1986","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Richtsfeld, A., M\u00f6rwald, T., Prankl, J., Zillich, M., and Vincze, M. (2012, January 7\u201312). Segmentation of unknown objects in indoor environments. Proceedings of the 2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Vilamoura, Portugal.","DOI":"10.1109\/IROS.2012.6385661"},{"key":"ref_33","unstructured":"Kovesi, P.D. (2017, May 10). MATLAB and Octave Functions for Computer Vision and Image Processing. Available online: http:\/\/www.peterkovesi.com\/matlabfns."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Balasubramanian, R., Xu, L., Brook, P.D., Smith, J.R., and Matsuoka, Y. (2010, January 3\u20137). Human-guided grasp measures improve grasp robustness on physical robot. Proceedings of the 2010 IEEE International Conference on Robotics and Automation, Anchorage, AK, USA.","DOI":"10.1109\/ROBOT.2010.5509855"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1437","DOI":"10.3390\/s120201437","article-title":"Accuracy and resolution of kinect depth data for indoor mapping applications","volume":"12","author":"Khoshelham","year":"2012","journal-title":"Sensors"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Moy\u00e0-Alcover, G., Elgammal, A., Jaume-i-Cap\u00f3, A., and Varona, J. (2016). Modeling depth for nonparametric foreground segmentation using RGBD devices. Pattern Recognit. Lett.","DOI":"10.1016\/j.patrec.2016.09.004"},{"key":"ref_38","unstructured":"Brian Hudson (2017, May 10). Emphasis on Filtering & Depth Map Occlusion Filling, Clarkson University Computer Vision Course CS 611 Fall 2012. Available online: https:\/\/people.clarkson.edu\/~hudsonb\/courses\/cs611\/."},{"key":"ref_39","unstructured":"Carmichael, O., and Hebert, M. (2003, January 18\u201320). Shape-based recognition of wiry objects. Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, WI, USA."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Calli, B., Singh, A., Walsman, A., Srinivasa, S., Abbeel, P., and Dollar, A. (2015, January 27\u201331). The YCB object and model set: Towards common benchmarks for manipulation research. Proceedings of the Conference on Advanced Robotics (ICAR), Istanbul, Turkey.","DOI":"10.1109\/ICAR.2015.7251504"},{"key":"ref_41","unstructured":"Sucan, I.A., and Chitta, S. (2017, May 10). MoveIt!. Available online: Http:\/\/moveit.ros.org."},{"key":"ref_42","unstructured":"Jabalameli, A. (2019, May 10). Sample Grasping Execution. Available online: https:\/\/youtu.be\/7r0KaxpQk6E."}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/8\/3\/63\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:11:13Z","timestamp":1760188273000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/8\/3\/63"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,7,30]]},"references-count":42,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2019,9]]}},"alternative-id":["robotics8030063"],"URL":"https:\/\/doi.org\/10.3390\/robotics8030063","relation":{},"ISSN":["2218-6581"],"issn-type":[{"value":"2218-6581","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,7,30]]}}}