{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,27]],"date-time":"2026-01-27T14:46:06Z","timestamp":1769525166136,"version":"3.49.0"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"3-4","license":[{"start":{"date-parts":[[2019,11,21]],"date-time":"2019-11-21T00:00:00Z","timestamp":1574294400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,11,21]],"date-time":"2019-11-21T00:00:00Z","timestamp":1574294400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Multimed Tools Appl"],"published-print":{"date-parts":[[2020,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Real-time grasp detection plays a key role in manipulation, and it is also a complex task, especially for detecting how to grasp novel objects. This paper proposes a very quick and accurate approach to detect robotic grasps. The main idea is to perform grasping of novel objects in a typical RGB-D scene view. Our goal is not to find the best grasp for every object but to obtain the local optimal grasps in candidate grasp rectangles. There are three main contributions to our detection work. Firstly, an improved graph segmentation approach is used to do objects detection and it can separate objects from the background directly and fast. Secondly, we develop a morphological image processing method to generate candidate grasp rectangles set which avoids us to search grasp rectangles globally. Finally, we train a random forest model to predict grasps and achieve an accuracy of 94.26%. The model is mainly used to score every element in our candidate grasps set and the one gets the highest score will be converted to the final grasp configuration for robots. For real-world experiments, we set up our system on a tabletop scene with multiple objects and when implementing robotic grasps, we control Baxter robot with a different inverse kinematics strategy rather than the built-in one.<\/jats:p>","DOI":"10.1007\/s11042-019-08302-9","type":"journal-article","created":{"date-parts":[[2019,11,21]],"date-time":"2019-11-21T18:02:25Z","timestamp":1574359345000},"page":"2427-2446","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["Robotic grasp detection based on image processing and random forest"],"prefix":"10.1007","volume":"79","author":[{"given":"Jiahao","family":"Zhang","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Miao","family":"Li","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ying","family":"Feng","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chenguang","family":"Yang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2019,11,21]]},"reference":[{"key":"8302_CR1","unstructured":"Aristidou A, Lasenby J, Chrysanthou Y, Shamir A (2018) Inverse kinematics techniques in computer graphics: a survey. In: Computer graphics forum. Wiley online library, vol 37, pp 35\u201358"},{"key":"8302_CR2","unstructured":"Bicchi A, Kumar V (2000) Robotic grasping and contact: a review. In: Proceedings 2000 ICRA. Millennium Conference. IEEE international conference on robotics and automation. Symposia Proceedings (Cat. No.00CH37065), vol 1, pp 348\u2013353"},{"key":"8302_CR3","unstructured":"Chu F-J, Vela PA (2018) Deep grasp: Detection and localization of grasps with deep neural networks"},{"issue":"3","key":"8302_CR4","doi-asserted-by":"publisher","first-page":"286","DOI":"10.1177\/02783649922066213","volume":"18","author":"K Daniilidis","year":"1999","unstructured":"Daniilidis K (1999) Hand-eye calibration using dual quaternions. Int J Robot Res 18(3):286\u2013298","journal-title":"Int J Robot Res"},{"key":"8302_CR5","unstructured":"De Berg M, Van Kreveld M, Overmars M, Schwarzkopf O (1997) Computational geometry. In: Computational geometry. Springer, pp 1\u201317"},{"key":"8302_CR6","unstructured":"Diankov R, Kuffner J (2008) Openrave: a planning architecture for autonomous robotics. Robotics Institute, Pittsburgh, PA, Tech. Rep. CMU-RI-TR-08-34,79"},{"key":"8302_CR7","unstructured":"Ding D, Liu Y-H, Zhang J, Knoll A (2001) Computation of fingertip positions for a form-closure grasp. In: Proceedings 2001 ICRA. IEEE international conference on robotics and automation (Cat. No.01CH37164), vol 3, pp 2217\u20132222"},{"issue":"2","key":"8302_CR8","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1023\/B:VISI.0000022288.19776.77","volume":"59","author":"PF Felzenszwalb","year":"2004","unstructured":"Felzenszwalb PF, Huttenlocher DP (2004) Efficient graph-based image segmentation. Int J Comput Vis 59(2):167\u2013181","journal-title":"Int J Comput Vis"},{"key":"8302_CR9","doi-asserted-by":"crossref","unstructured":"Fischinger D, Vincze M (2012) Empty the basket-a shape based learning approach for grasping piles of unknown objects. In: Iros, pp 2051\u20132057","DOI":"10.1109\/IROS.2012.6386137"},{"key":"8302_CR10","doi-asserted-by":"crossref","unstructured":"Fischinger D, Vincze M (2012) Shape based learning for grasping novel objects in cluttered scenes. In: Syroco, pp 787\u2013792","DOI":"10.3182\/20120905-3-HR-2030.00176"},{"issue":"9","key":"8302_CR11","doi-asserted-by":"publisher","first-page":"1167","DOI":"10.1177\/0278364915577105","volume":"34","author":"D Fischinger","year":"2015","unstructured":"Fischinger D, Weiss A, Vincze M (2015) Learning grasps with topographic features. Int J Robot Res 34(9):1167\u20131194","journal-title":"Int J Robot Res"},{"key":"8302_CR12","doi-asserted-by":"crossref","unstructured":"Girshick R (2015) Fast r-cnn. In: Proceedings of the IEEE international conference on computer vision, pp 1440\u20131448","DOI":"10.1109\/ICCV.2015.169"},{"key":"8302_CR13","doi-asserted-by":"crossref","unstructured":"Gualtieri M, Pas AT, Saenko K, Platt R (2016) High precision grasp pose detection in dense clutter. In: 2016 IEEE\/RSJ international conference on intelligent robots and systems (IROS). IEEE, pp 598\u2013605","DOI":"10.1109\/IROS.2016.7759114"},{"issue":"1","key":"8302_CR14","doi-asserted-by":"crossref","first-page":"172988141668270","DOI":"10.1177\/1729881416682706","volume":"14","author":"D Guo","year":"2016","unstructured":"Guo D, Sun F, Kong T, Liu H (2016) Deep vision networks for real-time robotic grasp detection. Int J Adv Robot Sys 14(1):1729881416682706","journal-title":"Int J Adv Robot Sys"},{"key":"8302_CR15","unstructured":"Huaman AC (2016) Grasp selection strategies for robot manipulation using a superquadric-based object representation. PhD thesis, Georgia Institute of Technology"},{"key":"8302_CR16","doi-asserted-by":"crossref","unstructured":"Jiang Y, Moseson S, Saxena A (2011) Efficient grasping from rgbd images: Learning using a new rectangle representation. In: 2011 IEEE International conference on robotics and automation, pp 3304\u20133311","DOI":"10.1109\/ICRA.2011.5980145"},{"key":"8302_CR17","unstructured":"Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097\u20131105"},{"key":"8302_CR18","doi-asserted-by":"crossref","unstructured":"Kumra S, Kanan C (2017) Robotic grasp detection using deep convolutional neural networks. In: 2017 IEEE\/RSJ International conference on intelligent robots and systems (IROS). IEEE, pp 769\u2013776","DOI":"10.1109\/IROS.2017.8202237"},{"issue":"4\u20135","key":"8302_CR19","doi-asserted-by":"publisher","first-page":"705","DOI":"10.1177\/0278364914549607","volume":"34","author":"I Lenz","year":"2015","unstructured":"Lenz I, Lee H, Saxena A (2015) Deep learning for detecting robotic grasps. Int J Robot Res 34(4\u20135):705\u2013724","journal-title":"Int J Robot Res"},{"key":"8302_CR20","unstructured":"Li J-W, Jin M-H, Liu H (2003) A new algorithm for three-finger force-closure grasp of polygonal objects. In: 2003 IEEE International conference on robotics and automation (cat. no.03CH37422), vol 2, pp 1800\u20131804"},{"issue":"3","key":"8302_CR21","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1177\/027836498500400308","volume":"4","author":"AA Maciejewski","year":"1985","unstructured":"Maciejewski AA, Klein CA (1985) Obstacle avoidance for kinematically redundant manipulators in dynamically varying environments. Int J Robot Res 4(3):109\u2013117","journal-title":"Int J Robot Res"},{"key":"8302_CR22","doi-asserted-by":"crossref","unstructured":"Makhal A, Thomas F, Gracia AP (2018) Grasping unknown objects in clutter by superquadric representation. In: 2018 Second IEEE international conference on robotic computing (IRC). IEEE, pp 292\u2013299","DOI":"10.1109\/IRC.2018.00062"},{"issue":"4","key":"8302_CR23","doi-asserted-by":"publisher","first-page":"110","DOI":"10.1109\/MRA.2004.1371616","volume":"11","author":"AT Miller","year":"2004","unstructured":"Miller AT, Allen PK (2004) Graspit! a versatile simulator for robotic grasping. IEEE Robot Autom Mag 11(4):110\u2013122","journal-title":"IEEE Robot Autom Mag"},{"key":"8302_CR24","doi-asserted-by":"crossref","unstructured":"Miller AT, Knoop S, Christensen HI, Allen PK (2003) Automatic grasp planning using shape primitives. In: IEEE international conference on robotics and automation, 2003. Proceedings. ICRA\u201903, vol 2. IEEE, pp 1824\u20131829","DOI":"10.1109\/ROBOT.2003.1241860"},{"key":"8302_CR25","doi-asserted-by":"crossref","unstructured":"Morrison D, Corke P, Leitner J (2018) Closing the loop for robotic grasping: a real-time, generative grasp synthesis approach. arXiv:1804.05172","DOI":"10.15607\/RSS.2018.XIV.021"},{"key":"8302_CR26","unstructured":"Pas AT, Platt R (2015) Localizing antipodal grasps in point clouds. arXiv:1501.0"},{"key":"8302_CR27","unstructured":"Pas AT, Platt R (2016) Localizing handle-like grasp affordances in 3D point clouds. In: Experimental robotics. Springer, pp 623\u2013638"},{"key":"8302_CR28","unstructured":"Pas AT, Platt R (2018) Using geometry to detect grasp poses in 3d point clouds. In: Robotics research. Springer, pp 307\u2013324"},{"issue":"13-14","key":"8302_CR29","doi-asserted-by":"publisher","first-page":"1455","DOI":"10.1177\/0278364917735594","volume":"36","author":"AT Pas","year":"2017","unstructured":"Pas AT, Gualtieri M, Saenko K, Platt R (2017) Grasp pose detection in point clouds. Int J Robot Res 36(13-14):1455\u20131473","journal-title":"Int J Robot Res"},{"key":"8302_CR30","unstructured":"Paul RP (1981) Robot manipulators: mathematics, programming, and control: the computer control of robot manipulators. Richard Paul"},{"key":"8302_CR31","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2011) Scikit-learn: Machine learning in Python. J Mach Learn Res 12:2825\u20132830","journal-title":"J Mach Learn Res"},{"key":"8302_CR32","doi-asserted-by":"crossref","unstructured":"Rao CR, Mitra SK (1972) Generalized inverse of a matrix and its applications. In: Icams conference","DOI":"10.1525\/9780520325883-032"},{"key":"8302_CR33","doi-asserted-by":"crossref","unstructured":"Rao D, Le QV, Phoka T, Quigley M, Sudsang A, Ng AY (2010) Grasping novel objects with depth segmentation. In: 2010 IEEE\/RSJ international conference on intelligent robots and systems (IROS). IEEE, pp 2578\u20132585","DOI":"10.1109\/IROS.2010.5650493"},{"key":"8302_CR34","doi-asserted-by":"crossref","unstructured":"Redmon J, Angelova A (2015) Real-time grasp detection using convolutional neural networks. In: 2015 IEEE international conference on robotics and automation (ICRA). IEEE, pp 1316\u20131322","DOI":"10.1109\/ICRA.2015.7139361"},{"key":"8302_CR35","doi-asserted-by":"crossref","unstructured":"Redmon J, Farhadi A (2017) Yolo9000: better, faster, stronger. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7263\u20137271","DOI":"10.1109\/CVPR.2017.690"},{"key":"8302_CR36","unstructured":"Redmon J, Farhadi A (2018) Yolov3: an incremental improvement. arXiv:1804.02767"},{"key":"8302_CR37","doi-asserted-by":"crossref","unstructured":"Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: Unified, real-time object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 779\u2013788","DOI":"10.1109\/CVPR.2016.91"},{"key":"8302_CR38","doi-asserted-by":"crossref","unstructured":"Trottier L, Giguere P, Chaib-Draa B (2017) Convolutional residual network for grasp localization. In: 2017 14Th conference on computer and robot vision (CRV). IEEE, pp 168\u2013175","DOI":"10.1109\/CRV.2017.14"},{"issue":"9","key":"8302_CR39","doi-asserted-by":"publisher","first-page":"2109","DOI":"10.1109\/TPAMI.2017.2745563","volume":"40","author":"X Zeng","year":"2018","unstructured":"Zeng X, Ouyang W, Yan J, Li H, Xiao T, Wang K, Liu Y, Zhou Y, Yang B, Wang Z, et al. (2018) Crafting gbd-net for object detection. IEEE Trans Pattern Anal Mach Intell 40(9):2109\u20132123","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"8302_CR40","unstructured":"Zhang H, Lan X, Zhou X, Zheng N (2018) Roi-based robotic grasp detection in object overlapping scenes using convolutional neural network. arXiv:1808.10313"},{"key":"8302_CR41","doi-asserted-by":"crossref","unstructured":"Zhang J, Yang C, Li M, Feng Y (2018) Grasping novel objects with real-time obstacle avoidance. In: International conference on social robotics. Springer, pp 160\u2013169","DOI":"10.1007\/978-3-030-05204-1_16"}],"container-title":["Multimedia Tools and Applications"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-019-08302-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s11042-019-08302-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s11042-019-08302-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,6]],"date-time":"2022-10-06T16:58:10Z","timestamp":1665075490000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s11042-019-08302-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,21]]},"references-count":41,"journal-issue":{"issue":"3-4","published-print":{"date-parts":[[2020,1]]}},"alternative-id":["8302"],"URL":"https:\/\/doi.org\/10.1007\/s11042-019-08302-9","relation":{},"ISSN":["1380-7501","1573-7721"],"issn-type":[{"value":"1380-7501","type":"print"},{"value":"1573-7721","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,21]]},"assertion":[{"value":"6 March 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 September 2019","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 September 2019","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"21 November 2019","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}