{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,10]],"date-time":"2026-01-10T21:42:43Z","timestamp":1768081363722,"version":"3.49.0"},"reference-count":30,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2018,5,11]],"date-time":"2018-05-11T00:00:00Z","timestamp":1525996800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004608","name":"Natural Science Foundation of Jiangsu Province","doi-asserted-by":"publisher","award":["BK20151339"],"award-info":[{"award-number":["BK20151339"]}],"id":[{"id":"10.13039\/501100004608","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["51475212"],"award-info":[{"award-number":["51475212"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Fruit recognition based on depth information has been a hot topic due to its advantages. However, the present equipment and methods cannot meet the requirements of rapid and reliable recognition and location of fruits in close shot for robot harvesting. To solve this problem, we propose a recognition algorithm for citrus fruit based on RealSense. This method effectively utilizes depth-point cloud data in a close-shot range of 160 mm and different geometric features of the fruit and leaf to recognize fruits with a intersection curve cut by the depth-sphere. Experiments with close-shot recognition of six varieties of fruit under different conditions were carried out. The detection rates of little occlusion and adhesion were from 80\u2013100%. However, severe occlusion and adhesion still have a great influence on the overall success rate of on-branch fruits recognition, the rate being 63.8%. The size of the fruit has a more noticeable impact on the success rate of detection. Moreover, due to close-shot near-infrared detection, there was no obvious difference in recognition between bright and dark conditions. The advantages of close-shot limited target detection with RealSense, fast foreground and background removal and the simplicity of the algorithm with high precision may contribute to high real-time vision-servo operations of harvesting robots.<\/jats:p>","DOI":"10.3390\/s18051510","type":"journal-article","created":{"date-parts":[[2018,5,11]],"date-time":"2018-05-11T03:42:48Z","timestamp":1526010168000},"page":"1510","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["Experiments and Analysis of Close-Shot Identification of On-Branch Citrus Fruit with RealSense"],"prefix":"10.3390","volume":"18","author":[{"given":"Jizhan","family":"Liu","sequence":"first","affiliation":[{"name":"Key Laboratory of Modern Agricultural Equipment and Technology, Ministry of Education, Jiangsu University, Jiangsu 212013, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yan","family":"Yuan","sequence":"additional","affiliation":[{"name":"Key Laboratory of Modern Agricultural Equipment and Technology, Ministry of Education, Jiangsu University, Jiangsu 212013, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yao","family":"Zhou","sequence":"additional","affiliation":[{"name":"College of Information Science and Technology, Nanjing Forestry University, Nanjing 210037, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xinxin","family":"Zhu","sequence":"additional","affiliation":[{"name":"Key Laboratory of Modern Agricultural Equipment and Technology, Ministry of Education, Jiangsu University, Jiangsu 212013, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1265-5533","authenticated-orcid":false,"given":"Tabinda Naz","family":"Syed","sequence":"additional","affiliation":[{"name":"Key Laboratory of Modern Agricultural Equipment and Technology, Ministry of Education, Jiangsu University, Jiangsu 212013, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,5,11]]},"reference":[{"key":"ref_1","unstructured":"(2017, September 15). FAOSTAT. Available online: http:\/\/www.fao.org\/faostat\/zh\/#data\/QI."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1016\/j.biosystemseng.2009.09.011","article-title":"Evaluation of a strawberry-harvesting robot in a field test","volume":"105","author":"Hayashii","year":"2010","journal-title":"Biosyst. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/j.biosystemseng.2004.10.006","article-title":"Orange Harvesting Systems Review","volume":"90","author":"Sanders","year":"2005","journal-title":"Biosyst. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1590\/0100-2945-070\/14","article-title":"Harvest Labor Quality and Productivity: Case study of cherry growing in Chile","volume":"32","author":"Jararojas","year":"2015","journal-title":"Rev. Bras. Frutic."},{"key":"ref_5","unstructured":"Gu, H., Lu, Y., Lou, J., and Zhang, W. (December, January 29). Recognition and location of fruit objects based on machine vision. Proceedings of the 16th International Conference on Advances in Artificial Reality and Tele-Existence, Hangzhou, China."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1007\/s001380050117","article-title":"A vision system based on a laser range-finder applied to robotic fruit harvesting","volume":"11","author":"Ceres","year":"2000","journal-title":"Mach. Vis. Appl."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1016\/j.compag.2014.10.016","article-title":"Detecting citrus fruits and occlusion recovery under natural illumination conditions","volume":"110","author":"Lu","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1016\/j.compag.2016.01.023","article-title":"A method of segmenting apples at night based on color and position information","volume":"122","author":"Liu","year":"2016","journal-title":"Comput. Electron. Agric."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1016\/j.compag.2015.01.010","article-title":"Location of apples in trees using stereoscopic vision","volume":"112","author":"Si","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Yang, K.L., Wang, K.W., Hu, W.J., and Bai, J. (2016). Expanding the detection of traversable area with RealSense for the visually impaired. Sensors, 16.","DOI":"10.3390\/s16111954"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Hu, Y., Wang, L., Xiang, L.R., Wu, Q., and Jiang, H.Y. (2018). Automatic non-destructive growth measurement of leafy vegetables based on kinect. Sensors, 18.","DOI":"10.3390\/s18030806"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Wang, Z.L., Walsh, K.B., and Verma, B. (2017). On-Tree Mango Fruit Size Estimation Using RGB-D Images. Sensors, 17.","DOI":"10.3390\/s17122738"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1016\/j.ifacol.2016.10.067","article-title":"Towards an artificial vision-robotic system for tomato identification","volume":"49","author":"Morales","year":"2016","journal-title":"IFAC-PapersOnLine"},{"key":"ref_14","unstructured":"Nguyen, T.T., Keresztes, J., Vandevoorde, K., Kayacan, E., De Baerdemaeker, J., and Saeys, W. (2014, January 6\u201310). Apple detection algorithm for robotic harvesting using a RGB-D camera. Proceedings of the International Conference of Agricultural Engineering, Zurich, Switzerland."},{"key":"ref_15","first-page":"35","article-title":"Research on 3D Reconstruction of Fruit Tree and Fruit Recognition and Location Method Based on RGB-D Camera","volume":"46","author":"Mai","year":"2015","journal-title":"Trans. Chin. Soc. Agric. Mach."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"872","DOI":"10.1109\/LRA.2017.2655622","article-title":"Autonomous sweet pepper harvesting for protected cropping systems","volume":"2","author":"Lehnert","year":"2017","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"388","DOI":"10.1016\/j.compag.2017.09.019","article-title":"Automatic apple recognition based on the fusion of color and 3D feature for robotic fruit picking","volume":"142","author":"Tao","year":"2017","journal-title":"Comput. Electron. Agric."},{"key":"ref_18","unstructured":"Qiu, Q., Tian, L., Qiao, X., Jiang, K., and Feng, Q. (2017, January 24\u201326). Selecting candidate regions of clustered tomato fruits under complex greenhouse scenes using RGB-D data. Proceedings of the 3rd International Conference on Control, Automation and Robotics (ICCAR), Nagoya, Japan."},{"key":"ref_19","unstructured":"Chen, X., Chaudhary, K., Tanaka, Y., and Nagahama, K. (October, January 28). Reasoning-based vision recognition for agricultural humanoid robot toward tomato harvesting. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Hamburg, Germany."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Choi, D., Lee, W.S., Schueller, J.K., Ehsani, R., Roka, F., and Diamond, J. (2017, January 16\u201319). A performance comparison of RGB, NIR, and depth images in immature citrus detection using deep learning algorithms for yield prediction. Proceedings of the 2017 ASABE Annual International Meeting Sponsored by ASABE, Spokane, WA, USA.","DOI":"10.13031\/aim.201700076"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yasukawa, S., Li, B., Sonoda, T., and Ishii, K. (2017, January 19\u201322). Development of a Tomato Harvesting Robot. Proceedings of the 2017 International Conference on Artificial Life and Robotics (ICAROB 2017), Seagaia Convention Center, Miyazaki, Japan.","DOI":"10.5954\/ICAROB.2017.OS22-1"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/j.biosystemseng.2015.12.001","article-title":"Design of an eye-in-hand sensing and servo control framework for harvesting robotics in dense vegetation","volume":"146","author":"Barth","year":"2016","journal-title":"Biosyst. Eng."},{"key":"ref_23","first-page":"154","article-title":"Feedback Locating Control Based on Close Scene for Cucumber Harvesting Robot","volume":"2","author":"Feng","year":"2011","journal-title":"Trans. Chin. Soc. Agric. Mach."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1016\/j.biosystemseng.2011.07.005","article-title":"Design and control of an apple harvesting robot","volume":"110","author":"Zhao","year":"2011","journal-title":"Biosyst. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Lehnert, C., Sa, I., Mccool, C., Upcroft, B., and Perez, T. (2016, January 16\u201321). Sweet pepper pose detection and grasping for automated crop harvesting. Proceedings of the IEEE International Conference on Robotics and Automation, Stockholm, Sweden.","DOI":"10.1109\/ICRA.2016.7487394"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1016\/j.compag.2016.03.007","article-title":"Robust visual servo control in the presence of fruit motion for robotic citrus harvesting","volume":"123","author":"Mehta","year":"2016","journal-title":"Comput. Electron.n Agric."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1016\/j.compag.2016.06.022","article-title":"A review of key techniques of vision-based control for harvesting robot","volume":"127","author":"Zhao","year":"2016","journal-title":"Comput. Electron. Agric."},{"key":"ref_28","first-page":"876","article-title":"Kinect 3D reconstruction for quantification of grape bunches volume and mass","volume":"15","author":"Marinello","year":"2016","journal-title":"Eng. Rural Dev."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"20463","DOI":"10.3390\/s150820463","article-title":"In Situ 3D Segmentation of Individual Plant Leaves Using a RGB-D Camera for Agricultural Automation","volume":"15","author":"Xia","year":"2015","journal-title":"Sensors"},{"key":"ref_30","first-page":"32","article-title":"Depth-sphere Transversal Method for on-branch Citrus Fruit Recognition","volume":"10","author":"Liu","year":"2017","journal-title":"Trans. Chin. Soc. Agric. Mach."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/5\/1510\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:04:11Z","timestamp":1760195051000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/5\/1510"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,5,11]]},"references-count":30,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2018,5]]}},"alternative-id":["s18051510"],"URL":"https:\/\/doi.org\/10.3390\/s18051510","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,5,11]]}}}