{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,26]],"date-time":"2026-02-26T01:51:07Z","timestamp":1772070667472,"version":"3.50.1"},"reference-count":36,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2017,11,7]],"date-time":"2017-11-07T00:00:00Z","timestamp":1510012800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Recognition and matching of litchi fruits are critical steps for litchi harvesting robots to successfully grasp litchi. However, due to the randomness of litchi growth, such as clustered growth with uncertain number of fruits and random occlusion by leaves, branches and other fruits, the recognition and matching of the fruit become a challenge. Therefore, this study firstly defined mature litchi fruit as three clustered categories. Then an approach for recognition and matching of clustered mature litchi fruit was developed based on litchi color images acquired by binocular charge-coupled device (CCD) color cameras. The approach mainly included three steps: (1) calibration of binocular color cameras and litchi image acquisition; (2) segmentation of litchi fruits using four kinds of supervised classifiers, and recognition of the pre-defined categories of clustered litchi fruit using a pixel threshold method; and (3) matching the recognized clustered fruit using a geometric center-based matching method. The experimental results showed that the proposed recognition method could be robust against the influences of varying illumination and occlusion conditions, and precisely recognize clustered litchi fruit. In the tested 432 clustered litchi fruits, the highest and lowest average recognition rates were 94.17% and 92.00% under sunny back-lighting and partial occlusion, and sunny front-lighting and non-occlusion conditions, respectively. From 50 pairs of tested images, the highest and lowest matching success rates were 97.37% and 91.96% under sunny back-lighting and non-occlusion, and sunny front-lighting and partial occlusion conditions, respectively.<\/jats:p>","DOI":"10.3390\/s17112564","type":"journal-article","created":{"date-parts":[[2017,11,7]],"date-time":"2017-11-07T11:46:01Z","timestamp":1510055161000},"page":"2564","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":51,"title":["Recognition and Matching of Clustered Mature Litchi Fruits Using Binocular Charge-Coupled Device (CCD) Color Cameras"],"prefix":"10.3390","volume":"17","author":[{"given":"Chenglin","family":"Wang","sequence":"first","affiliation":[{"name":"Key Laboratory of Key Technology on Agricultural Machine and Equipment, Ministry of Education, South China Agricultural University, Guangzhou 510642, China"}]},{"given":"Yunchao","family":"Tang","sequence":"additional","affiliation":[{"name":"School of Civil and Transportation Engineering, Guangdong University of Technology, Guangzhou 510006, China"}]},{"given":"Xiangjun","family":"Zou","sequence":"additional","affiliation":[{"name":"Key Laboratory of Key Technology on Agricultural Machine and Equipment, Ministry of Education, South China Agricultural University, Guangzhou 510642, China"}]},{"given":"Lufeng","family":"Luo","sequence":"additional","affiliation":[{"name":"School of Mechanical and Electrical Engineering, Foshan University, Foshan 528000, China"}]},{"given":"Xiong","family":"Chen","sequence":"additional","affiliation":[{"name":"Key Laboratory of Key Technology on Agricultural Machine and Equipment, Ministry of Education, South China Agricultural University, Guangzhou 510642, China"}]}],"member":"1968","published-online":{"date-parts":[[2017,11,7]]},"reference":[{"key":"ref_1","unstructured":"(2017, July 14). Overview of Litchi Industry in the World, Available online: http:\/\/ir.tari.gov.tw:8080\/bitstream\/345210000\/5854\/2\/no171-2.pdf."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Baeten, J., Donn\u00e9, K., Boedrij, S., Beckers, W., and Claesen, E. (2008). Autonomous fruit picking machine: A robotic apple harvester. Field and Service Robotics, Springer.","DOI":"10.1007\/978-3-540-75404-6_51"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1108\/01439919810232440","article-title":"Design and implementation of an aided fruit-harvesting robot (Agribot)","volume":"25","author":"Ceres","year":"1998","journal-title":"Ind. Robot"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1016\/S1881-8366(13)80017-1","article-title":"Study of an autonomous fruit picking robot system in greenhouses","volume":"6","author":"Yichich","year":"2013","journal-title":"Eng. Agric. Environ. Food"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/0273-1177(95)00806-P","article-title":"Fruit harvesting robots in Japan","volume":"18","author":"Kondo","year":"1996","journal-title":"Adv. Space Res."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"95","DOI":"10.3182\/20101206-3-JP-3009.00016","article-title":"Development of robotic strawberry harvester to approach target fruit from hanging bench side","volume":"43","author":"Yamamoto","year":"2010","journal-title":"IFAC Proc. Vol."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Yasukawa, S., Li, B., Sonoda, T., and Ishii, K. (2017, January 19\u201322). Development of a Tomato Harvesting Robot. Proceedings of the 2017 International Conference on Artificial Life and Robotics, Miyazaki, Japan.","DOI":"10.5954\/ICAROB.2017.OS22-1"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/j.biosystemseng.2008.08.002","article-title":"Study on temporal variation in citrus canopy using thermal imaging for citrus fruit detection","volume":"101","author":"Bulanon","year":"2008","journal-title":"Biosyst. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Wachs, J., Stern, H.I., Burks, T., Alchanatis, V., and Betdagan, I. (2009, January 6\u20138). Apple detection in natural tree canopies from multimodal images. Proceedings of the 7th European Conference on Precision Agriculture, Wageningen, The Netherlands.","DOI":"10.3920\/9789086866649_036"},{"key":"ref_10","unstructured":"Kane, K.E., and Lee, W.S. (2007, January 17\u201320). Multispectral imaging for in-field green citrus identification. Proceedings of the ASABE Annual International Meeting, Minneapolis, Minnesota."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2303","DOI":"10.13031\/2013.24083","article-title":"Detection of green apples in hyperspectral images of apple-tree foliage using machine vision","volume":"50","author":"Safren","year":"2007","journal-title":"Trans. ASABE"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1016\/S1881-8366(09)80023-2","article-title":"Machine Vision Algorithm for Robots to Harvest Strawberries in Tabletop Culture Greenhouses","volume":"2","author":"Rajendra","year":"2009","journal-title":"Eng. Agric. Environ. Food"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1006\/bioe.2002.0132","article-title":"AE\u2014Automation and emerging technologies: A segmentation algorithm for the automatic recognition of Fuji apples at harvest","volume":"83","author":"Bulanon","year":"2002","journal-title":"Biosyst. Eng."},{"key":"ref_14","first-page":"1144","article-title":"Recognition and localization of ripen tomato based on machine vision","volume":"5","author":"Arefi","year":"2011","journal-title":"Aust. J. Crop Sci."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Akin, C., Kirci, M., Gunes, E.O., and Cakir, Y. (2012, January 2\u20134). Detection of the pomegranate fruits on tree using image processing. Proceedings of the 2012 First International Conference on Agro-Geoinformatics, Shanghai, China.","DOI":"10.1109\/Agro-Geoinformatics.2012.6311724"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.compag.2012.11.009","article-title":"Estimation of mango crop yield using image analysis segmentation method","volume":"91","author":"Payne","year":"2013","journal-title":"Comput. Electron. Agric."},{"key":"ref_17","first-page":"52","article-title":"Kiwifruit recognition at nighttime using artificial lighting based on machine vision","volume":"8","author":"Fu","year":"2015","journal-title":"Int. J. Agric. Biol. Eng."},{"key":"ref_18","first-page":"23","article-title":"Grape image fast segmentation based on improved artificial bee colony and fuzzy clustering","volume":"46","author":"Luo","year":"2015","journal-title":"Trans. CSAM"},{"key":"ref_19","first-page":"162","article-title":"Recognition of mature litchi in natural environment based on machine vision","volume":"42","author":"Xiong","year":"2011","journal-title":"Trans. CSAM"},{"key":"ref_20","first-page":"191","article-title":"Color feature analysis and recognition for litchi fruits and their main fruit bearing branch based on exploratory analysis","volume":"29","author":"Guo","year":"2013","journal-title":"Trans. CSAM"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.biosystemseng.2016.02.004","article-title":"Localisation of litchi in an unstructured environment using binocular stereo vision","volume":"145","author":"Wang","year":"2016","journal-title":"Biosyst. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Luo, L., Tang, Y., Zou, X., Wang, C., Zhang, P., and Feng, W. (2016). Robust Grape Cluster Detection in a Vineyard by Combining the AdaBoost Framework and Multiple Color Components. Sensors, 16.","DOI":"10.3390\/s16122098"},{"key":"ref_23","unstructured":"Chinchuluun, R., Lee, W.S., and Burks, T.F. (2006, January 4\u20136). Machine vision-based citrus yield mapping system. Proceedings of the 119th annual meeting of the Florida State Horticultural Society, Tamp, FL, USA."},{"key":"ref_24","unstructured":"Seng, W.C., and Mirisaee, S.H. (2009, January 5\u20137). A new method for fruits recognition system. Proceedings of the 2009 International Conference on Electrical Engineering and Informatics, Selangor, Malaysia."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1007\/s11119-010-9198-x","article-title":"Low and high-level visual feature-based apple detection from multi-modal images","volume":"11","author":"Wachs","year":"2010","journal-title":"Precis. Agric."},{"key":"ref_26","first-page":"115","article-title":"Identification of fruit and branch in natural scenes for citrus harvesting robot using machine vision and support vector machine","volume":"7","author":"Qiang","year":"2014","journal-title":"Int. J. Agric. Biol. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Jian, L., Shujuan, C., Chengyan, Z., and Haifeng, C. (August, January 31). Research on localization of apples based on binocular stereo vision marked by cancroids matching. Proceedings of the 2012 Third International Conference on Digital Manufacturing and Automation, Guilin, China.","DOI":"10.1109\/ICDMA.2012.161"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1016\/j.compag.2015.01.010","article-title":"Location of apples in trees using stereoscopic vision","volume":"112","author":"Si","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1007\/s00138-010-0291-y","article-title":"Virtual manipulator-based binocular stereo vision positioning system and errors modeling","volume":"23","author":"Zou","year":"2012","journal-title":"Mach. Vis. Appl."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1109\/TSMC.1978.4309999","article-title":"Texture features corresponding to visual perception","volume":"8","author":"Tamura","year":"1978","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_31","first-page":"4","article-title":"A review of machine learning algorithms for text-documents classification","volume":"1","author":"Khan","year":"2010","journal-title":"J. Adv. Inf. Technol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1023\/A:1007413511361","article-title":"On the optimality of the simple Bayesian classifier under zero-one loss","volume":"29","author":"Pedro","year":"1997","journal-title":"Mach. Learn."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Wang, L., and Zhao, X. (2012, January 21\u201323). Improved knn classification algortihm research in text categorization. Proceedings of the 2nd International Conference on Communications and Networks, Yichang, China.","DOI":"10.1109\/CECNet.2012.6201850"},{"key":"ref_34","first-page":"449","article-title":"Learning sample selection in multi-spectral remote sensing image classification using BP neural network","volume":"6","author":"Yu","year":"1999","journal-title":"J. Infrared Millim. Waves"},{"key":"ref_35","unstructured":"Reyna, R.A., Hernandez, N., Esteve, D., and Cattoen, M. (2000, January 10\u201313). Segmenting images with support vector machines. Proceedings of the IEEE International Conference on Image Processing (ICIP 2000), Vancouver, BC, Canada."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"305","DOI":"10.1016\/j.biosystemseng.2003.08.002","article-title":"Field test of an autonomous cucumber picking robot","volume":"86","author":"Hemming","year":"2003","journal-title":"Biosyst. Eng."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/11\/2564\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:48:32Z","timestamp":1760208512000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/11\/2564"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,11,7]]},"references-count":36,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2017,11]]}},"alternative-id":["s17112564"],"URL":"https:\/\/doi.org\/10.3390\/s17112564","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,11,7]]}}}