{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T10:41:50Z","timestamp":1780569710069,"version":"3.54.1"},"reference-count":55,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2019,2,1]],"date-time":"2019-02-01T00:00:00Z","timestamp":1548979200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004608","name":"Natural Science Foundation of Jiangsu Province","doi-asserted-by":"publisher","award":["BK20180515"],"award-info":[{"award-number":["BK20180515"]}],"id":[{"id":"10.13039\/501100004608","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["31471419"],"award-info":[{"award-number":["31471419"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Automatic recognition of ripening tomatoes is a main hurdle precluding the replacement of manual labour by robotic harvesting. In this paper, we present a novel automatic algorithm for recognition of ripening tomatoes using an improved method that combines multiple features, feature analysis and selection, a weighted relevance vector machine (RVM) classifier, and a bi-layer classification strategy. The algorithm operates using a two-layer strategy. The first-layer classification strategy aims to identify tomato-containing regions in images using the colour difference information. The second classification strategy is based on a classifier that is trained on multi-medium features. In our proposed algorithm, to simplify the calculation and to improve the recognition efficiency, the processed images are divided into 9 \u00d7 9 pixel blocks, and these blocks, rather than single pixels, are considered as the basic units in the classification task. Six colour-related features, namely the Red (R), Green (G), Blue (B), Hue (H), Saturation (S) and Intensity (I) components, respectively, colour components, and five textural features (entropy, energy, correlation, inertial moment and local smoothing) were extracted from pixel blocks. Relevant features and their weights were analysed using the iterative RELIEF (I-RELIEF) algorithm. The image blocks were classified into different categories using a weighted RVM classifier based on the selected relevant features. The final results of tomato recognition were determined by combining the block classification results and the bi-layer classification strategy. The algorithm demonstrated the detection accuracy of 94.90% on 120 images, this suggests that the proposed algorithm is effective and suitable for tomato detection<\/jats:p>","DOI":"10.3390\/s19030612","type":"journal-article","created":{"date-parts":[[2019,2,1]],"date-time":"2019-02-01T11:19:58Z","timestamp":1549019998000},"page":"612","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":52,"title":["Automatic Recognition of Ripening Tomatoes by Combining Multi-Feature Fusion with a Bi-Layer Classification Strategy for Harvesting Robots"],"prefix":"10.3390","volume":"19","author":[{"given":"Jingui","family":"Wu","sequence":"first","affiliation":[{"name":"College of Engineering, Nanjing Agricultural University, Nanjing 210031, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Baohua","family":"Zhang","sequence":"additional","affiliation":[{"name":"College of Engineering, Nanjing Agricultural University, Nanjing 210031, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jun","family":"Zhou","sequence":"additional","affiliation":[{"name":"College of Engineering, Nanjing Agricultural University, Nanjing 210031, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yingjun","family":"Xiong","sequence":"additional","affiliation":[{"name":"College of Engineering, Nanjing Agricultural University, Nanjing 210031, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Baoxing","family":"Gu","sequence":"additional","affiliation":[{"name":"College of Engineering, Nanjing Agricultural University, Nanjing 210031, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaolong","family":"Yang","sequence":"additional","affiliation":[{"name":"College of Horticulture, Shenyang Agricultural University, Shenyang 110866, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2019,2,1]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.procs.2015.12.378","article-title":"Trends in Robotic Sensor Technologies for Fruit Harvesting: 2010\u20132015","volume":"77","author":"Zujevs","year":"2015","journal-title":"Procedia Comput. Sci."},{"key":"ref_2","first-page":"84","article-title":"Harvesting quality status and development trend of mechanical cotton harvester","volume":"22","author":"Chen","year":"2013","journal-title":"IAEJ"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.biosystemseng.2016.05.001","article-title":"Detecting tomatoes in greenhouse scenes by combining AdaBoost classifier and colour analysis","volume":"148","author":"Zhao","year":"2016","journal-title":"Biosyst. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"3880","DOI":"10.1016\/j.ijleo.2012.11.079","article-title":"Human detection based on motion object extraction and head\u2013shoulder feature","volume":"124","author":"Ye","year":"2013","journal-title":"Opt. Int. J. Light Electron Opt."},{"key":"ref_5","first-page":"19","article-title":"Design of structured-light vision system for tomato harvesting robot","volume":"7","author":"Feng","year":"2014","journal-title":"Int. J. Agric. Biol. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.biosystemseng.2015.07.011","article-title":"Computer vision recognition of stem and calyx in apples using near-infrared linear-array structured light and 3D reconstruction","volume":"139","author":"Zhang","year":"2015","journal-title":"Biosyst. Eng."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/j.compag.2007.07.002","article-title":"Creating a panoramic field image using multi-spectral stereovision system","volume":"60","author":"Kise","year":"2008","journal-title":"Comput. Electron. Agric."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Sumriddetchkajorn, S., and Intaravanne, Y. (2013, January 26\u201328). Two-dimensional fruit ripeness estimation using thermal imaging. Proceedings of the International Conference on Photonics Solution, Pattaya, Thailand.","DOI":"10.1117\/12.2019654"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1023\/A:1020568125418","article-title":"An Autonomous Robot for Harvesting Cucumbers in Greenhouses","volume":"13","author":"Henten","year":"2002","journal-title":"Auton. Robots"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/j.compag.2008.01.018","article-title":"Cherry-harvesting robot","volume":"63","author":"Tanigaki","year":"2008","journal-title":"Comput. Electron. Agric."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.compag.2008.12.006","article-title":"Robotic harvesting of Gerbera Jamesonii based on detection and three-dimensional modeling of cut flower pedicels","volume":"66","author":"Rath","year":"2009","journal-title":"Comput. Electron. Agric."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1007\/s11119-010-9198-x","article-title":"Low and high-level visual feature-based apple detection from multi-modal images","volume":"11","author":"Wachs","year":"2010","journal-title":"Precis. Agric."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.biosystemseng.2013.07.007","article-title":"Identification and determination of the number of immature green citrus fruit in a canopy under different ambient light conditions","volume":"117","author":"Sengupta","year":"2014","journal-title":"Biosyst. Eng."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Lu, J., and Sang, N. (2015). Detecting Citrus Fruits and Occlusion Recovery under Natural Illumination Conditions, Elsevier Science Publishers B. V.","DOI":"10.1016\/j.compag.2014.10.016"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Maldonado, W. (2016). Automatic Green Fruit Counting in Orange Trees Using Digital Images, Elsevier Science Publishers B. V.","DOI":"10.1016\/j.compag.2016.07.023"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1039","DOI":"10.1002\/rob.21699","article-title":"Image Segmentation for Fruit Detection and Yield Estimation in Apple Orchards","volume":"34","author":"Bargoti","year":"2017","journal-title":"J. Field Robot."},{"key":"ref_17","first-page":"328","article-title":"Green ripe tomato detection method based on machine vision in greenhouse","volume":"33","author":"Li","year":"2017","journal-title":"Trans. Chin. Soc. Agric. Eng."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/j.compag.2018.01.011","article-title":"A methodology for fresh tomato maturity detection using computer vision","volume":"146","author":"Wan","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_19","first-page":"1538","article-title":"A Review of Computer Vision Methods for Fruit Recognition","volume":"24","author":"Witus","year":"2018","journal-title":"Int. J. Eng."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1719","DOI":"10.1016\/S0031-3203(98)00170-8","article-title":"Automatic fruit recognition: A survey and new results using Range\/Attenuation images","volume":"32","author":"Jain","year":"1999","journal-title":"Pattern Recognit."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1007\/PL00013271","article-title":"Localization of spherical fruits for robotic harvesting","volume":"13","author":"Plebe","year":"2001","journal-title":"Mach. Vis. Appl."},{"key":"ref_22","first-page":"98","article-title":"Identification of citrus fruit in a tree canopy using color information","volume":"21","author":"Xu","year":"2005","journal-title":"Trans. Chin. Soc. Agric. Eng."},{"key":"ref_23","unstructured":"Hannan, M.W., Burks, T.F., and Bulanon, D.M. (2019, January 31). A Machine Vision Algorithm Combining Adaptive Segmentation and Shape Analysis for Orange Fruit Detection. Available online: http:\/\/www.cigrjournal.org\/index.php\/Ejounral\/article\/view\/1281."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/j.compag.2011.11.007","article-title":"Determination of the number of green apples in RGB images recorded in orchards","volume":"81","author":"Linker","year":"2012","journal-title":"Comput. Electron. Agric."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1186","DOI":"10.1016\/j.compeleceng.2011.11.005","article-title":"Automatic recognition vision system guided for apple harvesting robot","volume":"38","author":"Ji","year":"2012","journal-title":"Comput. Electr. Eng."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1080\/10798587.2013.771451","article-title":"In-Field Recognition and Navigation Path Extraction for Pineapple Harvesting Robots","volume":"19","author":"Li","year":"2013","journal-title":"Intell. Autom. Soft Comput."},{"key":"ref_27","first-page":"28","article-title":"Application of Image Processing in Fruit and Vegetable Analysis: A Review","volume":"24","author":"Dubey","year":"2014","journal-title":"J. Intell. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1016\/j.biosystemseng.2016.08.026","article-title":"Vision-based extraction of spatial information in grape clusters for harvesting robots","volume":"151","author":"Luo","year":"2016","journal-title":"Biosyst. Eng."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Nguyen, B.P., Heemskerk, H., So, P.T., and Tucker-Kellogg, L. (2016). Superpixel-based segmentation of muscle fibers in multi-channel microscopy. BMC Syst. Biol., 10.","DOI":"10.1186\/s12918-016-0372-2"},{"key":"ref_30","unstructured":"Chen, X., Nguyen, B.P., Chui, C.K., and Ong, S.H. (2017, January 9\u201312). Automated brain tumor segmentation using kernel dictionary learning and superpixel-level features. Proceedings of the 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Budapest, Hungary."},{"key":"ref_31","first-page":"1144","article-title":"Recognition and localization of ripen tomato based on machine vision","volume":"5","author":"Arefi","year":"2011","journal-title":"Aust. J. Crop Sci."},{"key":"ref_32","first-page":"97","article-title":"Applications of the generalized Hough transform in recognizing occluded image","volume":"24","author":"Yao","year":"2008","journal-title":"Trans. Chin. Soc. Agric. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhao, J., Tow, J., and Katupitiya, J. (2005, January 2\u20136). On-tree fruit recognition using texture properties and color data. Proceedings of the 2005 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Edmonton, AB, Canada.","DOI":"10.1109\/IROS.2005.1545592"},{"key":"ref_34","first-page":"90","article-title":"Fruit Recognition using Color and Texture Features","volume":"1","author":"Shebiah","year":"2010","journal-title":"J. Emerg. Trends Comput. Inf. Sci."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"388","DOI":"10.1016\/j.compag.2017.09.019","article-title":"Automatic apple recognition based on the fusion of color and 3D feature for robotic fruit picking","volume":"142","author":"Tao","year":"2017","journal-title":"Comput. Electron. Agric."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"535","DOI":"10.1016\/S0031-3203(02)00058-4","article-title":"New training strategies for RBF neural networks for X","volume":"36","author":"Casasent","year":"2003","journal-title":"Pattern Recognit."},{"key":"ref_37","unstructured":"Bulanon, D.M., Kataoka, T., Okamoto, H., and Hata, S. (2004, January 4\u20136). Development of a real-time machine vision system for the apple harvesting robot. Proceedings of the Sice 2004 Conference, Sapporo, Japan."},{"key":"ref_38","first-page":"142","article-title":"Machine visionbased Citrus yield mapping system","volume":"119","author":"Chinchuluun","year":"2006","journal-title":"Proc. Fla. State Hort. Soc."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2843","DOI":"10.1016\/j.patcog.2011.12.010","article-title":"On-line multi-stage sorting algorithm for agriculture products","volume":"45","author":"Laykin","year":"2012","journal-title":"Pattern Recognit."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.compag.2015.05.021","article-title":"Sensors and systems for fruit detection and localization","volume":"116","author":"Gongal","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Yin, H., Chai, Y., Yang, S.X., and Mittal, G.S. (2009, January 4\u20137). Ripe Tomato Recognition and Localization for a Tomato Harvesting Robotic System. Proceedings of the 2009 International Conference of Soft Computing and Pattern Recognition, Malacca, Malaysia.","DOI":"10.1109\/SoCPaR.2009.111"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/THMS.2015.2453203","article-title":"Robust Biometric Recognition from Palm Depth Images for Gloved Hands","volume":"45","author":"Nguyen","year":"2015","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Sa, I., Ge, Z., Dayoub, F., Upcroft, B., Perez, T., and McCool, C. (2016). DeepFruits: A Fruit Detection System Using Deep Neural Networks. Sensors, 16.","DOI":"10.3390\/s16081222"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Bargoti, S., and Underwood, J. (June, January 29). Deep Fruit Detection in Orchards. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.","DOI":"10.1109\/ICRA.2017.7989417"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/j.biosystemseng.2013.12.008","article-title":"Automatic fruit recognition and counting from multiple images","volume":"118","author":"Song","year":"2014","journal-title":"Biosyst. Eng."},{"key":"ref_46","first-page":"602","article-title":"A Method for Cucumber Identification Based on Iterative-RELIEF and Relevance Vector Machine","volume":"47","author":"Jin","year":"2013","journal-title":"J. Shanghai Jiaotong Univ."},{"key":"ref_47","unstructured":"Cupec, R. (2016). Crop Row Detection by Global Energy Minimization, Elsevier Science Inc."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"597","DOI":"10.1016\/j.jfoodeng.2005.10.038","article-title":"Stem and calyx recognition on \u2019Jonagold\u2019 apples by pattern recognition","volume":"78","author":"Unay","year":"2007","journal-title":"J. Food Eng."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"1035","DOI":"10.1109\/TPAMI.2007.1093","article-title":"Iterative RELIEF for Feature Weighting: Algorithms, Theories, and Applications","volume":"29","author":"Sun","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1016\/j.jfoodeng.2014.08.024","article-title":"Computer vision detection of defective apples using automatic lightness correction and weighted RVM classifier","volume":"146","author":"Zhang","year":"2015","journal-title":"J. Food Eng."},{"key":"ref_51","first-page":"211","article-title":"Sparse bayesian learning and the relevance vector machine","volume":"1","author":"Tipping","year":"2001","journal-title":"JMLR"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1002\/lsm.20160","article-title":"Relevance vector machine for optical diagnosis of cancer","volume":"36","author":"Majumder","year":"2005","journal-title":"Lasers Surg. Med."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1109\/TMI.2004.842457","article-title":"A study on several Machine-learning methods for classification of Malignant and benign clustered microcalcifications","volume":"24","author":"Wei","year":"2005","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"1278","DOI":"10.1109\/TMI.2005.855435","article-title":"Relevance vector machine for automatic detection of clustered microcalcifications","volume":"24","author":"Wei","year":"2005","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"586","DOI":"10.1109\/LGRS.2007.903069","article-title":"Hyperspectral Image Classification Using Relevance Vector Machines","volume":"4","author":"Demir","year":"2007","journal-title":"IEEE Geosci. Remote Sens. Lett."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/3\/612\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:30:12Z","timestamp":1760185812000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/19\/3\/612"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,2,1]]},"references-count":55,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2019,2]]}},"alternative-id":["s19030612"],"URL":"https:\/\/doi.org\/10.3390\/s19030612","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,2,1]]}}}