{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,22]],"date-time":"2026-01-22T07:40:48Z","timestamp":1769067648548,"version":"3.49.0"},"reference-count":48,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2021,10,21]],"date-time":"2021-10-21T00:00:00Z","timestamp":1634774400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Monitoring fruit growth is useful when estimating final yields in advance and predicting optimum harvest times. However, observing fruit all day at the farm via RGB images is not an easy task because the light conditions are constantly changing. In this paper, we present CROP (Central Roundish Object Painter). The method involves image segmentation by deep learning, and the architecture of the neural network is a deeper version of U-Net. CROP identifies different types of central roundish fruit in an RGB image in varied light conditions, and creates a corresponding mask. Counting the mask pixels gives the relative two-dimensional size of the fruit, and in this way, time-series images may provide a non-contact means of automatically monitoring fruit growth. Although our measurement unit is different from the traditional one (length), we believe that shape identification potentially provides more information. Interestingly, CROP can have a more general use, working even for some other roundish objects. For this reason, we hope that CROP and our methodology yield big data to promote scientific advancements in horticultural science and other fields.<\/jats:p>","DOI":"10.3390\/s21216999","type":"journal-article","created":{"date-parts":[[2021,10,21]],"date-time":"2021-10-21T23:27:39Z","timestamp":1634858859000},"page":"6999","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Central Object Segmentation by Deep Learning to Continuously Monitor Fruit Growth through RGB Images"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6757-1700","authenticated-orcid":false,"given":"Motohisa","family":"Fukuda","sequence":"first","affiliation":[{"name":"Faculty of Science, Yamagata University, 1-4-12 Kojirakawa, Yamagata 990-8560, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2002-4662","authenticated-orcid":false,"given":"Takashi","family":"Okuno","sequence":"additional","affiliation":[{"name":"Faculty of Science, Yamagata University, 1-4-12 Kojirakawa, Yamagata 990-8560, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shinya","family":"Yuki","sequence":"additional","affiliation":[{"name":"Elix Inc., Daini Togo Park Building 3F, 8-34 Yonbancho, Chiyoda-ku, Tokyo 102-0081, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,10,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1016\/j.compag.2015.05.021","article-title":"Sensors and systems for fruit detection and localization: A review","volume":"116","author":"Gongal","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1003","DOI":"10.21273\/HORTSCI.21.4.1003","article-title":"Pear fruit growth and the use of diameter to estimate fruit volume and weight","volume":"21","author":"Mitchell","year":"1986","journal-title":"HortScience"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.jfoodeng.2008.11.004","article-title":"Non-destructive technologies for fruit and vegetable size determination\u2014A review","volume":"92","author":"Moreda","year":"2009","journal-title":"J. Food Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"245","DOI":"10.1016\/j.jfoodeng.2011.08.011","article-title":"Shape determination of horticultural produce using two-dimensional computer vision\u2014A review","volume":"108","author":"Moreda","year":"2012","journal-title":"J. Food Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1016\/j.scienta.2016.03.036","article-title":"From fruitlet to harvest: Modelling and predicting size and its distributions for tomato, apple and pepper fruit","volume":"204","author":"Tijskens","year":"2016","journal-title":"Sci. Hortic."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1380","DOI":"10.21273\/HORTSCI.42.6.1380","article-title":"A low-cost device for accurate and continuous measurements of fruit diameter","volume":"42","author":"Morandi","year":"2007","journal-title":"HortScience"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.compag.2016.02.028","article-title":"A new optoelectronic sensor for monitoring fruit or stem radial growth","volume":"123","author":"Thalheimer","year":"2016","journal-title":"Comput. Electron. Agric."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"105336","DOI":"10.1016\/j.compag.2020.105336","article-title":"A novel image measurement algorithm for common mushroom caps based on convolutional neural network","volume":"171","author":"Lu","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"26911","DOI":"10.1109\/ACCESS.2020.2971524","article-title":"Deep Learning Approach for Apple Edge Detection to Remotely Monitor Apple Growth in Orchards","volume":"8","author":"Wang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_10","unstructured":"Redmon, J., and Farhadi, A. (2019). Yolov3: An incremental improvement. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"196","DOI":"10.1111\/j.1755-0238.2004.tb00022.x","article-title":"Yield prediction from digital image analysis: A technique with potential for vineyard assessments prior to harvest","volume":"10","author":"Dunn","year":"2004","journal-title":"Aust. J. Grape Wine Res."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.compag.2012.11.009","article-title":"Estimation of mango crop yield using image analysis\u2013segmentation method","volume":"91","author":"Payne","year":"2013","journal-title":"Comput. Electron. Agric."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.compag.2017.05.019","article-title":"An yield estimation in citrus orchards via fruit detection and counting using image processing","volume":"140","author":"Dorj","year":"2017","journal-title":"Comput. Electron. Agric."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"837","DOI":"10.1002\/rob.21541","article-title":"Automated visual yield estimation in vineyards","volume":"31","author":"Nuske","year":"2014","journal-title":"J. Field Robot."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"12191","DOI":"10.3390\/s140712191","article-title":"On plant detection of intact tomato fruits using image analysis and machine learning methods","volume":"14","author":"Yamamoto","year":"2014","journal-title":"Sensors"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Hung, C., Nieto, J., Taylor, Z., Underwood, J., and Sukkarieh, S. (2013, January 3\u20137). Orchard fruit segmentation using multi-spectral feature learning. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan.","DOI":"10.1109\/IROS.2013.6697125"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"230","DOI":"10.1016\/j.proeng.2012.04.185","article-title":"Implementation of Hough transform for fruit image segmentation","volume":"35","year":"2012","journal-title":"Procedia Eng."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1016\/j.jfoodeng.2010.04.015","article-title":"Estimating volume and mass of citrus fruits by image processing technique","volume":"100","author":"Omid","year":"2010","journal-title":"J. Food Eng."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Wang, Z., Koirala, A., Walsh, K., Anderson, N., and Verma, B. (2018). In field fruit sizing using a smart phone application. Sensors, 18.","DOI":"10.3390\/s18103331"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1016\/j.compag.2013.02.009","article-title":"An image segmentation method for apple sorting and grading using support vector machine and Otsu\u2019s method","volume":"94","author":"Mizushima","year":"2013","journal-title":"Comput. Electron. Agric."},{"key":"ref_22","first-page":"91","article-title":"Faster r-cnn: Towards real-time object detection with region proposal networks","volume":"28","author":"Ren","year":"2015","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Bargoti, S., and Underwood, J. (June, January 29). Deep fruit detection in orchards. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.","DOI":"10.1109\/ICRA.2017.7989417"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2296","DOI":"10.1109\/LRA.2019.2901987","article-title":"Monocular Camera Based Fruit Counting and Mapping with Semantic Data Association","volume":"4","author":"Liu","year":"2019","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Sa, I., Ge, Z., Dayoub, F., Upcroft, B., Perez, T., and McCool, C. (2016). Deepfruits: A fruit detection system using deep neural networks. Sensors, 16.","DOI":"10.3390\/s16081222"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Huang, Z., Huang, L., Gong, Y., Huang, C., and Wang, X. (2019, January 16\u201320). Mask scoring r-cnn. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00657"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"105247","DOI":"10.1016\/j.compag.2020.105247","article-title":"Grape detection, segmentation, and tracking using deep neural networks and three-dimensional association","volume":"170","author":"Santos","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41438-020-0323-3","article-title":"Deep learning image segmentation and extraction of blueberry fruit traits associated with harvestability and yield","volume":"7","author":"Ni","year":"2020","journal-title":"Hortic. Res."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Rahnemoonfar, M., and Sheppard, C. (2017). Deep count: Fruit counting based on deep simulated learning. Sensors, 17.","DOI":"10.3390\/s17040905"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1039","DOI":"10.1002\/rob.21699","article-title":"Image segmentation for fruit detection and yield estimation in apple orchards","volume":"34","author":"Bargoti","year":"2017","journal-title":"J. Field Robot."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1109\/LRA.2017.2651944","article-title":"Counting apples and oranges with deep learning: A data-driven approach","volume":"2","author":"Chen","year":"2017","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.compag.2018.02.016","article-title":"Deep learning in agriculture: A survey","volume":"147","author":"Kamilaris","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22\u201329). Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.74"},{"key":"ref_34","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Milletari, F., Navab, N., and Ahmadi, S.A. (2016, January 25\u201328). V-net: Fully convolutional neural networks for volumetric medical image segmentation. Proceedings of the 2016 Fourth International Conference on 3D Vision (3DV), Stanford, CA, USA.","DOI":"10.1109\/3DV.2016.79"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1007\/BF00344251","article-title":"Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position","volume":"36","author":"Fukushima","year":"1980","journal-title":"Biol. Cybern."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_39","first-page":"1097","article-title":"Imagenet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Long, J., Shelhamer, E., and Darrell, T. (2015, January 7\u201312). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298965"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Noh, H., Hong, S., and Han, B. (2015, January 7\u201313). Learning deconvolution network for semantic segmentation. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.178"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"2481","DOI":"10.1109\/TPAMI.2016.2644615","article-title":"Segnet: A deep convolutional encoder-decoder architecture for image segmentation","volume":"39","author":"Badrinarayanan","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8\u201314). Encoder-decoder with atrous separable convolution for semantic image segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"ref_44","unstructured":"Wada, K. (2021, October 20). labelme: Image Polygonal Annotation with Python. Available online: https:\/\/github.com\/wkentaro\/labelme."},{"key":"ref_45","unstructured":"Wallach, H., Larochelle, H., Beygelzimer, A., d\u2019Alch\u00e9-Buc, F., Fox, E., and Garnett, R. (2019). PyTorch: An Imperative Style, High-Performance Deep Learning Library. Advances in Neural Information Processing Systems 32, Curran Associates, Inc."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1109\/MCSE.2007.55","article-title":"Matplotlib: A 2D graphics environment","volume":"9","author":"Hunter","year":"2007","journal-title":"Comput. Sci. Eng."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"3021","DOI":"10.21105\/joss.03021","article-title":"seaborn: Statistical data visualization","volume":"6","author":"Waskom","year":"2021","journal-title":"J. Open Source Softw."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Li, Y., Hou, X., Koch, C., Rehg, J.M., and Yuille, A.L. (2014, January 23\u201328). The secrets of salient object segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.43"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/21\/6999\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:20:45Z","timestamp":1760167245000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/21\/6999"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,21]]},"references-count":48,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2021,11]]}},"alternative-id":["s21216999"],"URL":"https:\/\/doi.org\/10.3390\/s21216999","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,21]]}}}