{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,28]],"date-time":"2026-02-28T16:10:58Z","timestamp":1772295058847,"version":"3.50.1"},"reference-count":33,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2022,3,23]],"date-time":"2022-03-23T00:00:00Z","timestamp":1647993600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Automated crop monitoring using image analysis is commonly used in horticulture. Image-processing technologies have been used in several studies to monitor growth, determine harvest time, and estimate yield. However, accurate monitoring of flowers and fruits in addition to tracking their movements is difficult because of their location on an individual plant among a cluster of plants. In this study, an automated clip-type Internet of Things (IoT) camera-based growth monitoring and harvest date prediction system was proposed and designed for tomato cultivation. Multiple clip-type IoT cameras were installed on trusses inside a greenhouse, and the growth of tomato flowers and fruits was monitored using deep learning-based blooming flower and immature fruit detection. In addition, the harvest date was calculated using these data and temperatures inside the greenhouse. Our system was tested over three months. Harvest dates measured using our system were comparable with the data manually recorded. These results suggest that the system could accurately detect anthesis, number of immature fruits, and predict the harvest date within an error range of \u00b12.03 days in tomato plants. This system can be used to support crop growth management in greenhouses.<\/jats:p>","DOI":"10.3390\/s22072456","type":"journal-article","created":{"date-parts":[[2022,3,23]],"date-time":"2022-03-23T22:08:06Z","timestamp":1648073286000},"page":"2456","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":35,"title":["An Automated, Clip-Type, Small Internet of Things Camera-Based Tomato Flower and Fruit Monitoring and Harvest Prediction System"],"prefix":"10.3390","volume":"22","author":[{"given":"Unseok","family":"Lee","sequence":"first","affiliation":[{"name":"Research Center for Agricultural Robotics, National Agriculture Food Research Organization (NARO), Tsukuba 305-0856, Japan"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5931-853X","authenticated-orcid":false,"given":"Md Parvez","family":"Islam","sequence":"additional","affiliation":[{"name":"Research Center for Agricultural Robotics, National Agriculture Food Research Organization (NARO), Tsukuba 305-0856, Japan"}]},{"given":"Nobuo","family":"Kochi","sequence":"additional","affiliation":[{"name":"Research Center for Agricultural Robotics, National Agriculture Food Research Organization (NARO), Tsukuba 305-0856, Japan"}]},{"given":"Kenichi","family":"Tokuda","sequence":"additional","affiliation":[{"name":"Research Center for Agricultural Robotics, National Agriculture Food Research Organization (NARO), Tsukuba 305-0856, Japan"}]},{"given":"Yuka","family":"Nakano","sequence":"additional","affiliation":[{"name":"Research Center for Agricultural Robotics, National Agriculture Food Research Organization (NARO), Tsukuba 305-0856, Japan"}]},{"given":"Hiroki","family":"Naito","sequence":"additional","affiliation":[{"name":"Research Center for Agricultural Robotics, National Agriculture Food Research Organization (NARO), Tsukuba 305-0856, Japan"}]},{"given":"Yasushi","family":"Kawasaki","sequence":"additional","affiliation":[{"name":"Research Center for Agricultural Robotics, National Agriculture Food Research Organization (NARO), Tsukuba 305-0856, Japan"}]},{"given":"Tomohiko","family":"Ota","sequence":"additional","affiliation":[{"name":"Research Center for Agricultural Robotics, National Agriculture Food Research Organization (NARO), Tsukuba 305-0856, Japan"}]},{"given":"Tomomi","family":"Sugiyama","sequence":"additional","affiliation":[{"name":"Institute of Vegetable and Floriculture Science, National Agriculture Food Research Organization (NARO), Tsukuba 305-8519, Japan"}]},{"given":"Dong-Hyuk","family":"Ahn","sequence":"additional","affiliation":[{"name":"Institute of Vegetable and Floriculture Science, National Agriculture Food Research Organization (NARO), Tsukuba 305-8519, Japan"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,23]]},"reference":[{"key":"ref_1","first-page":"217","article-title":"Correlation studies of different growth, quality and yield attributing parameters of tomato (Solanum lycopersicum L.)","volume":"2","author":"Das","year":"2017","journal-title":"Int. J. Agric. Environ. Biores."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1504\/IJCVR.2012.046419","article-title":"Computer vision for fruit harvesting robots\u2014State of the art and challenges ahead","volume":"3","author":"Kapach","year":"2012","journal-title":"Int. J. Comput. Vis. Robot."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/S0168-1699(03)00086-3","article-title":"Estimation of number and diameter of apple fruits in an orchard during the growing season by thermal imaging","volume":"42","author":"Stajnko","year":"2004","journal-title":"Comput. Electron. Agric."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Wang, Q., Nuske, S., Bergerman, M., and Singh, S. (2012, January 18\u201321). Automated crop yield estimation for apple orchards. Proceedings of the International Symposium on Experimental Robotics, Qu\u00e9bec City, QC, Canada.","DOI":"10.1007\/978-3-319-00065-7_50"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1002\/rob.21902","article-title":"A comparative study of fruit detection and counting methods for yield mapping in apple orchards","volume":"37","author":"Roy","year":"2020","journal-title":"J. Field Robot."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.biosystemseng.2013.07.007","article-title":"Identification and determination of the number of immature green citrus fruit in a canopy under different ambient light conditions","volume":"117","author":"Sengupta","year":"2014","journal-title":"Biosyst. Eng."},{"key":"ref_7","first-page":"519","article-title":"Detection and counting of on-tree citrus fruit for crop yield estimation","volume":"7","author":"Malik","year":"2016","journal-title":"Int. J. Adv. Comput. Sci. Appl."},{"key":"ref_8","first-page":"32","article-title":"Predicting Yield of Fruit and Flowers using Digital Image Analysis","volume":"8","author":"Nisar","year":"2015","journal-title":"Indian J. Sci. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1016\/j.compag.2018.12.041","article-title":"Ground based hyperspectral imaging for extensive mango yield estimation","volume":"157","author":"Wendel","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/j.biosystemseng.2013.12.008","article-title":"Automatic fruit recognition and counting from multiple images","volume":"118","author":"Song","year":"2014","journal-title":"Biosyst. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Chen, Y., Lee, W.S., Gan, H., Peres, N., Fraisse, C., Zhang, Y., and He, Y. (2019). Strawberry Yield Prediction Based on a Deep Neural Network Using High-Resolution Aerial Orthoimages. Remote Sens., 11.","DOI":"10.3390\/rs11131584"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1016\/j.biosystemseng.2016.05.001","article-title":"Detecting tomatoes in greenhouse scenes by combining AdaBoost classifier and colour analysis","volume":"148","author":"Zhao","year":"2016","journal-title":"Biosyst. Eng."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Liu, G., Mao, S., and Kim, J.H. (2019). A mature-tomato detection algorithm using machine learning and color analysis. Sensors, 19.","DOI":"10.3390\/s19092023"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Sa, I., Ge, Z., Dayoub, F., Upcroft, B., Perez, T., and Mccool, C. (2016). DeepFruits: A fruit detection system using deep neural networks. Sensors, 16.","DOI":"10.3390\/s16081222"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Rahnemoonfar, M., and Sheppard, C. (2017). Deep count: Fruit counting based on deep simulated learning. Sensors, 17.","DOI":"10.3390\/s17040905"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3003","DOI":"10.1109\/LRA.2018.2849498","article-title":"Multi-species fruit flower detection using a refined semantic segmentation network","volume":"3","author":"Dias","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.compind.2018.03.010","article-title":"Apple flower detection using deep convolutional networks","volume":"99","author":"Dias","year":"2018","journal-title":"Comput. Ind."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Sun, J., He, X., Ge, X., Wu, X., Shen, J., and Song, Y. (2018). Detection of key organs in tomato based on deep migration learning in a complex background. Agriculture, 8.","DOI":"10.20944\/preprints201810.0524.v1"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards real-time object detection with region proposal networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_20","unstructured":"Eizentals, P. (2016). Picking System for Automatic Harvesting of Sweet Pepper: Sensing and Mechanism. [Ph.D. Thesis, Kochi University of Technology Academic Resource Repository]. Available online: http:\/\/hdl.handle.net\/10173\/1417."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yuan, T., Zhang, S., Sheng, X., Wang, D., Gong, Y., and Li, W. (2016, January 19\u201321). An autonomous pollination robot for hormone treatment of tomato flower in greenhouse. Proceedings of the 3rd International Conference on Systems and Informatics (ICSAI), Shanghai, China.","DOI":"10.1109\/ICSAI.2016.7810939"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Seo, D., Cho, B.-H., and Kim, K.-C. (2021). Development of Monitoring Robot System for Tomato Fruits in Hydroponic Greenhouses. Agronomy, 11.","DOI":"10.3390\/agronomy11112211"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"652","DOI":"10.1080\/14620316.2005.11511994","article-title":"Influence of sub-optimal temperature on tomato growth and yield: A review","volume":"80","author":"Ploeg","year":"2005","journal-title":"J. Hortic. Sci. Biotechnol."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"869","DOI":"10.1006\/anbo.2001.1524","article-title":"Effect of Temperature on the Growth and Development of Tomato Fruits","volume":"88","author":"Adams","year":"2001","journal-title":"Ann. Bot."},{"key":"ref_25","unstructured":"(2022, March 19). M5Camera. Available online: https:\/\/docs.m5stack.com\/en\/unit\/m5camera."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_27","unstructured":"Redmon, J., and Farhadi, A. (2018). YOLOv3: An incremental improvement. arXiv."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1080\/00031305.2017.1380080","article-title":"Forecasting at Scale","volume":"72","author":"Taylor","year":"2018","journal-title":"Am. Stat."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"11","DOI":"10.21273\/JASHS.111.1.11","article-title":"Predicting harvesting date of processing tomatoes by a simulation model","volume":"111","author":"Wolf","year":"1986","journal-title":"J. Am. Soc. Hort. Sci."},{"key":"ref_30","first-page":"41","article-title":"Demonstration of Year-Round Production of Tomato Fruits with High Soluble-Solids Content by Low Node-Order Pinching and High-Density Planting","volume":"3","author":"Iwasaki","year":"2019","journal-title":"Bull. NARO Crop Sci."},{"key":"ref_31","first-page":"85","article-title":"Fruit Yield and Environmental Condition under Integrative Environment Control for High Yielding Production at Long-time Culture of Tomato","volume":"10","author":"Yasuba","year":"2011","journal-title":"Bull. Natl. Inst. Veg. Tea Sci."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1016\/j.compag.2019.01.012","article-title":"Apple detection during different growth stages in orchards using the improved YOLO-V3 model","volume":"157","author":"Tian","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_33","unstructured":"(2022, March 14). Hyperparameter Tuning of Prophet Package. Available online: http:\/\/facebook.github.io\/prophet\/docs\/diagnostics.html#hyperparameter-tuning."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/7\/2456\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:41:24Z","timestamp":1760136084000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/7\/2456"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,23]]},"references-count":33,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,4]]}},"alternative-id":["s22072456"],"URL":"https:\/\/doi.org\/10.3390\/s22072456","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,23]]}}}