{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,1]],"date-time":"2025-11-01T13:51:25Z","timestamp":1762005085989,"version":"build-2065373602"},"reference-count":33,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2019,4,10]],"date-time":"2019-04-10T00:00:00Z","timestamp":1554854400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>The number of leaves in maize plant is one of the key traits describing its growth conditions. It is directly related to plant development and leaf counts also give insight into changing plant development stages. Compared with the traditional solutions which need excessive human interventions, the methods of computer vision and machine learning are more efficient. However, leaf counting with computer vision remains a challenging problem. More and more researchers are trying to improve accuracy. To this end, an automated, deep learning based approach for counting leaves in maize plants is developed in this paper. A Convolution Neural Network(CNN) is used to extract leaf features. The CNN model in this paper is inspired by Google Inception Net V3, which using multi-scale convolution kernels in one convolution layer. To compress feature maps generated from some middle layers in CNN, the Fisher Vector (FV) is used to reduce redundant information. Finally, these encoded feature maps are used to regress the leaf numbers by using Random Forests. To boost the related research, a relatively single maize image dataset (Different growth stage with 2845 samples, which 80% for train and 20% for test) is constructed by our team. The proposed algorithm in single maize data set achieves Mean Square Error (MSE) of 0.32.<\/jats:p>","DOI":"10.3390\/sym11040516","type":"journal-article","created":{"date-parts":[[2019,4,10]],"date-time":"2019-04-10T11:25:08Z","timestamp":1554895508000},"page":"516","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["Leaf Counting with Multi-Scale Convolutional Neural Network Features and Fisher Vector Coding"],"prefix":"10.3390","volume":"11","author":[{"given":"Boran","family":"Jiang","sequence":"first","affiliation":[{"name":"School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China"}]},{"given":"Ping","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China"}]},{"given":"Shuo","family":"Zhuang","sequence":"additional","affiliation":[{"name":"School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China"}]},{"given":"Maosong","family":"Li","sequence":"additional","affiliation":[{"name":"Institute of Agricultural Resources and Regional Planning, Beijing 100081, China"}]},{"given":"Zhenfa","family":"Li","sequence":"additional","affiliation":[{"name":"Tianjin Climate Center, Tianjin 300074, China"}]},{"given":"Zhihong","family":"Gong","sequence":"additional","affiliation":[{"name":"Tianjin Climate Center, Tianjin 300074, China"}]}],"member":"1968","published-online":{"date-parts":[[2019,4,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"828","DOI":"10.1126\/science.1183899","article-title":"Precision agriculture and food security","volume":"327","author":"Gebbers","year":"2010","journal-title":"Science"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1682","DOI":"10.1016\/j.agwat.2010.05.025","article-title":"Root growth, available soil water, and water-use efficiency of winter wheat under different irrigation regimes applied at different growth stages in north China","volume":"97","author":"Li","year":"2010","journal-title":"Agric. Water Manag."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"773","DOI":"10.1614\/0043-1745(2002)050[0773:CPFWCT]2.0.CO;2","article-title":"Critical period for weed control: The concept and data analysis","volume":"50","author":"Knezevic","year":"2002","journal-title":"Weed Sci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1016\/j.tplants.2011.09.005","article-title":"Phenomics\u2013technologies to relieve the phenotyping bottleneck","volume":"16","author":"Furbank","year":"2011","journal-title":"Trends Plant Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"645","DOI":"10.1242\/dev.124.3.645","article-title":"Phase change and the regulation of trichome distribution in Arabidopsis thaliana","volume":"124","author":"Telfer","year":"1997","journal-title":"Development"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1169","DOI":"10.1093\/jxb\/50.336.1169","article-title":"The modular character of growth in Nicotiana tabacum plants under steady-state nutrition","volume":"50","author":"Walter","year":"1999","journal-title":"J. Exp. Bot."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1111\/j.1399-3054.1995.tb00836.x","article-title":"The effect of daylength on the transition to flowering in phytochrome-deficient, late-flowering and double mutants of Arabidopsis thaliana","volume":"95","author":"Koornneef","year":"1995","journal-title":"Physiol. Plant."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Giuffrida, M.V., Minervini, M., and Tsaftaris, S.A. (2019, March 11). Learning to Count Leaves in Rosette Plants. Available online: http:\/\/tsaftaris.com\/preprints\/Giuffrida_CVPPP2015.pdf.","DOI":"10.5244\/C.29.CVPPP.1"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ye, M., Cao, Z., and Yu, Z. (2013). An image-based approach for automatic detecting tasseling stage of maize using spatio-temporal saliency. MIPPR 2013: Remote Sensing Image Processing, Geographic Information Systems, and Other Applications, International Society for Optics and Photonics.","DOI":"10.1117\/12.2031024"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1016\/j.compag.2017.06.022","article-title":"Early detection of water stress in maize based on digital images","volume":"140","author":"Zhuang","year":"2017","journal-title":"Comput. Electron. Agric."},{"key":"ref_11","first-page":"195","article-title":"Face recognition method based on sift feature and fisher","volume":"35","author":"Cui","year":"2009","journal-title":"Comput. Eng."},{"key":"ref_12","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (July, January 26). Rethinking the inception architecture for computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_13","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"26","DOI":"10.5391\/IJFIS.2017.17.1.26","article-title":"Plant leaf recognition using a convolution neural network","volume":"17","author":"Jeon","year":"2017","journal-title":"Int. J. Fuzzy Logic Intell. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"98","DOI":"10.5391\/IJFIS.2017.17.2.98","article-title":"CNN output optimization for more balanced classification","volume":"17","author":"Choi","year":"2017","journal-title":"Int. J. Fuzzy Logic Intell. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/TGRS.2017.2711275","article-title":"Integrating multilayer features of convolutional neural networks for remote sensing scene classification","volume":"55","author":"Li","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","first-page":"230","article-title":"Second-order convolutional neural networks","volume":"66","author":"Yu","year":"2017","journal-title":"Clinic. Immunol. Immunopathol."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Huang, Z., and Van Gool, L. (2016). A Riemannian network for SPD matrix learning. arXiv.","DOI":"10.1609\/aaai.v31i1.10866"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Akodad, S., Bombrun, L., Yaacoub, C., Berthoumieu, Y., and Germain, C. (November,  7\u201310). Image classification based on log-Euclidean Fisher Vectors for covariance matrix descriptors. Proceedings of the 2018 Eighth International Conference on Image Processing Theory, Tools and Applications (IPTA), Xi\u2019an, China.","DOI":"10.1109\/IPTA.2018.8608154"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Ren, M., and Zemel, R.S. (2017). End-to-end instance segmentation with recurrent attention. arXiv.","DOI":"10.1109\/CVPR.2017.39"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Donahue, J., Anne Hendricks, L., Guadarrama, S., Rohrbach, M., Venugopalan, S., Saenko, K., and Darrell, T. (2015). Long-term recurrent convolutional networks for visual recognition and description. arXiv.","DOI":"10.21236\/ADA623249"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Pape, J.M., and Klukas, C. (2015, January 7\u201310). Utilizing machine learning approaches to improve the prediction of leaf counts and individual leaf segmentation of rosette plant images. Proceedings of the Computer Vision Problems in Plant Phenotyping Workshop, Swansea, UK.","DOI":"10.5244\/C.29.CVPPP.3"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Pape, J.M., and Klukas, C. (2015). 3-D Histogram-Based Segmentation and Leaf Detection for Rosette Plants. Asia-pacific Conference on Conceptual Modelling, Australian Computer Society, Inc.","DOI":"10.1007\/978-3-319-16220-1_5"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Dobrescu, A., Giuffrida, M.V., and Tsaftaris, S.A. (2017, January 22\u201329). Leveraging multiple datasets for deep leaf counting. Proceedings of the 2017 IEEE International Conference on Computer Vision Workshop (ICCVW), Venice, Italy.","DOI":"10.1109\/ICCVW.2017.243"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Aich, S., and Stavness, I. (2017). Leaf counting with deep convolutional and deconvolutional networks. arXiv.","DOI":"10.1109\/ICCVW.2017.244"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Aslam, M., Maqbool, M.A., and Ceng, R. (2015). Drought Stress in Maize (Zea mays L.), Springer Briefs in Agriculture. Chapter Effect of Drought on Maize.","DOI":"10.1007\/978-3-319-25442-5"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1150","DOI":"10.1109\/ICCV.1999.790410","article-title":"Object recognition from local scale-invariant features","volume":"Volume 2","author":"Lowe","year":"1999","journal-title":"Proceedings of the 1999 Seventh IEEE International Conference on Computer Vision"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Simonyan, K., Parkhi, O.M., Vedaldi, A., and Zisserman, A. (2013). Fisher Vector Faces in the Wild, University of Oxford.","DOI":"10.5244\/C.27.8"},{"key":"ref_29","unstructured":"Jaakkola, T., and Haussler, D. (2019, March 11). Exploiting Generative Models in Discriminative Classifiers. Available online: https:\/\/papers.nips.cc\/paper\/1520-exploiting-generative-models-in-discriminative-classifiers.pdf."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Perronnin, F., and Dance, C. (2007, January 17\u201322). Fisher Kernels on Visual Vocabularies for Image Categorization. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383266"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1016\/j.compbiomed.2017.11.019","article-title":"Automated retinal health diagnosis using pyramid histogram of visual words and Fisher vector techniques","volume":"92","author":"Koh","year":"2018","journal-title":"Comput. Biol. Med."},{"key":"ref_32","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2019, March 11). Imagenet Classification with Deep Convolutional Neural Networks. Available online: https:\/\/papers.nips.cc\/paper\/4824-imagenet-classification-with-deep-convolutional-neural-networks.pdf."},{"key":"ref_33","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/11\/4\/516\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:44:24Z","timestamp":1760186664000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/11\/4\/516"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4,10]]},"references-count":33,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2019,4]]}},"alternative-id":["sym11040516"],"URL":"https:\/\/doi.org\/10.3390\/sym11040516","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2019,4,10]]}}}