{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T16:43:54Z","timestamp":1783529034560,"version":"3.55.0"},"reference-count":52,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2021,9,23]],"date-time":"2021-09-23T00:00:00Z","timestamp":1632355200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100017668","name":"Key Research and Development Project of Anhui Province","doi-asserted-by":"publisher","award":["1804a07020108\uff0c201904a06020056\uff0c202104a06020012"],"award-info":[{"award-number":["1804a07020108\uff0c201904a06020056\uff0c202104a06020012"]}],"id":[{"id":"10.13039\/501100017668","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Independent Project of Anhui Key Laboratory of Smart Agricultural Technology and Equipment","award":["APKLSATE2019X001"],"award-info":[{"award-number":["APKLSATE2019X001"]}]},{"name":"Ministry of Agriculture Agricultural Internet of Things Technology Integration and Application Key Laboratory Open Fund in 2016","award":["2016KL05"],"award-info":[{"award-number":["2016KL05"]}]},{"name":"Major Science and Technology Special Plan of Anhui Province in 2017","award":["17030701049"],"award-info":[{"award-number":["17030701049"]}]},{"name":"Major Project of Natural Science Research in Universities of Anhui Province","award":["KJ2019ZD20"],"award-info":[{"award-number":["KJ2019ZD20"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Deep neural networks (DNNs) have become the de facto standard for image recognition tasks, and their applications with respect to plant diseases have also obtained remarkable results. However, the large number of parameters and high computational complexities of these network models make them difficult to deploy on farms in remote areas. In this paper, focusing on the problems of resource constraints and plant diseases, we propose a DNN-based compression method. In order to reduce computational burden, this method uses lightweight fully connected layers to accelerate reasoning, pruning to remove redundant parameters and reduce multiply\u2013accumulate operations, knowledge distillation instead of retraining to restore the lost accuracy, and then quantization to compress the size of the model further. After compressing the mainstream VGGNet and AlexNet models, the compressed versions are applied to the Plant Village dataset of plant disease images, and a performance comparison of the models before and after compression is obtained to verify the proposed method. The results show that the model can be compressed to 0.04 Mb with an accuracy of 97.09%. This experiment also proves the effectiveness of knowledge distillation during the pruning process, and compressed models are more efficient than prevalent lightweight models.<\/jats:p>","DOI":"10.3390\/sym13101769","type":"journal-article","created":{"date-parts":[[2021,9,27]],"date-time":"2021-09-27T23:08:31Z","timestamp":1632784111000},"page":"1769","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["Deep Neural Network Compression for Plant Disease Recognition"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7087-3638","authenticated-orcid":false,"given":"Ruiqing","family":"Wang","sequence":"first","affiliation":[{"name":"School of Information and Computer, Anhui Agricultural University, Hefei 230036, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wu","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Information and Computer, Anhui Agricultural University, Hefei 230036, China"},{"name":"Anhui Province Key Laboratory of Smart Agricultural Technology and Equipment, Anhui Agriculture University, Hefei 230036, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiuyang","family":"Ding","sequence":"additional","affiliation":[{"name":"School of Information and Computer, Anhui Agricultural University, Hefei 230036, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Meng","family":"Xia","sequence":"additional","affiliation":[{"name":"School of Information and Computer, Anhui Agricultural University, Hefei 230036, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mengjian","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Information and Computer, Anhui Agricultural University, Hefei 230036, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuan","family":"Rao","sequence":"additional","affiliation":[{"name":"School of Information and Computer, Anhui Agricultural University, Hefei 230036, China"},{"name":"Anhui Province Key Laboratory of Smart Agricultural Technology and Equipment, Anhui Agriculture University, Hefei 230036, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhaohui","family":"Jiang","sequence":"additional","affiliation":[{"name":"School of Information and Computer, Anhui Agricultural University, Hefei 230036, China"},{"name":"Anhui Province Key Laboratory of Smart Agricultural Technology and Equipment, Anhui Agriculture University, Hefei 230036, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,9,23]]},"reference":[{"key":"ref_1","unstructured":"Chetlur, S., Woolley, C., Vandermersch, P., Cohen, J., Tran, J., Catanzaro, B., and Shelhamer, E. (2014). Cudnn: Efficient primitives for deep learning. arXiv, Available online: https:\/\/arxiv.org\/abs\/1410.0759."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/MCI.2018.2840738","article-title":"Recent trends in deep learning based natural language processing","volume":"13","author":"Young","year":"2018","journal-title":"IEEE Comput. Intell. Mag."},{"key":"ref_4","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, NIPS."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1016\/j.media.2017.07.005","article-title":"A survey on deep learning in medical image analysis","volume":"42","author":"Litjens","year":"2017","journal-title":"Med. Image Anal."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 13\u201316). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Noh, H., Hong, S., and Han, B. (2015, January 13\u201316). Learning deconvolution network for semantic segmentation. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.178"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Jia, X., Gavves, E., Fernando, B., and Tuytelaars, T. (2015, January 13\u201316). Guiding the long-short term memory model for image caption generation. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.277"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Rahnemoonfar, M., and Sheppard, C. (2017). Deep count: Fruit counting based on deep simulated learning. Sensors, 17.","DOI":"10.3390\/s17040905"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"105108","DOI":"10.1016\/j.compag.2019.105108","article-title":"Fast implementation of real-time fruit detection in apple orchards using deep learning","volume":"168","author":"Kang","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Xiong, J., Yu, D., Liu, S., Shu, L., Wang, X., and Liu, Z.J.E. (2021). A review of plant phenotypic image recognition technology based on deep learning. Electronics, 10.","DOI":"10.3390\/electronics10010081"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.compag.2018.02.016","article-title":"Deep learning in agriculture: A survey","volume":"147","author":"Kamilaris","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_13","unstructured":"Mortensen, A.K., Dyrmann, M., Karstoft, H., J\u00f8rgensen, R.N., and Gislum, R. (2016, January 26\u201329). Semantic segmentation of mixed crops using deep convolutional neural network. Proceedings of the CIGR-AgEng Conference, Aarhus, Denmark."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Hasan, R.I., Yusuf, S.M., and Alzubaidi, L. (2020). Review of the state of the art of deep learning for plant diseases: A broad analysis and discussion. Plants, 9.","DOI":"10.3390\/plants9101302"},{"key":"ref_15","first-page":"1097","article-title":"Imagenet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Commun. ACM"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_17","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv, Available online: https:\/\/arxiv.org\/abs\/1409.1556."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2224","DOI":"10.1109\/COMST.2019.2904897","article-title":"Deep learning in mobile and wireless networking: A survey","volume":"21","author":"Zhang","year":"2019","journal-title":"IEEE Commun. Surv. Tutorials"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1344","DOI":"10.1109\/LRA.2017.2667039","article-title":"Mixtures of lightweight deep convolutional neural networks: Applied to agricultural robotics","volume":"2","author":"McCool","year":"2017","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"105951","DOI":"10.1016\/j.compag.2020.105951","article-title":"Disease detection in tomato leaves via CNN with lightweight architectures implemented in Raspberry Pi 4","volume":"181","author":"Rodriguez","year":"2021","journal-title":"Comput. Electron. Agric."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"630","DOI":"10.1111\/ppa.13322","article-title":"Attention embedded lightweight network for maize disease recognition","volume":"70","author":"Chen","year":"2021","journal-title":"Plant Pathol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"105735","DOI":"10.1016\/j.compag.2020.105735","article-title":"Grape disease image classification based on lightweight convolution neural networks and channelwise attention","volume":"178","author":"Tang","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"31497","DOI":"10.1007\/s11042-020-09669-w","article-title":"Identifying plant diseases using deep transfer learning and enhanced lightweight network","volume":"79","author":"Chen","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"5113","DOI":"10.1007\/s10462-020-09816-7","article-title":"A comprehensive survey on model compression and acceleration","volume":"53","author":"Choudhary","year":"2020","journal-title":"Artif. Intell. Rev."},{"key":"ref_25","unstructured":"Hughes, D., and Salath\u00e9, M. (2015). An open access repository of images on plant health to enable the development of mobile disease diagnostics. arXiv, Available online: https:\/\/arxiv.org\/abs\/1511.08060."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1419","DOI":"10.3389\/fpls.2016.01419","article-title":"Using deep learning for image-based plant disease detection","volume":"7","author":"Mohanty","year":"2016","journal-title":"Front. Plant Sci."},{"key":"ref_27","unstructured":"LeCun, Y., Denker, J.S., and Solla, S.A. (1990). Optimal brain damage. Advances in Neural Information Processing Systems, NIPS. Available online: https:\/\/dl.acm.org\/doi\/10.5555\/109230.109298."},{"key":"ref_28","unstructured":"Denil, M., Shakibi, B., Dinh, L., Ranzato, M.A., and De Freitas, N. (2013). Predicting parameters in deep learning. arXiv, Available online: https:\/\/arxiv.org\/abs\/1306.0543."},{"key":"ref_29","unstructured":"Hassibi, B., and Stork, D.G. (1993). Second Order Derivatives for Network Pruning: Optimal Brain Surgeon. Advances in Neural Information Processing Systems 5, NIPS."},{"key":"ref_30","unstructured":"Han, S., Pool, J., Tran, J., and Dally, W.J. (2015). Learning both weights and connections for efficient neural networks. arXiv, Available online: https:\/\/arxiv.org\/abs\/1506.02626."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1145\/3007787.3001163","article-title":"EIE: Efficient inference engine on compressed deep neural network","volume":"44","author":"Han","year":"2016","journal-title":"ACM SIGARCH Comput. Archit. News"},{"key":"ref_32","unstructured":"Li, H., Kadav, A., Durdanovic, I., Samet, H., and Graf, H.P. (2016). Pruning filters for efficient convnets. arXiv, Available online: https:\/\/arxiv.org\/abs\/1608.08710."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Luo, J.-H., Wu, J., and Lin, W. (2017, January 27\u201329). Thinet: A filter level pruning method for deep neural network compression. Proceedings of the IEEE International Conference on Computer Vision, Venic, Italy.","DOI":"10.1109\/ICCV.2017.541"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Liu, Z., Li, J., Shen, Z., Huang, G., Yan, S., and Zhang, C. (2017, January 27\u201329). Learning efficient convolutional networks through network slimming. Proceedings of the IEEE International Conference on Computer Vision, Venic, Italy.","DOI":"10.1109\/ICCV.2017.298"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Lin, M., Ji, R., Wang, Y., Zhang, Y., Zhang, B., Tian, Y., and Shao, L. (2020, January 14\u201319). Hrank: Filter pruning using high-rank feature map. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00160"},{"key":"ref_36","unstructured":"Zhu, M., and Gupta, S. (2017). To prune, or not to prune: Exploring the efficacy of pruning for model compression. arXiv, Available online: https:\/\/arxiv.org\/abs\/1710.01878."},{"key":"ref_37","unstructured":"Hinton, G., Vinyals, O., and Dean, J. (2015). Distilling the knowledge in a neural network. arXiv, Available online: https:\/\/arxiv.org\/abs\/1503.02531."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Fukuda, T., Suzuki, M., Kurata, G., Thomas, S., Cui, J., and Ramabhadran, B. (2017, January 20\u201324). Efficient Knowledge Distillation from an Ensemble of Teachers. Proceedings of the Interspeech, Stockholm, Sweden.","DOI":"10.21437\/Interspeech.2017-614"},{"key":"ref_39","unstructured":"Zagoruyko, S., and Komodakis, N. (2016). Paying more attention to attention: Improving the performance of convolutional neural networks via attention transfer. arXiv, Available online: https:\/\/arxiv.org\/abs\/1612.03928."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Mirzadeh, S.I., Farajtabar, M., Li, A., Levine, N., Matsukawa, A., and Ghasemzadeh, H. (2020, January 7\u201312). Improved knowledge distillation via teacher assistant. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.","DOI":"10.1609\/aaai.v34i04.5963"},{"key":"ref_41","unstructured":"Gong, Y., Liu, L., Yang, M., and Bourdev, L. (2014). Compressing deep convolutional networks using vector quantization. arXiv, Available online: https:\/\/arxiv.org\/abs\/1412.6115."},{"key":"ref_42","unstructured":"Vanhoucke, V., Senior, A., and Mao, M.Z. (2021, May 03). Improving the Speed of Neural Networks on CPUs. Available online: https:\/\/www.researchgate.net\/publication\/319770111_Improving_the_speed_of_neural_networks_on_CPUs."},{"key":"ref_43","unstructured":"Courbariaux, M., Hubara, I., Soudry, D., El-Yaniv, R., and Bengio, Y. (2016). Binarized neural networks: Training deep neural networks with weights and activations constrained to +1 or \u22121. arXiv, Available online: https:\/\/arxiv.org\/abs\/1602.02830."},{"key":"ref_44","unstructured":"Han, S., Mao, H., and Dally, W.J. (2015). Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. arXiv, Available online: https:\/\/arxiv.org\/abs\/1510.00149."},{"key":"ref_45","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv, Available online: https:\/\/arxiv.org\/abs\/1704.04861."},{"key":"ref_46","unstructured":"Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., and Keutzer, K. (2016). SqueezeNet: AlexNet-level accuracy with 50\u00d7 fewer parameters and <0.5 MB model size. arXiv, Available online: https:\/\/arxiv.org\/abs\/1602.07360."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Ale, L., Sheta, A., Li, L., Wang, Y., and Zhang, N. (2019, January 9\u201313). Deep learning based plant disease detection for smart agriculture. Proceedings of the 2019 IEEE Globecom Workshops (GC Wkshps), Waikoloa, HI, USA.","DOI":"10.1109\/GCWkshps45667.2019.9024439"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1016\/j.compag.2018.01.009","article-title":"Deep learning models for plant disease detection and diagnosis","volume":"145","author":"Ferentinos","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_49","unstructured":"Delnevo, G., Girau, R., Ceccarini, C., and Prandi, C. (2021, September 03). A Deep Learning and Social IoT approach for Plants Disease Prediction toward a Sustainable Agriculture. IEEE Internet Things J., Available online: https:\/\/ieeexplore.ieee.org\/abstract\/document\/9486935."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"903","DOI":"10.1109\/LGRS.2019.2932385","article-title":"Automatic recognition of soybean leaf diseases using UAV images and deep convolutional neural networks","volume":"17","author":"Tetila","year":"2019","journal-title":"IEEE Geosci. Remote. Sens. Lett."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Yu, H.-J., and Son, C.-H. (2020, January 14\u201319). Leaf spot attention network for apple leaf disease identification. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00034"},{"key":"ref_52","unstructured":"Lin, M., Chen, Q., and Yan, S. (2013). Network in network. arXiv, Available online: https:\/\/arxiv.org\/abs\/1312.4400."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/13\/10\/1769\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:03:54Z","timestamp":1760166234000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/13\/10\/1769"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,23]]},"references-count":52,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2021,10]]}},"alternative-id":["sym13101769"],"URL":"https:\/\/doi.org\/10.3390\/sym13101769","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,23]]}}}