{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,4]],"date-time":"2026-07-04T00:31:37Z","timestamp":1783125097939,"version":"3.54.6"},"reference-count":52,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2020,1,21]],"date-time":"2020-01-21T00:00:00Z","timestamp":1579564800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"The National Key Technology R&amp;D Program of China","award":["2018YFD0200300"],"award-info":[{"award-number":["2018YFD0200300"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["31401293, 31671586, 61773360"],"award-info":[{"award-number":["31401293, 31671586, 61773360"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Increasing grain production is essential to those areas where food is scarce. Increasing grain production by controlling crop diseases and pests in time should be effective. To construct video detection system for plant diseases and pests, and to build a real-time crop diseases and pests video detection system in the future, a deep learning-based video detection architecture with a custom backbone was proposed for detecting plant diseases and pests in videos. We first transformed the video into still frame, then sent the frame to the still-image detector for detection, and finally synthesized the frames into video. In the still-image detector, we used faster-RCNN as the framework. We used image-training models to detect relatively blurry videos. Additionally, a set of video-based evaluation metrics based on a machine learning classifier was proposed, which reflected the quality of video detection effectively in the experiments. Experiments showed that our system with the custom backbone was more suitable for detection of the untrained rice videos than VGG16, ResNet-50, ResNet-101 backbone system and YOLOv3 with our experimental environment.<\/jats:p>","DOI":"10.3390\/s20030578","type":"journal-article","created":{"date-parts":[[2020,1,21]],"date-time":"2020-01-21T11:25:59Z","timestamp":1579605959000},"page":"578","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":219,"title":["A Recognition Method for Rice Plant Diseases and Pests Video Detection Based on Deep Convolutional Neural Network"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4653-5137","authenticated-orcid":false,"given":"Dengshan","family":"Li","sequence":"first","affiliation":[{"name":"Institute of Intelligent Machines, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"},{"name":"Science Island Branch of Graduate School, University of Science and Technology of China, Hefei 230026, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rujing","family":"Wang","sequence":"additional","affiliation":[{"name":"Institute of Intelligent Machines, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chengjun","family":"Xie","sequence":"additional","affiliation":[{"name":"Institute of Intelligent Machines, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4218-8008","authenticated-orcid":false,"given":"Liu","family":"Liu","sequence":"additional","affiliation":[{"name":"Institute of Intelligent Machines, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"},{"name":"Science Island Branch of Graduate School, University of Science and Technology of China, Hefei 230026, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jie","family":"Zhang","sequence":"additional","affiliation":[{"name":"Institute of Intelligent Machines, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rui","family":"Li","sequence":"additional","affiliation":[{"name":"Institute of Intelligent Machines, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"},{"name":"Science Island Branch of Graduate School, University of Science and Technology of China, Hefei 230026, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fangyuan","family":"Wang","sequence":"additional","affiliation":[{"name":"Institute of Intelligent Machines, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"},{"name":"Science Island Branch of Graduate School, University of Science and Technology of China, Hefei 230026, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Man","family":"Zhou","sequence":"additional","affiliation":[{"name":"Institute of Intelligent Machines, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China"},{"name":"Science Island Branch of Graduate School, University of Science and Technology of China, Hefei 230026, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wancai","family":"Liu","sequence":"additional","affiliation":[{"name":"National Agro-Tech Extension and Service Center, Beijing 100125, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2020,1,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"734","DOI":"10.3389\/fpls.2014.00734","article-title":"Image-based phenotyping of plant disease symptoms","volume":"5","author":"Mutka","year":"2015","journal-title":"Front. Plant Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"829","DOI":"10.1094\/PD-67-829","article-title":"Rice sheath blight: A major rice disease","volume":"67","author":"Rush","year":"1983","journal-title":"Plant Dis."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1017\/S1742758400004872","article-title":"Varietal resistance to rice stem-borers in Asia","volume":"5","author":"Chaudhary","year":"1984","journal-title":"Int. J. Trop. Insect Sci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1016\/S1672-6308(08)60047-5","article-title":"Characterizing and estimating fungal disease severity of rice brown spot with hyperspectral reflectance data","volume":"15","author":"Liu","year":"2008","journal-title":"Rice Sci."},{"key":"ref_5","unstructured":"Dalal, N., and Triggs, B. (2005, January 20\u201325). Histograms of oriented gradients for human detection. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, CA, USA."},{"key":"ref_6","unstructured":"Lowe, D.G. (1997, January 20\u201327). Object recognition from local scale-invariant features. Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Cire\u015fan, D., Meier, U., Masci, J., and Schmidhuber, J. (August, January 31). A committee of neural networks for traffic sign classification. Proceedings of the 2011 International Joint Conference on Neural Networks, San Jose, CA, USA.","DOI":"10.1109\/IJCNN.2011.6033458"},{"key":"ref_8","unstructured":"Le Cun, Y., Matan, O., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jacket, L., and Baird, H.S. (1990, January 16\u201321). Handwritten zip code recognition with multilayer networks. Proceedings of the 10th International Conference on Pattern Recognition, Atlantic City, NJ, USA."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster r-cnn: Towards real-time object detection with region proposal networks","volume":"39","author":"Ren","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1016\/j.neucom.2017.01.018","article-title":"Plant identification using deep neural networks via optimization of transfer learning parameters","volume":"235","author":"Ghazi","year":"2017","journal-title":"Neurocomputing"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.compag.2016.02.003","article-title":"Automatic moth detection from trap images for pest management","volume":"123","author":"Ding","year":"2016","journal-title":"Comput. Electron. Agric."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1016\/j.compag.2016.07.003","article-title":"Deep learning for plant identification using vein morphological patterns","volume":"127","author":"Grinblat","year":"2016","journal-title":"Comput. Electron. Agric."},{"key":"ref_15","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3\u20138). Imagenet classification with deep convolutional neural networks. Proceedings of the Advances in Neural Information Processing Systems (NIPS), Lake Tahoe, NV, USA."},{"key":"ref_16","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_18","unstructured":"Ioffe, S., and Szegedy, C. (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv."},{"key":"ref_19","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2015, January 7\u201312). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_22","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Redmon, J., and Farhadi, A. (2017, January 21\u201326). YOLO9000: Better, faster, stronger. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.690"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., and Fei-Fei, L. (2014, January 23\u201328). Large-scale video classification with convolutional neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.223"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Neubeck, A., and Van Gool, L. (2006, January 20\u201324). Efficient non-maximum suppression. Proceedings of the 18th International Conference on Pattern Recognition (ICPR\u201906), Hong Kong, China.","DOI":"10.1109\/ICPR.2006.479"},{"key":"ref_26","unstructured":"Han, W., Khorrami, P., Paine, T.L., Ramachandran, P., Babaeizadeh, M., Shi, H., Li, J., Yan, S., and Huang, T.S. (2016). Seq-NMS for Video Object Detection. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1253","DOI":"10.1109\/TIP.2017.2651367","article-title":"Spatio-temporal closed-loop object detection","volume":"26","author":"Galteri","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2896","DOI":"10.1109\/TCSVT.2017.2736553","article-title":"T-cnn: Tubelets with convolutional neural networks for object detection from videos","volume":"28","author":"Kang","year":"2017","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhu, X., Wang, Y., Dai, J., Yuan, L., and Wei, Y. (2017, January 22\u201329). Flow-guided feature aggregation for video object detection. Proceedings of the IEEE International Conference on Computer Vision(ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.52"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1094\/PDIS-03-15-0340-FE","article-title":"Plant disease detection by imaging sensors\u2013parallels and specific demands for precision agriculture and plant phenotyping","volume":"100","author":"Mahlein","year":"2016","journal-title":"Plant Dis."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1310","DOI":"10.1094\/PDIS-03-15-0319-RE","article-title":"Leaf Doctor: A new portable application for quantifying plant disease severity","volume":"99","author":"Pethybridge","year":"2015","journal-title":"Plant Dis."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"985","DOI":"10.1094\/PHYTO-11-13-0328-R","article-title":"Measuring quantitative virulence in the wheat pathogen Zymoseptoria tritici using high-throughput automated image analysis","volume":"104","author":"Stewart","year":"2014","journal-title":"Phytopathology"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1094\/PDIS-93-6-0660","article-title":"Automated image analysis of the severity of foliar citrus canker symptoms","volume":"93","author":"Bock","year":"2009","journal-title":"Plant Dis."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/j.compag.2017.03.004","article-title":"A fuzzy clustering segmentation method based on neighborhood grayscale information for defining cucumber leaf spot disease images","volume":"136","author":"Bai","year":"2017","journal-title":"Comput. Electron. Agric."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1016\/j.compag.2017.05.019","article-title":"An yield estimation in citrus orchards via fruit detection and counting using image processing","volume":"140","author":"Dorj","year":"2017","journal-title":"Comput. Electron. Agric."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1016\/j.compag.2014.12.007","article-title":"A key frame extraction method for processing greenhouse vegetables production monitoring video","volume":"111","author":"Ma","year":"2015","journal-title":"Comput. Electron. Agric."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1016\/j.compag.2017.01.014","article-title":"Leaf image based cucumber disease recognition using sparse representation classification","volume":"134","author":"Zhang","year":"2017","journal-title":"Comput. Electron. Agric."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1016\/j.compag.2017.06.016","article-title":"Fusion of superpixel, expectation maximization and PHOG for recognizing cucumber diseases","volume":"140","author":"Zhang","year":"2017","journal-title":"Comput. Electron. Agric."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1041","DOI":"10.13031\/trans.59.11434","article-title":"Diagnostic model for wheat leaf conditions using image features and a support vector machine","volume":"59","author":"Du","year":"2016","journal-title":"Trans. ASABE"},{"key":"ref_40","unstructured":"Geirhos, R., Rubisch, P., Michaelis, C., Bethge, M., Wichmann, F.A., and Brendel, W. (2018). ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustness. arXiv."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1016\/j.compag.2018.01.009","article-title":"Deep learning models for plant disease detection and diagnosis","volume":"145","author":"Ferentinos","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Fuentes, A., Yoon, S., Kim, S., and Park, D. (2017). A robust deep-learning-based detector for real-time tomato plant diseases and pests recognition. Sensors, 17.","DOI":"10.3390\/s17092022"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.biosystemseng.2016.01.017","article-title":"A review on the main challenges in automatic plant disease identification based on visible range images","volume":"144","author":"Barbedo","year":"2016","journal-title":"Biosyst. Eng."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1145\/65943.65945","article-title":"A critical investigation of recall and precision as measures of retrieval system performance","volume":"7","author":"Raghavan","year":"1989","journal-title":"ACM Trans. Inf. Syst. (Tois)"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Aradhye, H., Toderici, G., and Yagnik, J. (2009, January 6\u20139). Video2text: Learning to annotate video content. Proceedings of the 2009 IEEE International Conference on Data Mining Workshops, Miami, FL, USA.","DOI":"10.1109\/ICDMW.2009.79"},{"key":"ref_46","unstructured":"Ciresan, D.C., Meier, U., Masci, J., Gambardella, L.M., and Schmidhuber, J. (2011, January 16\u201322). Flexible, high performance convolutional neural networks for image classification. Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, Barcelona, Spain."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Scherer, D., M\u00fcller, A., and Behnke, S. (2010, January 15\u201318). Evaluation of pooling operations in convolutional architectures for object recognition. Proceedings of the International Conference on Artificial Neural Networks, Thessaloniki, Greece.","DOI":"10.1007\/978-3-642-15825-4_10"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Tur, G., Deng, L., Hakkani-T\u00fcr, D., and He, X. (2012, January 25\u201330). Towards deeper understanding: Deep convex networks for semantic utterance classification. Proceedings of the 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Kyoto, Japan.","DOI":"10.1109\/ICASSP.2012.6289054"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Li, Z., Peng, C., Yu, G., Zhang, X., Deng, Y., and Sun, J. (2018, January 8\u201314). Detnet: Design backbone for object detection. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01240-3_21"},{"key":"ref_50","unstructured":"Girshick, R., Radosavovic, I., Gkioxari, G., Doll\u00e1r, P., and He, K. (2020, January 21). Detectron. Available online: https:\/\/github.com\/facebookresearch\/detectron."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Wong, S.C., Gatt, A., Stamatescu, V., and McDonnell, M.D. (December, January 30). Understanding data augmentation for classification: When to warp?. Proceedings of the 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA), Gold Coast, Australia.","DOI":"10.1109\/DICTA.2016.7797091"},{"key":"ref_52","first-page":"2493","article-title":"Natural language processing (almost) from scratch","volume":"12","author":"Collobert","year":"2011","journal-title":"J. Mach. Learn. Res."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/3\/578\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T14:05:32Z","timestamp":1760364332000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/3\/578"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,21]]},"references-count":52,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2020,2]]}},"alternative-id":["s20030578"],"URL":"https:\/\/doi.org\/10.3390\/s20030578","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,21]]}}}