{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,11]],"date-time":"2026-05-11T23:16:31Z","timestamp":1778541391144,"version":"3.51.4"},"reference-count":56,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2021,7,16]],"date-time":"2021-07-16T00:00:00Z","timestamp":1626393600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the Natural Science Foundation of China","award":["41871333"],"award-info":[{"award-number":["41871333"]}]},{"name":"the Important Project of Science and Technology of the Henan Province","award":["212102110238"],"award-info":[{"award-number":["212102110238"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The number of wheat ears is an essential indicator for wheat production and yield estimation, but accurately obtaining wheat ears requires expensive manual cost and labor time. Meanwhile, the characteristics of wheat ears provide less information, and the color is consistent with the background, which can be challenging to obtain the number of wheat ears required. In this paper, the performance of Faster regions with convolutional neural networks (Faster R-CNN) and RetinaNet to predict the number of wheat ears for wheat at different growth stages under different conditions is investigated. The results show that using the Global WHEAT dataset for recognition, the RetinaNet method, and the Faster R-CNN method achieve an average accuracy of 0.82 and 0.72, with the RetinaNet method obtaining the highest recognition accuracy. Secondly, using the collected image data for recognition, the R2 of RetinaNet and Faster R-CNN after transfer learning is 0.9722 and 0.8702, respectively, indicating that the recognition accuracy of the RetinaNet method is higher on different data sets. We also tested wheat ears at both the filling and maturity stages; our proposed method has proven to be very robust (the R2 is above 90). This study provides technical support and a reference for automatic wheat ear recognition and yield estimation.<\/jats:p>","DOI":"10.3390\/s21144845","type":"journal-article","created":{"date-parts":[[2021,7,16]],"date-time":"2021-07-16T10:52:58Z","timestamp":1626432778000},"page":"4845","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":66,"title":["Wheat Ear Recognition Based on RetinaNet and Transfer Learning"],"prefix":"10.3390","volume":"21","author":[{"given":"Jingbo","family":"Li","sequence":"first","affiliation":[{"name":"School of Surveying and Mapping Land Information Engineering, Henan Polytechnic University, Jiaozuo 454000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Changchun","family":"Li","sequence":"additional","affiliation":[{"name":"School of Surveying and Mapping Land Information Engineering, Henan Polytechnic University, Jiaozuo 454000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8774-7929","authenticated-orcid":false,"given":"Shuaipeng","family":"Fei","sequence":"additional","affiliation":[{"name":"School of Surveying and Mapping Land Information Engineering, Henan Polytechnic University, Jiaozuo 454000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chunyan","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Surveying and Mapping Land Information Engineering, Henan Polytechnic University, Jiaozuo 454000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weinan","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Surveying and Mapping Land Information Engineering, Henan Polytechnic University, Jiaozuo 454000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Fan","family":"Ding","sequence":"additional","affiliation":[{"name":"School of Surveying and Mapping Land Information Engineering, Henan Polytechnic University, Jiaozuo 454000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yilin","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Surveying and Mapping Land Information Engineering, Henan Polytechnic University, Jiaozuo 454000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yacong","family":"Li","sequence":"additional","affiliation":[{"name":"School of Surveying and Mapping Land Information Engineering, Henan Polytechnic University, Jiaozuo 454000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jinjin","family":"Shi","sequence":"additional","affiliation":[{"name":"School of Surveying and Mapping Land Information Engineering, Henan Polytechnic University, Jiaozuo 454000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhen","family":"Xiao","sequence":"additional","affiliation":[{"name":"School of Surveying and Mapping Land Information Engineering, Henan Polytechnic University, Jiaozuo 454000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,16]]},"reference":[{"key":"ref_1","unstructured":"(2021, June 02). FAOSTAT. Available online: http:\/\/faostat3.fao.org\/faostat-gateway\/go\/to\/browse\/Q\/QC\/E."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"100538","DOI":"10.1016\/j.gfs.2021.100538","article-title":"Global wheat trade and Codex Alimentarius guidelines for deoxynivalenol: A mycotoxin common in wheat","volume":"29","author":"Chen","year":"2021","journal-title":"Glob. Food Secur."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1016\/j.wace.2016.02.003","article-title":"Measuring the effects of extreme weather events on yields","volume":"12","author":"Powell","year":"2016","journal-title":"Weather Clim. Extrem."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1643","DOI":"10.1080\/0003684042000266838","article-title":"A spatial equilibrium analysis of trade policy reforms on the world wheat market","volume":"36","author":"Devadoss","year":"2004","journal-title":"Appl. Econ."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1071\/AR05170","article-title":"High ear number is key to achieving high wheat yields in the high-rainfall zone of south-western Australia","volume":"58","author":"Zhang","year":"2007","journal-title":"Aust. J. Agric. Res."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.eja.2016.01.005","article-title":"Yield and yield components of wheat and maize in wheat\u2013maize intercropping in the Netherlands","volume":"76","author":"Gou","year":"2016","journal-title":"Eur. J. Agron."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1186\/s13007-021-00726-5","article-title":"Determination of wheat spike and spikelet architecture and grain traits using X-ray Computed Tomography imaging","volume":"17","author":"Zhou","year":"2021","journal-title":"Plant Methods"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1186\/s13007-018-0366-8","article-title":"Detection and analysis of wheat spikes using Convolutional Neural Networks","volume":"14","author":"Hasan","year":"2018","journal-title":"Plant Methods"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1186\/s13007-018-0289-4","article-title":"Wheat ear counting in-field conditions: High throughput and low-cost approach using RGB images","volume":"14","author":"Kefauver","year":"2018","journal-title":"Plant Methods"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"100379","DOI":"10.1016\/j.cosrev.2021.100379","article-title":"A survey on deep learning and its applications","volume":"40","author":"Dong","year":"2021","journal-title":"Comput. Sci. Rev."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"200","DOI":"10.1109\/MGRS.2020.2998816","article-title":"High-throughput estimation of crop traits: A review of ground and aerial phenotyping platforms","volume":"9","author":"Jin","year":"2021","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"4852","DOI":"10.1080\/01431161.2018.1490504","article-title":"The impact of small unmanned airborne platforms on passive optical remote sensing: A conceptual perspective","volume":"39","author":"Lippitt","year":"2018","journal-title":"Int. J. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"E17","DOI":"10.1038\/s41586-020-2767-x","article-title":"Reply to: Transparency and reproducibility in artificial intelligence","volume":"586","author":"Mickinney","year":"2020","journal-title":"Nature"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards real-time object detection with region proposal networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/j.agrformet.2018.10.013","article-title":"Ear density estimation from high resolution RGB imagery using deep learning technique","volume":"264","author":"Madec","year":"2019","journal-title":"Agric. For. Meteorol."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast R-CNN. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_18","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_19","first-page":"2999","article-title":"Focal Loss for Dense Object Detection","volume":"99","author":"Lin","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 8\u201316). SSD: Single shot multibox detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Lin, T.Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21\u201326). Feature pyramid networks for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Wang, Y., Wang, C., Zhang, H., Dong, Y., and Wei, S. (2019). Automatic Ship Detection Based on RetinaNet Using Multi-Resolution Gaofen-3 Imagery. Remote Sens., 11.","DOI":"10.3390\/rs11050531"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Santos, A., Marcato Junior, J., de Andrade Silva, J., Pereira, R., Matos, D., Menezes, G., Higa, L., Eltner, A., Ramos, A.P., and Osco, L. (2020). Storm-Drain and Manhole Detection Using the RetinaNet Method. Sensors, 20.","DOI":"10.3390\/s20164450"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Chen, Y., Zhang, X., Chen, W., Li, Y., and Wang, J. (2020). Research on Recognition of Fly Species Based on Improved RetinaNet and CBAM, IEEE Access.","DOI":"10.1109\/ACCESS.2020.2997466"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zheng, Z., Qi, H., Zhuang, L., and Zhang, Z. (2021). Automated rail surface crack analytics using deep data-driven models and transfer learning. Sustain. Cities Soc., 70.","DOI":"10.1016\/j.scs.2021.102898"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1016\/j.ins.2017.01.025","article-title":"Fusion of color histogram and LBP-based features for texture image retrieval and classification","volume":"390","author":"Liu","year":"2017","journal-title":"Inf. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1024","DOI":"10.3389\/fpls.2018.01024","article-title":"Wheat ears counting in field conditions based on multi-feature optimization and TWSVM","volume":"9","author":"Zhou","year":"2018","journal-title":"Front. Plant Sci."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1016\/j.biosystemseng.2015.12.015","article-title":"In-field automatic observation of wheat heading stage using computer vision","volume":"143","author":"Zhu","year":"2016","journal-title":"Biosyst. Eng."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.neunet.2014.09.003","article-title":"Deep learning in neural networks: An overview","volume":"61","author":"Schmidhuber","year":"2015","journal-title":"Neural Netw."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Gong, B., Ergu, D., Cai, Y., and Ma, B. (2020). Real-Time Detection for Wheat Head Applying Deep Neural Network. Sensors, 21.","DOI":"10.3390\/s21010191"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"178930","DOI":"10.1109\/ACCESS.2019.2958831","article-title":"Combined use of FCN and harris corner detection for counting wheat ears in field conditions","volume":"7","author":"Wang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"189043","DOI":"10.1109\/ACCESS.2020.3031896","article-title":"A robust method for wheatear detection using UAV in natural scenes","volume":"8","author":"He","year":"2020","journal-title":"IEEE Access"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"105662","DOI":"10.1016\/j.compag.2020.105662","article-title":"Improving segmentation accuracy for ears of winter wheat at flowering stage by semantic segmentation","volume":"176","author":"Ma","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"106","DOI":"10.1186\/s13007-020-00648-8","article-title":"Wheat ear counting using K-means clustering segmentation and convolutional neural network","volume":"16","author":"Xu","year":"2020","journal-title":"Plant Methods"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1186\/s13007-020-00651-z","article-title":"Maize tassels detection: A benchmark of the state of the art","volume":"16","author":"Zou","year":"2020","journal-title":"Plant Methods"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1929","DOI":"10.3389\/fpls.2020.541960","article-title":"TasselNetV2+: A fast implementation for high-throughput plant counting from high-resolution RGB imagery","volume":"11","author":"Lu","year":"2020","journal-title":"Front. Plant Sci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1176","DOI":"10.3389\/fpls.2019.01176","article-title":"DeepCount: In-field automatic quantification of wheat spikes using simple linear iterative clustering and deep convolutional neural networks","volume":"10","author":"Virlet","year":"2019","journal-title":"Front. Plant Sci."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Ampatzidis, Y., and Partel, V. (2019). UAV-based high throughput phenotyping in citrus utilizing multispectral imaging and artificial intelligence. Remote Sens., 11.","DOI":"10.3390\/rs11040410"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"105629","DOI":"10.1016\/j.compag.2020.105629","article-title":"Length phenotyping with interest point detection","volume":"176","author":"Vit","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"98","DOI":"10.1186\/s13007-019-0479-8","article-title":"Plant disease identification using explainable 3D deep learning on hyperspectral images","volume":"15","author":"Nagasubramanian","year":"2019","journal-title":"Plant Methods"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1419","DOI":"10.3389\/fpls.2016.01419","article-title":"Using deep learning for image-based plant disease detection","volume":"7","author":"Mohanty","year":"2016","journal-title":"Front. Plant Sci."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Khaki, S., Safaei, N., Pham, H., and Wang, L. (2021). WheatNet: A Lightweight Convolutional Neural Network for High-throughput Image-based Wheat Head Detection and Counting. arXiv.","DOI":"10.1016\/j.neucom.2022.03.017"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"3521852","DOI":"10.34133\/2020\/3521852","article-title":"Global Wheat Head Detection (GWHD) dataset: A large and diverse dataset of high-resolution RGB-labelled images to develop and benchmark wheat head detection methods","volume":"2020","author":"David","year":"2020","journal-title":"Plant Phenomics"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1071\/FP16163","article-title":"Field Scanalyzer: An automated robotic field phenotyping platform for detailed crop monitoring","volume":"44","author":"Virlet","year":"2016","journal-title":"Funct. Plant Biol."},{"key":"ref_45","unstructured":"(2018, May 06). Labelimg. Available online: https:\/\/github.com\/tzutalin\/labelImg."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1145\/965139.807361","article-title":"Color gamut transform pairs","volume":"12","author":"Smith","year":"1978","journal-title":"ACM Siggraph Comput. Graph."},{"key":"ref_47","unstructured":"Fredrik Lundh (2020, September 10). Python Image Library (PIL). Available online: https:\/\/python-pillow.org\/."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1007\/s11263-013-0620-5","article-title":"Selective Search for Object Recognition","volume":"104","author":"Uijlings","year":"2013","journal-title":"Int. J. Comput. Vis."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Hosang, J., Benenson, R., and Schiele, B. (2017). Learning non-maximum suppression. arXiv.","DOI":"10.1109\/CVPR.2017.685"},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1186\/s13007-017-0254-7","article-title":"Panicle-SEG: A robust image segmentation methodfor rice panicles in the field based on deep learning and superpixel optimization","volume":"13","author":"Xiong","year":"2017","journal-title":"Plant Methods"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"59613","DOI":"10.1109\/ACCESS.2019.2915368","article-title":"Vehicle detectionin aerial images using rotation-invariant cascaded forest","volume":"7","author":"Ma","year":"2019","journal-title":"IEEE Access"},{"key":"ref_53","unstructured":"Salton, G., and McGill, M.J. (2021, May 23). Introduction to Modern Information Retrieval, Available online: https:\/\/trove.nla.gov.au\/work\/19430022."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"1345","DOI":"10.1109\/TKDE.2009.191","article-title":"A survey on transfer learning","volume":"22","author":"Pan","year":"2010","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"104269","DOI":"10.1016\/j.chemolab.2021.104269","article-title":"Investigation of Transfer Learning for Image Classification and Impact on Training Sample Size","volume":"211","author":"Zhu","year":"2021","journal-title":"Chemom. Intell. Lab. Syst."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"8489","DOI":"10.3390\/rs70708489","article-title":"On the Importance of Training Data Sample Selection in Random Forest Image Classification: A Case Study in Peatland Ecosystem Mapping","volume":"7","author":"Millard","year":"2015","journal-title":"Remote Sens."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/14\/4845\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:31:22Z","timestamp":1760164282000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/14\/4845"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,16]]},"references-count":56,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["s21144845"],"URL":"https:\/\/doi.org\/10.3390\/s21144845","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,16]]}}}