{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T18:48:12Z","timestamp":1780512492293,"version":"3.54.1"},"reference-count":34,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2023,6,8]],"date-time":"2023-06-08T00:00:00Z","timestamp":1686182400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"key research and development projects in Tianjin","award":["19YFZCSN00360"],"award-info":[{"award-number":["19YFZCSN00360"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In the complex environment of orchards, in view of low fruit recognition accuracy, poor real-time and robustness of traditional recognition algorithms, this paper propose an improved fruit recognition algorithm based on deep learning. Firstly, the residual module was assembled with the cross stage parity network (CSP Net) to optimize recognition performance and reduce the computing burden of the network. Secondly, the spatial pyramid pool (SPP) module is integrated into the recognition network of the YOLOv5 to blend the local and global features of the fruit, thus improving the recall rate of the minimum fruit target. Meanwhile, the NMS algorithm was replaced by the Soft NMS algorithm to enhance the ability of identifying overlapped fruits. Finally, a joint loss function was constructed based on focal and CIoU loss to optimize the algorithm, and the recognition accuracy was significantly improved. The test results show that the MAP value of the improved model after dataset training reaches 96.3% in the test set, which is 3.8% higher than the original model. F1 value reaches 91.8%, which is 3.8% higher than the original model. The average detection speed under GPU reaches 27.8 frames\/s, which is 5.6 frames\/s higher than the original model. Compared with current advanced detection methods such as Faster RCNN and RetinaNet, among others, the test results show that this method has excellent detection accuracy, good robustness and real-time performance, and has important reference value for solving the problem of accurate recognition of fruit in complex environment.<\/jats:p>","DOI":"10.3390\/s23125425","type":"journal-article","created":{"date-parts":[[2023,6,8]],"date-time":"2023-06-08T02:02:28Z","timestamp":1686189748000},"page":"5425","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Research on Apple Recognition Algorithm in Complex Orchard Environment Based on Deep Learning"],"prefix":"10.3390","volume":"23","author":[{"given":"Zhuoqun","family":"Zhao","sequence":"first","affiliation":[{"name":"School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China"},{"name":"School of Mechanical Engineering, Tianjin Sino-German University of Applied Sciences, Tianjin 300350, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jiang","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hui","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering and Automation, Tianjin University of Technology, Tianjin 300384, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,6,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"105380","DOI":"10.1016\/j.compag.2020.105380","article-title":"Detection and segmentation of overlapped fruits based on optimized mask R-CNN application in apple harvesting robot","volume":"172","author":"Jia","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"754","DOI":"10.1007\/s11119-020-09754-y","article-title":"Fast and accurate detection of kiwifruit in orchard using improved YOLOv3-tiny model","volume":"22","author":"Fu","year":"2020","journal-title":"Precis. Agric."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1177\/1729881420925310","article-title":"Apple harvesting robot under information technology: A review","volume":"17","author":"Jia","year":"2020","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kang, H.W., and Chen, C. (2019). Fruit detection and segmentation for apple harvesting using visual sensor in orchards. Sensors, 19.","DOI":"10.3390\/s19204599"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.biosystemseng.2019.06.019","article-title":"In-field citrus detection and localisation based on RGB-D image analysis","volume":"186","author":"Lin","year":"2019","journal-title":"Biosyst. Eng."},{"key":"ref_6","first-page":"5156","article-title":"A fast and efficient green apple object detection model based on Foveabox","volume":"34","author":"Jia","year":"2022","journal-title":"J. King Saud Univ.\u2014Comput. Inf. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Liu, G.X., Nouaze, J.C., Touko, P.L., and Kim, J.H. (2020). YOLO-Tomato: A robust algorithm for tomato detection based on YOLOv3. Sensors, 20.","DOI":"10.3390\/s20072145"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1016\/j.biosystemseng.2019.09.006","article-title":"Recognition of green apples in an orchard environment by combining the GrabCut model and Ncut algorithm","volume":"187","author":"Sun","year":"2019","journal-title":"Biosyst. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"107036","DOI":"10.1016\/j.comnet.2019.107036","article-title":"Faster R-CNN for multi-class fruit detection using a robotic vision system","volume":"168","author":"Wan","year":"2020","journal-title":"Comput. Netw."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"105192","DOI":"10.1016\/j.compag.2019.105192","article-title":"A visual detection method for nighttime litchi fruits and fruiting stems","volume":"169","author":"Liang","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2061","DOI":"10.1109\/TCSVT.2022.3222305","article-title":"Motion stimulation for compositional action recognition","volume":"33","author":"Ma","year":"2023","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"8257","DOI":"10.1109\/TGRS.2020.3042507","article-title":"Recurrent thrifty attention network for remote sensing scene recognition","volume":"59","author":"Fu","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Pan, W., Zhao, Z., Huang, W., Zhang, Z., Fu, L., Pan, Z., Yu, J., and Wu, F. (2022). Video Moment Retrieval with Noisy Labels. IEEE Trans. Neural Netw. Learn. Syst.","DOI":"10.1109\/TNNLS.2022.3212900"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards real-time object detection with region proposal networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"111808","DOI":"10.1016\/j.postharvbio.2021.111808","article-title":"Apple stem\/calyx real-time recognition using YOLO-v5 algorithm for fruit automatic loading system","volume":"185","author":"Wang","year":"2022","journal-title":"Postharvest Biol. Technol."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"105742","DOI":"10.1016\/j.compag.2020.105742","article-title":"Using channel pruning-based YOLO v4 deep learning algorithm for the real-time and accurate detection of apple flowers in natural environments","volume":"178","author":"Wu","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Sun, J., He, X.F., Ge, X., Wu, X., Shen, J., and Song, Y. (2018). Detection of key organs in tomato based on deep migration learning in a complex background. Agriculture, 8.","DOI":"10.20944\/preprints201810.0524.v1"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"107765","DOI":"10.1016\/j.compag.2023.107765","article-title":"Using lightweight deep learning algorithm for real-time detection of apple flowers in natural environments","volume":"207","author":"Shang","year":"2023","journal-title":"Comput. Electron. Agric."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 11\u201314). Ssd: Single Shot Multibox Detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27\u201330). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1016\/j.compag.2019.01.012","article-title":"Apple detection during different growth stages in orchards using the improved YOLOv3 model","volume":"157","author":"Tian","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_24","first-page":"164","article-title":"Apple positioning based on YOLO deep convolutional neural network for picking robot in complex background","volume":"35","author":"Zhao","year":"2019","journal-title":"Trans. Chin. Soc. Agric. Eng. (Trans. CSAE)"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Huang, M., Wang, B., Wan, J., and Zhou, C. (2023, January 24\u201326). Improved Blood Cell Detection Method Based on YOLOv5 Algorithm. Proceedings of the 2023 IEEE 6th Information Technology, Networking, Electronic and Automation Control Conference, Chongqing, China.","DOI":"10.1109\/ITNEC56291.2023.10082206"},{"key":"ref_26","unstructured":"Alexey, B., Wang, C.-Y., and Liao, H.-Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Wang, C.Y., Mark Liao, H.Y., Wu, Y.H., Chen, P.Y., Hsieh, J.W., and Yeh, I.H. (2020, January 14\u201319). CSPNet: A New Backbone That Can Enhance Learning Capability of CNN. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00203"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1016\/j.patrec.2021.10.026","article-title":"SnipeDet: Attention-guided pyramidal prediction kernels for generic object detection","volume":"152","author":"Chena","year":"2021","journal-title":"Pattern Recognit. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"110102","DOI":"10.1016\/j.jfoodeng.2020.110102","article-title":"On line detection of defective apples using computer vision system combined with deep learning methods","volume":"286","author":"Fan","year":"2020","journal-title":"J. Food Eng."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1072","DOI":"10.1007\/s11119-020-09709-3","article-title":"Passion fruit detection and counting based on multiple scale faster R-CNN using RGB-D images","volume":"21","author":"Tu","year":"2020","journal-title":"Precis. Agric."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Bodla, N., Singh, B., Chellappa, R., and Davis, L.S. (2017, January 22\u201329). Soft-NMS\u2014Improving Object Detection with One Line of Code. Proceedings of the 2017 IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.593"},{"key":"ref_32","first-page":"36","article-title":"Real-time detection methodology for obstacles in orchards using improved YOLOv4","volume":"37","author":"Shuping","year":"2021","journal-title":"Trans. Chin. Soc. Agric. Eng. (Trans. CSAE)"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1109\/TPAMI.2018.2858826","article-title":"Focal Loss for Dense Object Detection","volume":"42","author":"Lin","year":"2020","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"104846","DOI":"10.1016\/j.compag.2019.06.001","article-title":"Fruit detection for strawberry harvesting robot in non-structural environment based on Mask-RCNN","volume":"163","author":"Yu","year":"2019","journal-title":"Comput. Electron. Agric."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/12\/5425\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:50:32Z","timestamp":1760125832000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/12\/5425"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,8]]},"references-count":34,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["s23125425"],"URL":"https:\/\/doi.org\/10.3390\/s23125425","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,8]]}}}