{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,7]],"date-time":"2026-10-07T07:23:20Z","timestamp":1791357800483,"version":"4.3.1"},"reference-count":36,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2022,4,21]],"date-time":"2022-04-21T00:00:00Z","timestamp":1650499200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Top Talents Program for One Case One Discussion of Shandong Province","award":["2018-27"],"award-info":[{"award-number":["2018-27"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>China has the largest output of litchi in the world. However, at present, litchi is mainly picked manually, fruit farmers have high labor intensity and low efficiency. This means the intelligent unmanned picking system has broad prospects. The precise location of the main stem picking point of litchi is very important for the path planning of an unmanned system. Some researchers have identified the fruit and branches of litchi; however, there is relatively little research on the location of the main stem picking point of litchi. So, this paper presents a new open-access workflow for detecting accurate picking locations on the main stems and presents data used in the case study. At the same time, this paper also compares several different network architectures for main stem detection and segmentation and selects YOLOv5 and PSPNet as the most promising models for main stem detection and segmentation tasks, respectively. The workflow combines deep learning and traditional image processing algorithms to calculate the accurate location information of litchi main stem picking points in the litchi image. This workflow takes YOLOv5 as the target detection model to detect the litchi main stem in the litchi image, then extracts the detected region of interest (ROI) of the litchi main stem, uses PSPNet semantic segmentation model to semantically segment the ROI image of the main stem, carries out image post-processing operation on the ROI image of the main stem after semantic segmentation, and obtains the pixel coordinates of picking points in the ROI image of the main stem. After coordinate conversion, the pixel coordinates of the main stem picking points of the original litchi image are obtained, and the picking points are drawn on the litchi image. At present, the workflow can obtain the accurate position information of the main stem picking point in the litchi image. The recall and precision of this method were 76.29% and 92.50%, respectively, which lays a foundation for the subsequent work of obtaining the three-dimensional coordinates of the main stem picking point according to the image depth information, even though we have not done this work in this paper.<\/jats:p>","DOI":"10.3390\/rs14092004","type":"journal-article","created":{"date-parts":[[2022,4,24]],"date-time":"2022-04-24T00:45:21Z","timestamp":1650761121000},"page":"2004","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":58,"title":["Method for Identifying Litchi Picking Position Based on YOLOv5 and PSPNet"],"prefix":"10.3390","volume":"14","author":[{"given":"Xiaokang","family":"Qi","sequence":"first","affiliation":[{"name":"School of Mechanical and Aerospace Engineering, Jilin University, Changchun 130025, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingshi","family":"Dong","sequence":"additional","affiliation":[{"name":"School of Mechanical and Aerospace Engineering, Jilin University, Changchun 130025, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yubin","family":"Lan","sequence":"additional","affiliation":[{"name":"School of Agricultural Engineering and Food Science, Shandong University of Technology, Zibo 255000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0622-0445","authenticated-orcid":false,"given":"Hang","family":"Zhu","sequence":"additional","affiliation":[{"name":"School of Mechanical and Aerospace Engineering, Jilin University, Changchun 130025, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,4,21]]},"reference":[{"key":"ref_1","first-page":"34","article-title":"2018 China litchi Summit","volume":"56","author":"Huang","year":"2018","journal-title":"World Trop. Agric. Inf."},{"key":"ref_2","first-page":"11","article-title":"Research status and development trend of litchi picking machinery","volume":"49","author":"Zhu","year":"2021","journal-title":"For. Mach. Woodwork. Equip."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Davidson, J.R., Hohimer, C.J., Mo, C., and Karkee, M. (2017, January 16\u201319). Dual robot coordination for apple harvesting. Proceedings of the 2017 ASABE Annual International Meeting, Spokane, WA, USA.","DOI":"10.13031\/aim.201700567"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"603","DOI":"10.13031\/trans.12875","article-title":"Virtual model of grip-and-cut picking for simulation of vibration and falling of grape clusters","volume":"62","author":"Liu","year":"2019","journal-title":"Trans. ASABE"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Dai, N., Xie, H., Yang, X., Zhan, K., and Liu, J. (2019, January 7\u201310). Recognition of cutting region for pomelo picking robot based on machine vision. Proceedings of the 2019 ASABE Annual International Meeting, Boston, MA, USA.","DOI":"10.13031\/aim.201900412"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"105192","DOI":"10.1016\/j.compag.2019.105192","article-title":"A visual detection method for nighttime litchi fruits and fruiting stems","volume":"169","author":"Liang","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1016\/j.compag.2018.06.007","article-title":"Visual positioning technology of picking robots for dynamic litchi clusters with disturbance","volume":"151","author":"Xiong","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.biosystemseng.2017.11.005","article-title":"The recognition of litchi clusters and the calculation of picking point in a nocturnal natural environment","volume":"166","author":"Xiong","year":"2018","journal-title":"Biosyst. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Deng, J., Li, J., and Zou, X. (2011, January 19\u201320). Extraction of litchi stem based on computer vision under natural scene. Proceedings of the 2011 International Conference on Computer Distributed Control and Intelligent Environmental Monitoring, Changsha, China.","DOI":"10.1109\/CDCIEM.2011.380"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.biosystemseng.2016.02.004","article-title":"Localisation of litchi in an unstructured environment using binocular stereo vision","volume":"145","author":"Wang","year":"2016","journal-title":"Biosyst. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.biosystemseng.2019.08.016","article-title":"Computer vision-based localisation of picking points for automatic litchi harvesting applications towards natural scenarios","volume":"187","author":"Zhuang","year":"2019","journal-title":"Biosyst. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.compag.2018.02.016","article-title":"Deep learning in agriculture: A survey","volume":"147","author":"Kamilaris","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"126030","DOI":"10.1016\/j.eja.2020.126030","article-title":"Deep learning techniques for estimation of the yield and size of citrus fruits using a UAV","volume":"115","author":"Egea","year":"2020","journal-title":"Eur. J. Agron."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards real-time object detection with region proposal networks","volume":"39","author":"Ren","year":"2017","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1107","DOI":"10.1007\/s11119-019-09642-0","article-title":"Deep learning for real-time fruit detection and orchard fruit load estimation: Benchmarking of \u2018MangoYOLO\u2019","volume":"20","author":"Koirala","year":"2019","journal-title":"Precis. Agric."},{"key":"ref_16","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Redmon, J., and Farhadi, A. (2017, January 21\u201326). YOLO9000: Better, faster, stronger. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.690"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1016\/j.biosystemseng.2020.04.006","article-title":"Visual detection of green mangoes by an unmanned aerial vehicle in orchards based on a deep learning method","volume":"194","author":"Xiong","year":"2020","journal-title":"Biosyst. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"118","DOI":"10.1016\/j.compag.2016.01.023","article-title":"A method of segmenting apples at night based on color and position information","volume":"122","author":"Liu","year":"2016","journal-title":"Comput. Electron. Agric."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Sa, I., Ge, Z., Dayoub, F., Upcroft, B., Perez, T., and McCool, C. (2016). Deepfruits: A fruit detection system using deep neural networks. Sensors, 16.","DOI":"10.3390\/s16081222"},{"key":"ref_21","first-page":"557","article-title":"Recognition on image of lychee fruits and their main fruit bearing based on twin-threshold method","volume":"35","author":"Guo","year":"2014","journal-title":"Comput. Eng. Des."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"106398","DOI":"10.1016\/j.compag.2021.106398","article-title":"A method for litchi picking points calculation in natural environment based on main fruit bearing branch detection","volume":"189","author":"Zhong","year":"2021","journal-title":"Comput. Electron. Agric."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Bolya, D., Zhou, C., Xiao, F., and Lee, Y.J. (2019, January 27\u201328). YOLACT: Real-time instance segmentation. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00925"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21\u201326). Pyramid scene parsing network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.660"},{"key":"ref_26","unstructured":"Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Padilla, R., Netto, S.L., and Da Silva, E.A. (2020, January 1\u20133). A survey on performance metrics for object-detection algorithms. Proceedings of the 2020 International Conference on Systems, Signals and Image Processing (IWSSIP), Niteroi, Brazil.","DOI":"10.1109\/IWSSIP48289.2020.9145130"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"302","DOI":"10.1007\/s11263-018-1140-0","article-title":"Semantic understanding of scenes through the ade20k dataset","volume":"127","author":"Zhou","year":"2019","journal-title":"Int. J. Comput. Vis."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., and Schiele, B. (2016, January 27\u201330). The cityscapes dataset for semantic urban scene understanding. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.350"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/s11263-009-0275-4","article-title":"The pascal visual object classes (voc) challenge","volume":"88","author":"Everingham","year":"2010","journal-title":"Int. J. Comput. Vis."},{"key":"ref_31","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1007\/s42979-020-0114-9","article-title":"Detecting affect states using VGG16, ResNet50 and SE-ResNet50 networks","volume":"1","author":"Theckedath","year":"2020","journal-title":"SN Comput. Sci."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Torrey, L., and Shavlik, J. (2010). Transfer learning. Handbook of Research on Machine Learning Applications and Trends: Algorithms, Methods, and Techniques, IGI Global.","DOI":"10.4018\/978-1-60566-766-9.ch011"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1145\/357994.358023","article-title":"A fast parallel algorithm for thinning digital patterns","volume":"27","author":"Zhang","year":"1984","journal-title":"Commun. ACM"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016, January 8\u201316). Ssd: Single shot multibox detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8\u201314). Encoder-decoder with atrous separable convolution for semantic image segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_49"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/9\/2004\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:58:26Z","timestamp":1760137106000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/9\/2004"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,4,21]]},"references-count":36,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2022,5]]}},"alternative-id":["rs14092004"],"URL":"https:\/\/doi.org\/10.3390\/rs14092004","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,4,21]]}}}