{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T02:00:29Z","timestamp":1780711229622,"version":"3.54.1"},"reference-count":51,"publisher":"MDPI AG","issue":"22","license":[{"start":{"date-parts":[[2022,11,18]],"date-time":"2022-11-18T00:00:00Z","timestamp":1668729600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Precise canopy management is critical in vineyards for premium wine production because maximum crop load does not guarantee the best economic return for wine producers. The growers keep track of the number of grape bunches during the entire growing season for optimizing crop load per vine. Manual counting of grape bunches can be highly labor-intensive and error prone. Thus, an integrated, novel detection model, Swin-transformer-YOLOv5, was proposed for real-time wine grape bunch detection. The research was conducted on two varieties of Chardonnay and Merlot from July to September 2019. The performance of Swin-T-YOLOv5 was compared against commonly used detectors. All models were comprehensively tested under different conditions, including two weather conditions, two berry maturity stages, and three sunlight intensities. The proposed Swin-T-YOLOv5 outperformed others for grape bunch detection, with mean average precision (mAP) of up to 97% and F1-score of 0.89 on cloudy days. This mAP was ~44%, 18%, 14%, and 4% greater than Faster R-CNN, YOLOv3, YOLOv4, and YOLOv5, respectively. Swin-T-YOLOv5 achieved an R2 of 0.91 and RMSE of 2.4 (number of grape bunches) compared with the ground truth on Chardonnay. Swin-T-YOLOv5 can serve as a reliable digital tool to help growers perform precision canopy management in vineyards.<\/jats:p>","DOI":"10.3390\/rs14225853","type":"journal-article","created":{"date-parts":[[2022,11,21]],"date-time":"2022-11-21T04:13:36Z","timestamp":1669004016000},"page":"5853","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":52,"title":["Swin-Transformer-YOLOv5 for Real-Time Wine Grape Bunch Detection"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4957-9418","authenticated-orcid":false,"given":"Shenglian","family":"Lu","sequence":"first","affiliation":[{"name":"Guangxi Key Lab of Multisource Information Mining and Security, College of Computer Science and Engineering, Guangxi Normal University, Guilin 541004, China"},{"name":"Center for Precision and Automated Agricultural Systems, Washington State University, Prosser, WA 99350, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xiaoyu","family":"Liu","sequence":"additional","affiliation":[{"name":"Guangxi Key Lab of Multisource Information Mining and Security, College of Computer Science and Engineering, Guangxi Normal University, Guilin 541004, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zixuan","family":"He","sequence":"additional","affiliation":[{"name":"Center for Precision and Automated Agricultural Systems, Washington State University, Prosser, WA 99350, USA"},{"name":"Department of Biological Systems Engineering, Washington State University, Pullman, WA 99164, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9654-3859","authenticated-orcid":false,"given":"Xin","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Agricultural and Biological Engineering, Mississippi State University, Mississippi State, MS 39762, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1136-9885","authenticated-orcid":false,"given":"Wenbo","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Agricultural and Biological Engineering, Mississippi State University, Mississippi State, MS 39762, USA"},{"name":"Coastal Research and Extension Center, Mississippi State University, Pascagoula, MS 39567, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Manoj","family":"Karkee","sequence":"additional","affiliation":[{"name":"Center for Precision and Automated Agricultural Systems, Washington State University, Prosser, WA 99350, USA"},{"name":"Department of Biological Systems Engineering, Washington State University, Pullman, WA 99164, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,11,18]]},"reference":[{"key":"ref_1","unstructured":"(2022, October 18). USDA\/NASS QuickStats Query Tool, Available online: https:\/\/quickstats.nass.usda.gov\/."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1007\/s11119-020-09718-2","article-title":"Optimizing precision irrigation of a vineyard to improve water use efficiency and profitability by using a decision-oriented vine water consumption model","volume":"22","author":"Bellvert","year":"2020","journal-title":"Precis. Agric."},{"key":"ref_3","unstructured":"Zou, Z., Shi, Z., Guo, Y., and Ye, J. (2019). Object Detection in 20 Years: A Survey. arXiv."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"128837","DOI":"10.1109\/ACCESS.2019.2939201","article-title":"A Survey of Deep Learning-Based Object Detection","volume":"7","author":"Jiao","year":"2019","journal-title":"IEEE Access"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1016\/j.patcog.2017.10.013","article-title":"Recent advances in convolutional neural networks","volume":"77","author":"Gu","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016, January 11\u201314). Ssd: Single Shot Multibox Detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Goyal, P., Girshick, R., He, K., and Dollr, P. (2017, January 22\u201329). Focal Loss for Dense Object Detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Tian, Z., Shen, C., Chen, H., and He, T. (2019, January 27\u201328). Fcos: Fully Convolutional One-Stage Object Detection. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea.","DOI":"10.1109\/ICCV.2019.00972"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., and Zagoruyko, S. (2020, January 23\u201328). End-to-End Object Detection with Transformers. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58452-8_13"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Tan, M., Pang, R., and Le, Q.v. (2020, January 13\u201319). Efficientdet: Scalable and Efficient Object Detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01079"},{"key":"ref_11","unstructured":"Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y.M. (2020). Yolov4: Optimal Speed and Accuracy of Object Detection. arXiv."},{"key":"ref_12","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An Incremental Improvement. arXiv."},{"key":"ref_13","unstructured":"(2022, October 18). Ultralytics. Yolov5. Available online: https:\/\/github.com\/ultralytics\/yolov5."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Wang, C.-Y., Bochkovskiy, A., and Liao, H.-Y.M. (2021, January 20\u201325). Scaled-Yolov4: Scaling Cross Stage Partial Network. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01283"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23\u201328). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.81"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast R-Cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1137","DOI":"10.1109\/TPAMI.2016.2577031","article-title":"Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks","volume":"39","author":"Ren","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1904","DOI":"10.1109\/TPAMI.2015.2389824","article-title":"Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition","volume":"37","author":"He","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Dollr, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21\u201326). Feature Pyramid Networks for Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_20","unstructured":"Duan, K., Bai, S., Xie, L., Qi, H., Huang, Q., and Tian, Q. (November, January 27). Centernet: Keypoint Triplets for Object Detection. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Seoul, Republic of Korea."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"105634","DOI":"10.1016\/j.compag.2020.105634","article-title":"Multi-class fruit-on-plant detection for apple in SNAP system using Faster R-CNN","volume":"176","author":"Gao","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1072","DOI":"10.1007\/s11119-020-09709-3","article-title":"Passion fruit detection and counting based on multiple scale faster R-CNN using RGB-D images","volume":"21","author":"Tu","year":"2020","journal-title":"Precis. Agric."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"9","DOI":"10.52810\/TIOT.2021.100028","article-title":"Immature Apple Detection Method Based on Improved Yolov3","volume":"1","author":"Huang","year":"2021","journal-title":"ASP Trans. Internet Things"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e13803","DOI":"10.1111\/jfpe.13803","article-title":"An improved Yolov3 based on dual path network for cherry tomatoes detection","volume":"44","author":"Chen","year":"2021","journal-title":"J. Food Process. Eng."},{"key":"ref_25","unstructured":"Chen, Y., Li, J., Xiao, H., Jin, X., Yan, S., and Feng, J. (2017, January 4\u20139). Dual Path Networks. Proceedings of the Annual Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"106696","DOI":"10.1016\/j.compag.2022.106696","article-title":"Canopy-attention-YOLOv4-based immature\/mature apple fruit detection on dense-foliage tree architectures for early crop load estimation","volume":"193","author":"Lu","year":"2022","journal-title":"Comput. Electron. Agric."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018, January 8\u201314). Cbam: Convolutional Block Attention Module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_1"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3505244","article-title":"Transformers in Vision: A Survey","volume":"54","author":"Khan","year":"2022","journal-title":"ACM Comput. Surv."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Li, Y., Mao, H., Girshick, R., and He, K. (2022). Exploring Plain Vision Transformer Backbones for Object Detection. arXiv.","DOI":"10.1007\/978-3-031-20077-9_17"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11\u201317). Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Virtual Event.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"4486","DOI":"10.1109\/TCSVT.2021.3127149","article-title":"SwinNet: Swin Transformer Drives Edge-Aware RGB-D and RGB-T Salient Object Detection","volume":"32","author":"Liu","year":"2021","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Hatamizadeh, A., Nath, V., Tang, Y., Yang, D., Roth, H.R., and Xu, D. (2022). Swin UNETR: Swin Transformers for Semantic Segmentation of Brain Tumors in MRI Images. arXiv.","DOI":"10.1007\/978-3-031-08999-2_22"},{"key":"ref_33","first-page":"611","article-title":"Improving Classification of Remotely Sensed Images with the Swin Transformer","volume":"2022","author":"Jannat","year":"2022","journal-title":"SoutheastCon"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Srinivas, A., Lin, T.-Y., Parmar, N., Shlens, J., Abbeel, P., and Vaswani, A. (2021, January 20\u201325). Bottleneck Transformers for Visual Recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01625"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Zhao, H., Jia, J., and Koltun, V. (2020, January 13\u201319). Exploring Self-Attention for Image Recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.01009"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollr, P., and Zitnick, C.L. (2014, January 6\u201312). Microsoft Coco: Common Objects in Context. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10602-1_48"},{"key":"ref_37","first-page":"23296","article-title":"Intriguing Properties of Vision Transformers","volume":"34","author":"Naseer","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Wang, J., Zhang, Z., Luo, L., Zhu, W., Chen, J., and Wang, W. (2021). SwinGD: A Robust Grape Bunch Detection Model Based on Swin Transformer in Complex Vineyard Environment. Horticulturae, 7.","DOI":"10.3390\/horticulturae7110492"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"2789","DOI":"10.1007\/s11694-022-01396-0","article-title":"Swin-MLP: A strawberry appearance quality identification method by Swin Transformer and multi-layer perceptron","volume":"16","author":"Zheng","year":"2022","journal-title":"J. Food Meas. Charact."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"107163","DOI":"10.1016\/j.compag.2022.107163","article-title":"Practical cucumber leaf disease recognition using improved Swin Transformer and small sample size","volume":"199","author":"Wang","year":"2022","journal-title":"Comput. Electron. Agric."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Aguiar, A.S., Magalhes, S.A., dos Santos, F.N., Castro, L., Pinho, T., Valente, J., Martins, R., and Boaventura-Cunha, J. (2021). Grape Bunch Detection at Different Growth Stages Using Deep Learning Quantized Models. Agronomy, 11.","DOI":"10.3390\/agronomy11091890"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"113588","DOI":"10.1016\/j.eswa.2020.113588","article-title":"Grape detection with convolutional neural networks","volume":"159","author":"Cecotti","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"105687","DOI":"10.1016\/j.compag.2020.105687","article-title":"Application of consumer RGB-D cameras for fruit detection and localization in field: A critical review","volume":"177","author":"Fu","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1107","DOI":"10.1007\/s11119-019-09642-0","article-title":"Deep learning for real-time fruit detection and orchard fruit load estimation: Benchmarking of \u2018MangoYOLO\u2019","volume":"20","author":"Koirala","year":"2019","journal-title":"Precis. Agric."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1016\/j.biosystemseng.2021.11.011","article-title":"A real-time table grape detection method based on improved YOLOv4-tiny network in complex background","volume":"212","author":"Li","year":"2021","journal-title":"Biosyst. Eng."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Sozzi, M., Cantalamessa, S., Cogato, A., Kayad, A., and Marinello, F. (2022). Automatic Bunch Detection in White Grape Varieties Using YOLOv3, YOLOv4, and YOLOv5 Deep Learning Algorithms. Agronomy, 12.","DOI":"10.3390\/agronomy12020319"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1016\/j.compag.2019.01.012","article-title":"Apple detection during different growth stages in orchards using the improved YOLO-V3 model","volume":"157","author":"Tian","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_48","unstructured":"(2018, May 06). LabelImg. Available online: https:\/\/github.com\/tzutalin\/labelImg."},{"key":"ref_49","unstructured":"(2020, February 18). Imgaug. Available online: https:\/\/github.com\/aleju\/imgaug."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"3388","DOI":"10.1109\/TPAMI.2020.2981890","article-title":"Imbalance Problems in Object Detection: A Review","volume":"43","author":"Oksuz","year":"2021","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Winkler, A.J. (1974). General Viticulture, University of California Press.","DOI":"10.1525\/9780520353183"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/22\/5853\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:21:29Z","timestamp":1760145689000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/22\/5853"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,18]]},"references-count":51,"journal-issue":{"issue":"22","published-online":{"date-parts":[[2022,11]]}},"alternative-id":["rs14225853"],"URL":"https:\/\/doi.org\/10.3390\/rs14225853","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,18]]}}}