{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,8]],"date-time":"2026-07-08T16:33:45Z","timestamp":1783528425671,"version":"3.55.0"},"reference-count":32,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2024,5,8]],"date-time":"2024-05-08T00:00:00Z","timestamp":1715126400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Natural Sciences and Engineering Research Council of Canada (NSERC)","award":["RGPIN2021-04244"],"award-info":[{"award-number":["RGPIN2021-04244"]}]},{"name":"Natural Sciences and Engineering Research Council of Canada (NSERC)","award":["2019-67021-28996"],"award-info":[{"award-number":["2019-67021-28996"]}]},{"name":"United States Department of Agriculture (USDA)","award":["RGPIN2021-04244"],"award-info":[{"award-number":["RGPIN2021-04244"]}]},{"name":"United States Department of Agriculture (USDA)","award":["2019-67021-28996"],"award-info":[{"award-number":["2019-67021-28996"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>Aphid infestations are one of the primary causes of extensive damage to wheat and sorghum fields and are one of the most common vectors for plant viruses, resulting in significant agricultural yield losses. To address this problem, farmers often employ the inefficient use of harmful chemical pesticides that have negative health and environmental impacts. As a result, a large amount of pesticide is wasted on areas without significant pest infestation. This brings to attention the urgent need for an intelligent autonomous system that can locate and spray sufficiently large infestations selectively within the complex crop canopies. We have developed a large multi-scale dataset for aphid cluster detection and segmentation, collected from actual sorghum fields and meticulously annotated to include clusters of aphids. Our dataset comprises a total of 54,742 image patches, showcasing a variety of viewpoints, diverse lighting conditions, and multiple scales, highlighting its effectiveness for real-world applications. In this study, we trained and evaluated four real-time semantic segmentation models and three object detection models specifically for aphid cluster segmentation and detection. Considering the balance between accuracy and efficiency, Fast-SCNN delivered the most effective segmentation results, achieving 80.46% mean precision, 81.21% mean recall, and 91.66 frames per second (FPS). For object detection, RT-DETR exhibited the best overall performance with a 61.63% mean average precision (mAP), 92.6% mean recall, and 72.55 on an NVIDIA V100 GPU. Our experiments further indicate that aphid cluster segmentation is more suitable for assessing aphid infestations than using detection models.<\/jats:p>","DOI":"10.3390\/jimaging10050114","type":"journal-article","created":{"date-parts":[[2024,5,8]],"date-time":"2024-05-08T09:58:56Z","timestamp":1715162336000},"page":"114","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["A New Dataset and Comparative Study for Aphid Cluster Detection and Segmentation in Sorghum Fields"],"prefix":"10.3390","volume":"10","author":[{"given":"Raiyan","family":"Rahman","sequence":"first","affiliation":[{"name":"Department of Computer Science, Toronto Metropolitan University, Toronto, ON M5B 2K3, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-3327-0218","authenticated-orcid":false,"given":"Christopher","family":"Indris","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Toronto Metropolitan University, Toronto, ON M5B 2K3, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Goetz","family":"Bramesfeld","sequence":"additional","affiliation":[{"name":"Department of Aerospace Engineering, Toronto Metropolitan University, Toronto, ON M5B 2K3, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6171-3176","authenticated-orcid":false,"given":"Tianxiao","family":"Zhang","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computer Science, University of Kansas, Lawrence, KS 66045, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kaidong","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computer Science, University of Kansas, Lawrence, KS 66045, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9690-0067","authenticated-orcid":false,"given":"Xiangyu","family":"Chen","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computer Science, University of Kansas, Lawrence, KS 66045, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2697-3727","authenticated-orcid":false,"given":"Ivan","family":"Grijalva","sequence":"additional","affiliation":[{"name":"Department of Entomology, Kansas State University, Manhattan, KS 66506-4004, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7779-0504","authenticated-orcid":false,"given":"Brian","family":"McCornack","sequence":"additional","affiliation":[{"name":"Department of Entomology, Kansas State University, Manhattan, KS 66506-4004, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0926-7874","authenticated-orcid":false,"given":"Daniel","family":"Flippo","sequence":"additional","affiliation":[{"name":"Department of Biological and Agricultural Engineering, Kansas State University, Manhattan, KS 66506, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5161-4123","authenticated-orcid":false,"given":"Ajay","family":"Sharda","sequence":"additional","affiliation":[{"name":"Department of Biological and Agricultural Engineering, Kansas State University, Manhattan, KS 66506, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3182-104X","authenticated-orcid":false,"given":"Guanghui","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Computer Science, Toronto Metropolitan University, Toronto, ON M5B 2K3, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,5,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s13205-018-1536-0","article-title":"An effective pest management approach in potato to combat insect pests and herbicide","volume":"9","author":"Amiri","year":"2019","journal-title":"3 Biotech"},{"key":"ref_2","first-page":"1","article-title":"Global burden of crop loss","volume":"3","author":"Finegold","year":"2019","journal-title":"Gates Open Res."},{"key":"ref_3","unstructured":"Pearce, R. (2019). Precision Agronomy: Precision Ag Is Rapidly Evolving, with Many Emerging Benefits for Producers, Country Guide."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.biosystemseng.2015.11.005","article-title":"Detection of aphids in wheat fields using a computer vision technique","volume":"141","author":"Liu","year":"2016","journal-title":"Biosyst. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Chen, J., Fan, Y., Wang, T., Zhang, C., Qiu, Z., and He, Y. (2018). Automatic segmentation and counting of aphid nymphs on leaves using convolutional neural networks. Agronomy, 8.","DOI":"10.3390\/agronomy8080129"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Teng, Y., Wang, R., Du, J., Huang, Z., Zhou, Q., and Jiao, L. (2022). TD-Det: A Tiny Size Dense Aphid Detection Network under In-Field Environment. Insects, 13.","DOI":"10.3390\/insects13060501"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Zhang, T., Li, K., Chen, X., Zhong, C., Luo, B., Teran, I.G., McCornack, B., Flippo, D., Sharda, A., and Wang, G. (2023, January 13\u201314). A New Dataset and Comparative Study for Aphid Cluster Detection. Proceedings of the 2nd AAAI Workshop on AI for Agriculture and Food Systems, Washington, DC, USA.","DOI":"10.1038\/s41598-023-38633-5"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Rahman, R., Indris, C., Zhang, T., Li, K., McCornack, B., Flippo, D., Sharda, A., and Wang, G. (2023, January 17\u201324). On the real-time semantic segmentation of aphid clusters in the wild. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.","DOI":"10.1109\/CVPRW59228.2023.00670"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1564","DOI":"10.1002\/ohn.411","article-title":"Interpretable computer vision to detect and classify structural laryngeal lesions in digital flexible laryngoscopic images","volume":"169","author":"Bur","year":"2023","journal-title":"Otolaryngol. Head Neck Surg."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"108440","DOI":"10.1016\/j.patcog.2021.108440","article-title":"Semantic clustering based deduction learning for image recognition and classification","volume":"124","author":"Ma","year":"2022","journal-title":"Pattern Recognit."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Li, K., Fathan, M.I., Patel, K., Zhang, T., Zhong, C., Bansal, A., Rastogi, A., Wang, J.S., and Wang, G. (2021). Colonoscopy polyp detection and classification: Dataset creation and comparative evaluations. PLoS ONE, 16.","DOI":"10.1371\/journal.pone.0255809"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhang, T., Luo, B., Sharda, A., and Wang, G. (2022). Dynamic label assignment for object detection by combining predicted ious and anchor ious. J. Imaging, 8.","DOI":"10.3390\/jimaging8070193"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1016\/j.neucom.2021.01.126","article-title":"SOSD-Net: Joint semantic object segmentation and depth estimation from monocular images","volume":"440","author":"He","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_14","unstructured":"Patel, K.B., Li, F., and Wang, G. (2022, January 28). FuzzyNet: A Fuzzy Attention Module for Polyp Segmentation. Proceedings of the NeurIPS\u201922 Workshop on All Things Attention: Bridging Different Perspectives on Attention, New Orleans, LA, USA."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1016\/j.aspen.2014.06.014","article-title":"Using digital image processing for counting whiteflies on soybean leaves","volume":"17","author":"Barbedo","year":"2014","journal-title":"J. Asia Pac. Entomol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"400","DOI":"10.1016\/j.neucom.2021.12.012","article-title":"Towards densely clustered tiny pest detection in the wild environment","volume":"490","author":"Du","year":"2022","journal-title":"Neurocomputing"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Parraga-Alava, J., Alcivar-Cevallos, R., Morales Carrillo, J., Castro, M., Avell\u00e1n, S., Loor, A., and Mendoza, F. (2021). LeLePhid: An Image Dataset for Aphid Detection and Infestation Severity on Lemon Leaves. Data, 6.","DOI":"10.3390\/data6050051"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"13410","DOI":"10.1038\/s41598-023-38633-5","article-title":"Aphid cluster recognition and detection in the wild using deep learning models","volume":"13","author":"Zhang","year":"2023","journal-title":"Sci. Rep."},{"key":"ref_19","unstructured":"Munson, R.E., Schaffer, J.A., and Palm, E.W. (2023, May 30). Sorghum Aphid Pest Management. Available online: https:\/\/mospace.umsystem.edu\/xmlui\/handle\/10355\/8183."},{"key":"ref_20","unstructured":"Poudel, R.P.K., Liwicki, S., and Cipolla, R. (2019). Fast-SCNN: Fast Semantic Segmentation Network. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Yu, C., Wang, J., Peng, C., Gao, C., Yu, G., and Sang, N. (2018). BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentation. arXiv.","DOI":"10.1007\/978-3-030-01261-8_20"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Yu, C., Gao, C., Wang, J., Yu, G., Shen, C., and Sang, N. (2020). BiSeNet V2: Bilateral Network with Guided Aggregation for Real-time Semantic Segmentation. arXiv.","DOI":"10.1007\/s11263-021-01515-2"},{"key":"ref_23","unstructured":"Wang, J., Sun, K., Cheng, T., Jiang, B., Deng, C., Zhao, Y., Liu, D., Mu, Y., Tan, M., and Wang, X. (2019). Deep High-Resolution Representation Learning for Visual Recognition. arXiv."},{"key":"ref_24","unstructured":"Ren, S., He, K., Girshick, R.B., and Sun, J. (2015). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. arXiv."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Redmon, J., Divvala, S.K., Girshick, R.B., and Farhadi, A. (2015). You Only Look Once: Unified, Real-Time Object Detection. arXiv.","DOI":"10.1109\/CVPR.2016.91"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2022). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv.","DOI":"10.1109\/CVPR52729.2023.00721"},{"key":"ref_27","unstructured":"Lv, W., Zhao, Y., Xu, S., Wei, J., Wang, G., Cui, C., Du, Y., Dang, Q., and Liu, Y. (2023). DETRs Beat YOLOs on Real-time Object Detection. arXiv."},{"key":"ref_28","unstructured":"Contributors, M. (2023, May 30). MMSegmentation: OpenMMLab Semantic Segmentation Toolbox and Benchmark. Available online: https:\/\/github.com\/open-mmlab\/mmsegmentation."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhang, S., Chi, C., Yao, Y., Lei, Z., and Li, S.Z. (2020, January 13\u201319). Bridging the gap between anchor-based and anchor-free detection via adaptive training sample selection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00978"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Li, X., Wang, W., Hu, X., Li, J., Tang, J., and Yang, J. (2021, January 20\u201325). Generalized focal loss v2: Learning reliable localization quality estimation for dense object detection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.01146"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Kim, K., and Lee, H.S. (2020, January 23\u201328). Probabilistic anchor assignment with iou prediction for object detection. Proceedings of the Computer Vision\u2014ECCV 2020: 16th European Conference, Glasgow, UK. Proceedings, Part XXV 16.","DOI":"10.1007\/978-3-030-58595-2_22"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Zhang, H., Wang, Y., Dayoub, F., and Sunderhauf, N. (2021, January 20\u201325). Varifocalnet: An iou-aware dense object detector. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.","DOI":"10.1109\/CVPR46437.2021.00841"}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/10\/5\/114\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:42:04Z","timestamp":1760107324000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/10\/5\/114"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,8]]},"references-count":32,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2024,5]]}},"alternative-id":["jimaging10050114"],"URL":"https:\/\/doi.org\/10.3390\/jimaging10050114","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,8]]}}}