{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,1]],"date-time":"2026-07-01T22:14:52Z","timestamp":1782944092459,"version":"3.54.5"},"reference-count":48,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2024,8,18]],"date-time":"2024-08-18T00:00:00Z","timestamp":1723939200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100011033","name":"SPANISH RESEARCH STATE AGENCY (AEI)","doi-asserted-by":"publisher","award":["PID2020-113229RB-C41\/AEI\/10.13039\/501100011033"],"award-info":[{"award-number":["PID2020-113229RB-C41\/AEI\/10.13039\/501100011033"]}],"id":[{"id":"10.13039\/501100011033","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011033","name":"SPANISH RESEARCH STATE AGENCY (AEI)","doi-asserted-by":"publisher","award":["PRE2018-083227"],"award-info":[{"award-number":["PRE2018-083227"]}],"id":[{"id":"10.13039\/501100011033","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100011033","name":"SPANISH RESEARCH STATE AGENCY (AEI)","doi-asserted-by":"publisher","award":["FJC2021-047687-1"],"award-info":[{"award-number":["FJC2021-047687-1"]}],"id":[{"id":"10.13039\/501100011033","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100020636","name":"SPANISH MINISTRY OF EDUCATION AND PROFESSIONAL TRAINING","doi-asserted-by":"publisher","award":["PID2020-113229RB-C41\/AEI\/10.13039\/501100011033"],"award-info":[{"award-number":["PID2020-113229RB-C41\/AEI\/10.13039\/501100011033"]}],"id":[{"id":"10.13039\/501100020636","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100020636","name":"SPANISH MINISTRY OF EDUCATION AND PROFESSIONAL TRAINING","doi-asserted-by":"publisher","award":["PRE2018-083227"],"award-info":[{"award-number":["PRE2018-083227"]}],"id":[{"id":"10.13039\/501100020636","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100020636","name":"SPANISH MINISTRY OF EDUCATION AND PROFESSIONAL TRAINING","doi-asserted-by":"publisher","award":["FJC2021-047687-1"],"award-info":[{"award-number":["FJC2021-047687-1"]}],"id":[{"id":"10.13039\/501100020636","id-type":"DOI","asserted-by":"publisher"}]},{"name":"MCIN\/AEI\/10.13039\/501100011033 and EUROPEAN UNION NEXTGENERATIONEU\/PRTR","award":["PID2020-113229RB-C41\/AEI\/10.13039\/501100011033"],"award-info":[{"award-number":["PID2020-113229RB-C41\/AEI\/10.13039\/501100011033"]}]},{"name":"MCIN\/AEI\/10.13039\/501100011033 and EUROPEAN UNION NEXTGENERATIONEU\/PRTR","award":["PRE2018-083227"],"award-info":[{"award-number":["PRE2018-083227"]}]},{"name":"MCIN\/AEI\/10.13039\/501100011033 and EUROPEAN UNION NEXTGENERATIONEU\/PRTR","award":["FJC2021-047687-1"],"award-info":[{"award-number":["FJC2021-047687-1"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Early detection of weeds is crucial to manage weeds effectively, support decision-making and prevent potential crop losses. This research presents an innovative approach to develop a specialized cognitive system for classifying and detecting early-stage weeds at the species level. The primary objective was to create an automated multiclass discrimination system using cognitive computing, regardless of the weed growth stage. Initially, the model was trained and tested on a dataset of 31,002 UAV images, including ten weed species manually identified by experts at the early phenological stages of maize (BBCH14) and tomato (BBCH501). The images were captured at 11 m above ground level. This resulted in a classification accuracy exceeding 99.1% using the vision transformer Swin-T model. Subsequently, generative modeling was employed for data augmentation, resulting in new classification models based on the Swin-T architecture. These models were evaluated on an unbalanced dataset of 36,556 UAV images captured at later phenological stages (maize BBCH17 and tomato BBCH509), achieving a weighted average F1-score ranging from 94.8% to 95.3%. This performance highlights the system\u2019s adaptability to morphological variations and its robustness in diverse crop scenarios, suggesting that the system can be effectively implemented in real agricultural scenarios, significantly reducing the time and resources required for weed identification. The proposed data augmentation technique also proved to be effective in implementing the detection transformer architecture, significantly improving the generalization capability and enabling accurate detection of weeds at different growth stages. The research represents a significant advancement in weed monitoring across phenological stages, with potential applications in precision agriculture and sustainable crop management. Furthermore, the methodology showcases the versatility of the latest generation models for application in other knowledge domains, facilitating time-efficient model development. Future research could investigate the applicability of the model in different geographical regions and with different types of crops, as well as real-time implementation for continuous field monitoring.<\/jats:p>","DOI":"10.3390\/rs16163026","type":"journal-article","created":{"date-parts":[[2024,8,19]],"date-time":"2024-08-19T05:19:36Z","timestamp":1724044776000},"page":"3026","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Cognitive Computing Advancements: Improving Precision Crop Protection through UAV Imagery for Targeted Weed Monitoring"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3774-4121","authenticated-orcid":false,"given":"Gustavo A.","family":"Mes\u00edas-Ruiz","sequence":"first","affiliation":[{"name":"Institute of Agricultural Sciences, Spanish National Research Council (ICA-CSIC), Serrano 115b, 28006 Madrid, Spain"},{"name":"School of Agricultural, Food and Biosystems Engineering (ETSIAAB), Polytechnic University of Madrid (UPM), Av. Puerta de Hierro 2, 28040 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4592-3792","authenticated-orcid":false,"given":"Jos\u00e9 M.","family":"Pe\u00f1a","sequence":"additional","affiliation":[{"name":"Institute of Agricultural Sciences, Spanish National Research Council (ICA-CSIC), Serrano 115b, 28006 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6699-2204","authenticated-orcid":false,"given":"Ana I.","family":"de Castro","sequence":"additional","affiliation":[{"name":"Environment and Agronomy Department, National Agricultural and Food Research and Technology Institute (INIA-CSIC), Ctra. Coru\u00f1a km 7.5, 28008 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3444-3099","authenticated-orcid":false,"given":"Irene","family":"Borra-Serrano","sequence":"additional","affiliation":[{"name":"Institute of Agricultural Sciences, Spanish National Research Council (ICA-CSIC), Serrano 115b, 28006 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2268-2562","authenticated-orcid":false,"given":"Jos\u00e9","family":"Dorado","sequence":"additional","affiliation":[{"name":"Institute of Agricultural Sciences, Spanish National Research Council (ICA-CSIC), Serrano 115b, 28006 Madrid, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,8,18]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1016\/j.tplants.2022.12.014","article-title":"Weed-induced crop yield loss: A new paradigm and new challenges","volume":"28","author":"Horvath","year":"2023","journal-title":"Trends Plant Sci."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Chantre, G.R., and Gonz\u00e1lez-And\u00fajar, J.L. (2020). Site-Specific Based Models. Decision Support Systems for Weed Management, Springer International Publishing.","DOI":"10.1007\/978-3-030-44402-0"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"638","DOI":"10.1111\/j.1365-3180.2010.00809.x","article-title":"An assessment of the accuracy and consistency of human perception of weed cover","volume":"50","author":"Ribeiro","year":"2010","journal-title":"Weed Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1016\/j.compag.2019.02.005","article-title":"A review on weed detection using ground-based machine vision and image processing techniques","volume":"158","author":"Wang","year":"2019","journal-title":"Comput. Electron. Agric."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Mittal, M., Shah, R.R., and Roy, S. (2021). Chapter 1-Introduction to cognitive computing and its various applications. Cognitive Computing for Human-Robot Interaction, Academic Press. Cognitive Data Science in Sustainable Computing.","DOI":"10.1016\/B978-0-323-85769-7.00009-4"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"102888","DOI":"10.1016\/j.ipm.2022.102888","article-title":"Application of cognitive computing in healthcare, cybersecurity, big data and IoT: A literature review","volume":"59","author":"Sreedevi","year":"2022","journal-title":"Inf. Process. Manag."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"e1680845","DOI":"10.1155\/2020\/1680845","article-title":"Research on How Human Intelligence, Consciousness, and Cognitive Computing Affect the Development of Artificial Intelligence","volume":"2020","author":"Dong","year":"2020","journal-title":"Complexity"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Lytras, M.D., and Visvizi, A. (2021). Artificial Intelligence and Cognitive Computing: Methods, Technologies, Systems, Applications and Policy Making. Sustainability, 13.","DOI":"10.3390\/su13073598"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Sumithra, M., Kumar Dhanaraj, R., Iwendi, C., and Manoharan, A. (2023). Foundation of cognitive computing. Deep Learning for Cognitive Computing Systems: Technological Advancements and Applications, De Gruyter.","DOI":"10.1515\/9783110750584"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"103514","DOI":"10.1016\/j.dsp.2022.103514","article-title":"A survey of modern deep learning based object detection models","volume":"126","author":"Zaidi","year":"2022","journal-title":"Digit. Signal Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2533","DOI":"10.1016\/j.procs.2023.01.227","article-title":"Speech emotion recognition system using gender dependent convolution neural network","volume":"218","author":"Singh","year":"2023","journal-title":"Procedia Comput. Sci."},{"key":"ref_13","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017). Attention is All you Need. Proceedings of the Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/j.aiopen.2022.10.001","article-title":"A survey of transformers","volume":"3","author":"Lin","year":"2022","journal-title":"AI Open"},{"key":"ref_15","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2021). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. arXiv."},{"key":"ref_16","unstructured":"Yang, Y., Jiao, L., Liu, X., Liu, F., Yang, S., Feng, Z., and Tang, X. (2022). Transformers Meet Visual Learning Understanding: A Comprehensive Review. arXiv."},{"key":"ref_17","unstructured":"Liu, Y., Zhang, Y., Wang, Y., Hou, F., Yuan, J., Tian, J., Zhang, Y., Shi, Z., Fan, J., and He, Z. (2023). A Survey of Visual Transformers. IEEE Trans. Neural Netw. Learn. Syst., 1\u201321."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1016\/bs.host.2016.07.003","article-title":"Chapter 8-Cognitive Systems for the Food\u2013Water\u2013Energy Nexus","volume":"Volume 35","author":"Gudivada","year":"2016","journal-title":"Handbook of Statistics"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/j.compag.2010.01.001","article-title":"Development of soft computing and applications in agricultural and biological engineering","volume":"71","author":"Huang","year":"2010","journal-title":"Comput. Electron. Agric."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Mourhir, A., Papageorgiou, E.I., Kokkinos, K., and Rachidi, T. (2017). Exploring Precision Farming Scenarios Using Fuzzy Cognitive Maps. Sustainability, 9.","DOI":"10.3390\/su9071241"},{"key":"ref_21","first-page":"334","article-title":"Cognitive Distributed Computing System for Intelligent Agriculture","volume":"24","author":"Munteanu","year":"2021","journal-title":"Int. J. Progress. Sci. Technol. (IJPSAT)"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.tplants.2018.11.007","article-title":"Perspectives for Remote Sensing with Unmanned Aerial Vehicles in Precision Agriculture","volume":"24","author":"Maes","year":"2019","journal-title":"Trends Plant Sci."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"111402","DOI":"10.1016\/j.rse.2019.111402","article-title":"Remote sensing for agricultural applications: A meta-review","volume":"236","author":"Weiss","year":"2020","journal-title":"Remote Sens. Environ."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"107017","DOI":"10.1016\/j.compag.2022.107017","article-title":"Drones in agriculture: A review and bibliometric analysis","volume":"198","author":"Rejeb","year":"2022","journal-title":"Comput. Electron. Agric."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"100258","DOI":"10.1016\/j.array.2022.100258","article-title":"Data augmentation: A comprehensive survey of modern approaches","volume":"16","author":"Mumuni","year":"2022","journal-title":"Array"},{"key":"ref_26","unstructured":"Meier, U. (2018). Growth Stages of Mono- and Dicotyledonous Plants: BBCH Monograph. Open Agrar Repositorium."},{"key":"ref_27","unstructured":"(2024, August 15). Tzutalin, LabelImg. Available online: https:\/\/github.com\/tzutalin\/labelImg."},{"key":"ref_28","unstructured":"Mes\u00edas-Ruiz, G.A., Borra-Serrano, I., Pe\u00f1a Barrag\u00e1n, J.M., de Castro, A.I., Fern\u00e1ndez-Quintanilla, C., and Dorado, J. (2024, August 15). Unmanned Aerial Vehicle Imagery for Early Stage Weed Classification and Detection in Maize and Tomato Crops. DIGITAL.CSIC. Available online: https:\/\/digital.csic.es\/handle\/10261\/347533."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 10\u201317). Swin Transformer: Hierarchical Vision Transformer using Shifted Windows. Proceedings of the 2021 IEEE\/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22\u201329). Grad-CAM: Visual Explanations From Deep Networks via Gradient-Based Localization. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.74"},{"key":"ref_31","unstructured":"Loshchilov, I., and Hutter, F. (2019). Decoupled Weight Decay Regularization. arXiv."},{"key":"ref_32","unstructured":"Olaniyi, E., Chen, D., Lu, Y., and Huang, Y. (2022). Generative Adversarial Networks for Image Augmentation in Agriculture: A Systematic Review. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Wang, X., Li, Y., Zhang, H., and Shan, Y. (2021). Towards Real-World Blind Face Restoration with Generative Facial Prior. arXiv.","DOI":"10.1109\/CVPR46437.2021.00905"},{"key":"ref_34","unstructured":"Kingma, D.P., and Ba, J. (2017). Adam: A Method for Stochastic Optimization. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., and Zagoruyko, S. (2020). End-to-End Object Detection with Transformers. arXiv.","DOI":"10.1007\/978-3-030-58452-8_13"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1016\/j.compag.2017.10.027","article-title":"Weed detection in soybean crops using ConvNets","volume":"143","author":"Pistori","year":"2017","journal-title":"Comput. Electron. Agric."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"179","DOI":"10.5194\/isprs-annals-IV-2-W5-179-2019","article-title":"DETECTING RUMEX OBTUSIFOLIUS WEED PLANTS IN GRASSLANDS FROM UAV RGB IMAGERY USING DEEP LEARNING","volume":"IV-2\/W5","author":"Valente","year":"2019","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1291","DOI":"10.1007\/s11119-020-09721-7","article-title":"Detection of Colchicum autumnale in drone images, using a machine-learning approach","volume":"21","author":"Petrich","year":"2020","journal-title":"Precis. Agric."},{"key":"ref_40","first-page":"23","article-title":"Weed location and recognition based on UAV imaging and deep learning","volume":"3","author":"Zhang","year":"2020","journal-title":"Int. J. Precis. Agric. Aviat."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Huang, H., Deng, J., Lan, Y., Yang, A., Deng, X., Wen, S., Zhang, H., and Zhang, Y. (2018). Accurate Weed Mapping and Prescription Map Generation Based on Fully Convolutional Networks Using UAV Imagery. Sensors, 18.","DOI":"10.3390\/s18103299"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1080\/22797254.2020.1793687","article-title":"An open source workflow for weed mapping in native grassland using unmanned aerial vehicle: Using Rumex obtusifolius as a case study","volume":"54","author":"Lam","year":"2021","journal-title":"Eur. J. Remote Sens."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"108055","DOI":"10.1016\/j.compag.2023.108055","article-title":"Top-tuning on transformers and data augmentation transferring for boosting the performance of weed identification","volume":"211","author":"Panoutsopoulos","year":"2023","journal-title":"Comput. Electron. Agric."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Reedha, R., Dericquebourg, E., Canals, R., and Hafiane, A. (2022). Transformer Neural Network for Weed and Crop Classification of High Resolution UAV Images. Remote Sens., 14.","DOI":"10.3390\/rs14030592"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Khan, S., Tufail, M., Khan, M.T., Khan, Z.A., Iqbal, J., and Alam, M. (2021). A novel semi-supervised framework for UAV based crop\/weed classification. PLoS ONE, 16.","DOI":"10.1371\/journal.pone.0251008"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Shahi, T.B., Dahal, S., Sitaula, C., Neupane, A., and Guo, W. (2023). Deep Learning-Based Weed Detection Using UAV Images: A Comparative Study. Drones, 7.","DOI":"10.3390\/drones7100624"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Gallo, I., Rehman, A.U., Dehkordi, R.H., Landro, N., La Grassa, R., and Boschetti, M. (2023). Deep Object Detection of Crop Weeds: Performance of YOLOv7 on a Real Case Dataset from UAV Images. Remote Sens., 15.","DOI":"10.3390\/rs15020539"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"105385","DOI":"10.1016\/j.compag.2020.105385","article-title":"An automatic method for weed mapping in oat fields based on UAV imagery","volume":"173","author":"Zrinjski","year":"2020","journal-title":"Comput. Electron. Agric."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/16\/3026\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T15:38:25Z","timestamp":1760110705000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/16\/3026"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,18]]},"references-count":48,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2024,8]]}},"alternative-id":["rs16163026"],"URL":"https:\/\/doi.org\/10.3390\/rs16163026","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,8,18]]}}}