{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,8]],"date-time":"2026-08-08T06:19:46Z","timestamp":1786169986993,"version":"3.56.0"},"reference-count":39,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2023,10,17]],"date-time":"2023-10-17T00:00:00Z","timestamp":1697500800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100005920","name":"Organization for Women in Science for the Developing World (OWSD)","doi-asserted-by":"publisher","award":["3240318598"],"award-info":[{"award-number":["3240318598"]}],"id":[{"id":"10.13039\/501100005920","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Plant diseases pose a critical threat to global agricultural productivity, demanding timely detection for effective crop yield management. Traditional methods for disease identification are laborious and require specialised expertise. Leveraging cutting-edge deep learning algorithms, this study explores innovative approaches to plant disease identification, combining Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) to enhance accuracy. A multispectral dataset was meticulously collected to facilitate this research using six 50 mm filter filters, covering both the visible and several near-infrared (NIR) wavelengths. Among the models employed, ViT-B16 notably achieved the highest test accuracy, precision, recall, and F1 score across all filters, with averages of 83.3%, 90.1%, 90.75%, and 89.5%, respectively. Furthermore, a comparative analysis highlights the pivotal role of balanced datasets in selecting the appropriate wavelength and deep learning model for robust disease identification. These findings promise to advance crop disease management in real-world agricultural applications and contribute to global food security. The study underscores the significance of machine learning in transforming plant disease diagnostics and encourages further research in this field.<\/jats:p>","DOI":"10.3390\/s23208531","type":"journal-article","created":{"date-parts":[[2023,10,17]],"date-time":"2023-10-17T10:43:10Z","timestamp":1697539390000},"page":"8531","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":86,"title":["Multispectral Plant Disease Detection with Vision Transformer\u2013Convolutional Neural Network Hybrid Approaches"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7777-9057","authenticated-orcid":false,"given":"Malithi","family":"De Silva","sequence":"first","affiliation":[{"name":"The Department of Computer Science, Rhodes University, Hamilton Building, Prince Alfred Street, Grahamstown 6139, South Africa"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7395-7370","authenticated-orcid":false,"given":"Dane","family":"Brown","sequence":"additional","affiliation":[{"name":"The Department of Computer Science, Rhodes University, Hamilton Building, Prince Alfred Street, Grahamstown 6139, South Africa"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,17]]},"reference":[{"key":"ref_1","unstructured":"(2023, September 05). Agriculture and Food. Available online: https:\/\/www.worldbank.org\/en\/topic\/agriculture\/overview."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Jambor, A., Babu, S., Jambor, A., and Babu, S. (2016). Competitiveness of Global Agriculture: Policy Lessons for Food Security, Springer.","DOI":"10.1007\/978-3-319-44876-3"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Cheng, Y. (2023). Analysis of Development Strategy for Ecological Agriculture Based on a Neural Network in the Environmental Economy. Sustainability, 15.","DOI":"10.3390\/su15086843"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"105393","DOI":"10.1016\/j.compag.2020.105393","article-title":"Using deep transfer learning for image-based plant disease identification","volume":"173","author":"Chen","year":"2020","journal-title":"Comput. Electron. Agric."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"681","DOI":"10.1007\/s11540-021-09501-4","article-title":"The potato of the future: Opportunities and challenges in sustainable agri-food systems","volume":"64","author":"Devaux","year":"2021","journal-title":"Potato Res."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1111\/ppa.13467","article-title":"Fungicide resistance management: Maximizing the effective life of plant protection products","volume":"71","author":"Corkley","year":"2022","journal-title":"Plant Pathol."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"101426","DOI":"10.1016\/j.pmpp.2019.101426","article-title":"Non-destructive techniques of detecting plant diseases: A review","volume":"108","author":"Ali","year":"2019","journal-title":"Physiol. Mol. Plant Pathol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s13593-014-0246-1","article-title":"Advanced methods of plant disease detection. A review","volume":"35","author":"Martinelli","year":"2015","journal-title":"Agron. Sustain. Dev."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"101678","DOI":"10.1016\/j.ecoinf.2022.101678","article-title":"A systematic review on hyperspectral imaging technology with a machine and deep learning methodology for agricultural applications","volume":"69","author":"Khan","year":"2022","journal-title":"Ecol. Inform."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Wang, D., Cao, W., Zhang, F., Li, Z., Xu, S., and Wu, X. (2022). A review of deep learning in multiscale agricultural sensing. Remote Sens., 14.","DOI":"10.3390\/rs14030559"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1419","DOI":"10.3389\/fpls.2016.01419","article-title":"Using deep learning for image-based plant disease detection","volume":"7","author":"Mohanty","year":"2016","journal-title":"Front. Plant Sci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1080\/08839514.2017.1315516","article-title":"Deep learning for tomato diseases: Classification and symptoms visualization","volume":"31","author":"Brahimi","year":"2017","journal-title":"Appl. Artif. Intell."},{"key":"ref_13","first-page":"249","article-title":"Recognition and classification of paddy leaf diseases using Optimized Deep Neural network with Jaya algorithm","volume":"7","author":"Ramesh","year":"2020","journal-title":"Inf. Process. Agric."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Li, X., and Li, S. (2022). Transformer Help CNN See Better: A Lightweight Hybrid Apple Disease Identification Model Based on Transformers. Agriculture, 12.","DOI":"10.3390\/agriculture12060884"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1186\/s13007-017-0233-z","article-title":"Hyperspectral image analysis techniques for the detection and classification of the early onset of plant disease and stress","volume":"13","author":"Lowe","year":"2017","journal-title":"Plant Methods"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"De Silva, M., and Brown, D. (2022, January 4\u20135). Plant Disease Detection using Deep Learning on Natural Environment Images. Proceedings of the 2022 International Conference on Artificial Intelligence, Big Data, Computing and Data Communication Systems (icABCD), Durban, South Africa.","DOI":"10.1109\/icABCD54961.2022.9855925"},{"key":"ref_17","first-page":"290","article-title":"Plant Disease Detection Using Multispectral Imaging","volume":"1781","author":"Brown","year":"2023","journal-title":"Adv. Comput. Commun. Comput. Inf. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1016\/j.tplants.2021.06.009","article-title":"Applications of hyperspectral imaging in plant phenotyping","volume":"27","author":"Nguyen","year":"2022","journal-title":"Trends Plant Sci."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"De Silva, M., and Brown, D. (Lect. Notes Netw. Syst., 2023). Early Plant Disease Detection using Infrared and Mobile Photographs in Natural Environment, Lect. Notes Netw. Syst., in press.","DOI":"10.1007\/978-3-031-37717-4_21"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"De Silva, M., and Brown, D. (2023, January 3\u20134). Plant Disease Detection using Vision Transformers on Multispectral Natural Environment Images. Proceedings of the 2023 International Conference on Artificial Intelligence, Big Data, Computing and Data Communication Systems (icABCD), Durban, South Africa.","DOI":"10.1109\/icABCD59051.2023.10220517"},{"key":"ref_21","unstructured":"Brown, D., and De Silva, M. (September, January 30). Plant Disease Detection on Multispectral Images using Vision Transformers. Proceedings of the 25th Irish Machine Vision and Image Processing Conference (IMVIP), Galway, Ireland."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Fox, G. (2020). The brewing industry and the opportunities for real-time quality analysis using infrared spectroscopy. Appl. Sci., 10.","DOI":"10.3390\/app10020616"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"De Oca, A.M., Arreola, L., Flores, A., Sanchez, J., and Flores, G. (2018, January 12\u201315). Low-cost multispectral imaging system for crop monitoring. Proceedings of the 2018 International Conference on Unmanned Aircraft Systems (ICUAS), Dallas, TX, USA.","DOI":"10.1109\/ICUAS.2018.8453426"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/j.compag.2018.05.002","article-title":"A multispectral machine vision system for invertebrate detection on green leaves","volume":"150","author":"Liu","year":"2018","journal-title":"Comput. Electron. Agric."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Tait, L., Bind, J., Charan-Dixon, H., Hawes, I., Pirker, J., and Schiel, D. (2019). Unmanned aerial vehicles (UAVs) for monitoring macroalgal biodiversity: Comparison of RGB and multispectral imaging sensors for biodiversity assessments. Remote Sens., 11.","DOI":"10.3390\/rs11192332"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Singh, D., and Sharma, R. (2018). Postharvest Disinfection of Fruits and Vegetables, Elsevier.","DOI":"10.1016\/B978-0-12-812698-1.00001-7"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1602","DOI":"10.1016\/j.jclepro.2017.09.224","article-title":"Potential impacts of climate change on vegetable production and product quality\u2014A review","volume":"170","author":"Bisbis","year":"2018","journal-title":"J. Clean. Prod."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Kendal, D., Hauser, C.E., Garrard, G.E., Jellinek, S., Giljohann, K.M., and Moore, J.L. (2013). Quantifying plant colour and colour difference as perceived by humans using digital images. PLoS ONE, 8.","DOI":"10.1371\/journal.pone.0072296"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.optlaseng.2016.05.006","article-title":"Demosaicing images from colour cameras for digital image correlation","volume":"86","author":"Forsey","year":"2016","journal-title":"Opt. Lasers Eng."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"031204","DOI":"10.1117\/1.JEI.26.3.031204","article-title":"Retinex at 50: Color theory and spatial algorithms, a review","volume":"26","author":"McCann","year":"2017","journal-title":"J. Electron. Imaging"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Summers, C., and Dinneen, M.J. (2019, January 7\u201311). Improved mixed-example data augmentation. Proceedings of the 2019 IEEE winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.","DOI":"10.1109\/WACV.2019.00139"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"3142","DOI":"10.1109\/TIP.2017.2662206","article-title":"Beyond a gaussian denoiser: Residual learning of deep cnn for image denoising","volume":"26","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_36","first-page":"1","article-title":"Attention is all you need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_37","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16 \u00d7 16 words: Transformers for image recognition at scale. arXiv."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"103800","DOI":"10.1016\/j.cviu.2023.103800","article-title":"Exploring the differences in adversarial robustness between ViT-and CNN-based models using novel metrics","volume":"235","author":"Heo","year":"2023","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11\u201317). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00986"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/20\/8531\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:08:35Z","timestamp":1760130515000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/20\/8531"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,17]]},"references-count":39,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["s23208531"],"URL":"https:\/\/doi.org\/10.3390\/s23208531","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,17]]}}}