{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T18:52:56Z","timestamp":1781635976988,"version":"3.54.5"},"reference-count":32,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T00:00:00Z","timestamp":1770681600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,2,23]],"date-time":"2026-02-23T00:00:00Z","timestamp":1771804800000},"content-version":"vor","delay-in-days":13,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Minufiya University"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Big Data"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Wheat is one of the most critical staple crops globally and its productivity is severely threatened by various foliar diseases. These diseases leading to substantial economic and food security challenges. Accurate and early automated wheat disease classification is vital for reducing yield losses and improving agricultural productivity. This paper introduces a novel hybrid transformer model named Hybrid Attention Transformer Network (HAT-Net) designed for robust wheat disease classification. HAT-Net integrates the features of Swin Transformer and DeiT (Data-efficient Image Transformer) through a fully connected fusion layer. A cosine annealing scheduler is employed to enhance convergence and mitigate overfitting. The proposed model achieved 99.2% accuracy and 97.79% under cross-validation which outperforms existing transformer-based architectures. Two additional models, the Wheat-based Swin Transformer Network (W-STNet) and the Wheat-based Data Efficient Network (W-DENet) were developed. They achieved 96.72% and 97.3% accuracy under cross validation, respectively. This indicates that W-STNet trained approximately 25.3% faster than W-DENet and 41.4% faster than HAT-Net. To enhance transparency and trust in model decisions, three explainability techniques include LIME, Grad-CAM (for visualizing class-discriminative regions), and TorchVision\u2019s activation maps (for hierarchical feature analysis) are applied. These methods collectively validate that our models focus on biologically relevant disease patterns, bridging the gap between high performance and actionable agricultural insights. Compared with prior work (93.72% accuracy), HAT-Net achieved superior performance, efficiency, and transparency demonstrates the potential of hybrid transformers for reliable and scalable crop disease diagnosis. Transformers deliver higher accuracy, faster training, and more efficient feature learning, outperforming CNNs in both performance and real-world agricultural deployment.<\/jats:p>","DOI":"10.1186\/s40537-025-01353-w","type":"journal-article","created":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T09:54:35Z","timestamp":1770717275000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Novel transformer models for wheat disease classification with explainable insights"],"prefix":"10.1186","volume":"13","author":[{"given":"Amira","family":"Abdelatey","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adel Abdallah","family":"Abdou","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hatem","family":"Mohammed","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gamal Farouk","family":"Elhady","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,2,10]]},"reference":[{"issue":"12","key":"1353_CR1","doi-asserted-by":"publisher","DOI":"10.3390\/agronomy9120892","volume":"9","author":"SC Bhardwaj","year":"2019","unstructured":"Bhardwaj SC, Singh GP, Gangwar OP, Prasad P, Kumar S. Status of wheat rust research and progress in rust management-Indian context. Agronomy. 2019;9(12):892.","journal-title":"Agronomy"},{"issue":"3","key":"1353_CR2","doi-asserted-by":"publisher","first-page":"430","DOI":"10.1038\/s41559-018-0793-y","volume":"3","author":"S Savary","year":"2019","unstructured":"Savary S, Willocquet L, Pethybridge SJ, Esker P, McRoberts N, Nelson A. The global burden of pathogens and pests on major food crops. Nat Ecol Evol. 2019;3(3):430\u20139.","journal-title":"Nat Ecol Evol"},{"key":"1353_CR3","doi-asserted-by":"publisher","DOI":"10.1016\/j.compag.2024.109005","volume":"221","author":"D Kumar","year":"2024","unstructured":"Kumar D, Kukreja V. Image segmentation, classification, and recognition methods for wheat diseases: two decades\u2019 systematic literature review. Comput Electron Agric. 2024;221:109005.","journal-title":"Comput Electron Agric"},{"key":"1353_CR4","first-page":"104","volume":"1","author":"I Kunduracioglu","year":"2024","unstructured":"Kunduracioglu I. Utilizing ResNet architectures for identification of tomato diseases. J Intell Decis Mak Inform Sci. 2024;1:104\u201319.","journal-title":"J Intell Decis Mak Inform Sci"},{"key":"1353_CR5","doi-asserted-by":"publisher","first-page":"235","DOI":"10.59543\/comdem.v1i.10957","volume":"1","author":"I Kunduracioglu","year":"2024","unstructured":"Kunduracioglu I. Cnn models approaches for robust classification of Apple diseases. Comput Decis Making: Int J. 2024;1:235\u201351.","journal-title":"Comput Decis Making: Int J"},{"issue":"3","key":"1353_CR6","doi-asserted-by":"publisher","first-page":"1061","DOI":"10.1007\/s41348-024-00896-z","volume":"131","author":"I Kunduracioglu","year":"2024","unstructured":"Kunduracioglu I, Pacal I. Advancements in deep learning for accurate classification of grape leaves and diagnosis of grape diseases. J Plant Dis Prot. 2024;131(3):1061\u201380.","journal-title":"J Plant Dis Prot"},{"issue":"1","key":"1353_CR7","doi-asserted-by":"publisher","first-page":"321","DOI":"10.31181\/jopi21202423","volume":"2","author":"\u0130 Kundurac\u0131o\u011flu","year":"2024","unstructured":"Kundurac\u0131o\u011flu \u0130, Pa\u00e7al \u0130. Deep learning-based disease detection in sugarcane leaves: evaluating EfficientNet models. J Oper Intell. 2024;2(1):321\u2013235.","journal-title":"J Oper Intell"},{"key":"1353_CR8","doi-asserted-by":"crossref","unstructured":"Lu J, Hu J, Zhao G, Mei F, Zhang C. An in-field automatic, Lu J, Hu J, Zhao G, Mei F, Zhang C. An in-field automatic wheat disease diagnosis system. Computers and electronics in agriculture 142, 369\u2013379 (2017).","DOI":"10.1016\/j.compag.2017.09.012"},{"issue":"60","key":"1353_CR9","doi-asserted-by":"publisher","first-page":"125138","DOI":"10.1007\/s11356-023-26780-1","volume":"30","author":"A Shah","year":"2023","unstructured":"Shah A, Ali B, Wahab F, Ullah I, Amesho KT, Shafiq M. Entropy-based grid approach for handling outliers: a case study to environmental monitoring data. Environ Sci Pollut Res. 2023;30(60):125138\u201357.","journal-title":"Environ Sci Pollut Res"},{"key":"1353_CR10","unstructured":"Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Polosukhin I. Attention is all you need. Adv Neural Inf Process Syst 30 (2017)."},{"key":"1353_CR11","unstructured":"Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Houlsby N. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)."},{"key":"1353_CR12","doi-asserted-by":"crossref","unstructured":"Liu Z, Lin Y, Cao Y, Hu H, Wei Y, Zhang Z, Wang X, Guo B. Swin transformer: Hierarchical vision transformer using shifted windows. In: Proceedings of the IEEE\/CVF international conference on computer vision, pp. 10012\u201310022. (2021).","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"1353_CR13","unstructured":"Touvron H, Cord M, Douze M, Massa F, Sablayrolles A, J\u00e9gou H. Training data-efficient image transformers & distillation through attention. In: International conference on machine learning, pp. 10347\u201310357. PMLR (2021)."},{"key":"1353_CR14","doi-asserted-by":"crossref","unstructured":"Ribeiro MT, Singh S, Guestrin C. Why should i trust you? Explaining the predictions of any classifier. In: Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining, pp. 1135\u20131144. (2016).","DOI":"10.1145\/2939672.2939778"},{"key":"1353_CR15","unstructured":"Lundberg SM, Lee SI. A unified approach to interpreting model predictions. Adv Neural Inf Process Syst 2017;30:4768\u20134777."},{"key":"1353_CR16","doi-asserted-by":"publisher","DOI":"10.1016\/j.compag.2021.106184","volume":"186","author":"Z Jiang","year":"2021","unstructured":"Jiang Z, et al. Recognition of rice leaf diseases and wheat leaf diseases based on multi-task deep transfer learning. Comput Electron Agric. 2021;186:106184.","journal-title":"Comput Electron Agric"},{"issue":"1","key":"1353_CR17","doi-asserted-by":"publisher","DOI":"10.3390\/s22010031","volume":"22","author":"Z Feng","year":"2021","unstructured":"Feng Z, et al. Monitoring wheat powdery mildew based on hyperspectral, thermal infrared, and RGB image data fusion. Sensors (Basel). 2021;22(1):31.","journal-title":"Sensors (Basel)"},{"key":"1353_CR18","doi-asserted-by":"crossref","unstructured":"KHATTAR SHEENAMS, Sonam. VERMA, Tushar: Automated wheat plant disease detection using deep learning: a multi-class classification approach. In: 2023 3rd International Conference on Intelligent Technologies (CONIT), pp. 1\u20135. IEEE (2023).","DOI":"10.1109\/CONIT59222.2023.10205683"},{"issue":"5","key":"1353_CR19","doi-asserted-by":"crossref","first-page":"1123","DOI":"10.3390\/rs14051123","volume":"14","author":"Y Zhang","year":"2022","unstructured":"Zhang Y, et al. Detection and monitoring wheat diseases using unmanned aerial vehicles. Remote Sens. 2022;14(5):1123.","journal-title":"Remote Sens"},{"key":"1353_CR20","doi-asserted-by":"publisher","first-page":"69853","DOI":"10.1109\/ACCESS.2024.3397570","volume":"12","author":"STY Ramadan","year":"2024","unstructured":"Ramadan STY, Sakib T, Al Farid F, Islam MS, Abdullah JB, Bhuiyan MR, Karim HBA. Improving wheat leaf disease classification: evaluating augmentation strategies and cnn-based models with limited dataset. IEEE Access. 2024;12:69853\u201374.","journal-title":"IEEE Access"},{"key":"1353_CR21","doi-asserted-by":"crossref","unstructured":"Kumar V, Gill KS, Chauhan R, Thapliyal S, Sharma K. Enhancing Wheat Disease Classification: A Hybrid Approach Combining CNN and Random Forest. In: 2024 Fourth International Conference on Advances in Electrical, Computing, Communication and Sustainable Technologies (ICAECT), pp. 1\u20137. IEEE (2024).","DOI":"10.1109\/ICAECT60202.2024.10469310"},{"key":"1353_CR22","doi-asserted-by":"publisher","DOI":"10.1109\/access.2024.3434575","author":"M Islam","year":"2024","unstructured":"Islam M, Aloraini M, Habib S, Alanazi MD, Khan I, Khan A. Optimal Features Driven Attention Network With Medium-Scale Benchmark for Wheat Diseases Recognition. IEEE Access. 2024. https:\/\/doi.org\/10.1109\/access.2024.3434575.","journal-title":"IEEE Access"},{"key":"1353_CR23","unstructured":"2020 LCDCD, Dataset. https:\/\/www.kaggle.com\/datasets\/lyxbash\/lcdcd-2020-dataset, last accessed 2025\/05\/07."},{"key":"1353_CR24","doi-asserted-by":"crossref","unstructured":"Liu Z, Lin Y, Cao Y, Hu H, Wei Y, Zhang Z, Guo B. Swin transformer: Hierarchical vision transformer using shifted windows. In: Proceedings of the IEEE\/CVF international conference on computer vision, pp. 10012\u201310022. (2021).","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"1353_CR25","doi-asserted-by":"publisher","first-page":"15845","DOI":"10.1109\/ACCESS.2024.3357946","volume":"12","author":"T Jumphoo","year":"2024","unstructured":"Jumphoo T, Phapatanaburi K, Pathonsuwan W, Anchuen P, Uthansakul M, Uthansakul P. Exploiting data-efficient image transformer-based transfer learning for valvular heart diseases detection. IEEE Access. 2024;12:15845\u201355.","journal-title":"IEEE Access"},{"key":"1353_CR26","doi-asserted-by":"crossref","unstructured":"Jahangeer JS, Shanmugavadivu P. (2025, August). Diabetic Retinopathy Detection using a deep CNN with Attention and Refined Learning Rate Scheduling. In 2025 World Skills Conference on Universal Data Analytics and Sciences (WorldSUAS) (pp. 1\u20138). IEEE.","DOI":"10.1109\/WorldSUAS66815.2025.11199220"},{"issue":"1","key":"1353_CR27","doi-asserted-by":"publisher","DOI":"10.1186\/s40708-024-00222-1","volume":"11","author":"V Vimbi","year":"2024","unstructured":"Vimbi V, Shaffi N, Mahmud M. Interpreting artificial intelligence models: a systematic review on the application of LIME and SHAP in Alzheimer\u2019s disease detection. Brain Inf. 2024;11(1):10.","journal-title":"Brain Inf"},{"issue":"1","key":"1353_CR28","doi-asserted-by":"publisher","first-page":"440","DOI":"10.1186\/s12870-025-06386-0","volume":"25","author":"K Gopalan","year":"2025","unstructured":"Gopalan K, Srinivasan S, Singh M, Mathivanan SK, Moorthy U. Corn leaf disease diagnosis: enhancing accuracy with resnet152 and grad-cam for explainable AI. BMC Plant Biol. 2025;25(1):440.","journal-title":"BMC Plant Biol"},{"key":"1353_CR29","doi-asserted-by":"publisher","DOI":"10.3389\/fpls.2016.01419","volume":"7","author":"SP Mohanty","year":"2016","unstructured":"Mohanty SP, Hughes DP, Salath\u00e9 M. Using deep learning for image-based plant disease detection. Front Plant Sci. 2016;7:1419.","journal-title":"Front Plant Sci"},{"key":"1353_CR30","unstructured":"Google COLAB. https:\/\/colab.research.google.com\/, last accessed 2025\/05\/07."},{"issue":"3","key":"1353_CR31","first-page":"1447","volume":"40","author":"A de la Cruz Huayanay","year":"2025","unstructured":"de la Cruz Huayanay A, Baz\u00e1n JL, Russo CM. Performance of evaluation metrics for classification in imbalanced data. Comput Stat. 2025;40(3):1447\u201373.","journal-title":"Comput Stat"},{"key":"1353_CR32","doi-asserted-by":"crossref","unstructured":"Pacal, I., Kunduracioglu, I., Alma, M. H., Deveci, M., Kadry, S., Nedoma, J., \u2026 Martinek,R. (2024). A systematic review of deep learning techniques for plant diseases. Artificial Intelligence Review, 57(11), 304.","DOI":"10.1007\/s10462-024-10944-7"}],"container-title":["Journal of Big Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40537-025-01353-w","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-025-01353-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40537-025-01353-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T18:01:20Z","timestamp":1781632880000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1186\/s40537-025-01353-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,2,10]]},"references-count":32,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2026,12]]}},"alternative-id":["1353"],"URL":"https:\/\/doi.org\/10.1186\/s40537-025-01353-w","relation":{},"ISSN":["2196-1115"],"issn-type":[{"value":"2196-1115","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,2,10]]},"assertion":[{"value":"10 June 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 December 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 February 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"<!--Emphasis Type='Bold' removed-->Ethics and consent to participate declarations"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to publication"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Institutional review board statement"}},{"value":"Not applicable.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}},{"value":"The authors declare no competing interests.","order":6,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"30"}}