{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,19]],"date-time":"2026-10-19T18:16:27Z","timestamp":1792433787081,"version":"4.5.0"},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,7,18]],"date-time":"2024-07-18T00:00:00Z","timestamp":1721260800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,7,18]],"date-time":"2024-07-18T00:00:00Z","timestamp":1721260800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J Comput Intell Syst"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Plant disease detection is a critical task in agriculture, essential for ensuring crop health and productivity. Traditional methods in this context are often labor-intensive and prone to errors, highlighting the need for automated solutions. While computer vision-based solutions have been successfully deployed in recent years for plant disease identification and localization tasks, these often operate independently, leading to suboptimal performance. It is essential to develop an integrated solution combining these two tasks for improved efficiency and accuracy. This research proposes the innovative Plant Disease Localization and Classification model based on Vision Transformer (PDLC-ViT), which integrates co-scale, co-attention, and cross-attention mechanisms and a ViT, within a Multi-Task Learning (MTL) framework. The model was trained and evaluated on the Plant Village dataset. Key hyperparameters, including learning rate, batch size, dropout ratio, and regularization factor, were optimized through a thorough grid search. Early stopping based on validation loss was employed to prevent overfitting. The PDLC-ViT model demonstrated significant improvements in plant disease localization and classification tasks. The integration of co-scale, co-attention, and cross-attention mechanisms allowed the model to capture multi-scale dependencies and enhance feature learning, leading to superior performance compared to existing models. The PDLC-ViT model evaluated on two public datasets achieved an accuracy of 99.97%, a Mean Average Precision (MAP) of 99.18%, and a Mean Average Recall (MAR) of 99.11%. These results underscore the model's exceptional precision and recall, highlighting its robustness and reliability in detecting and classifying plant diseases. The PDLC-ViT model sets a new benchmark in plant disease detection, offering a reliable and advanced tool for agricultural applications. Its ability to integrate localization and classification tasks within an MTL framework promotes timely and accurate disease management, contributing to sustainable agriculture and food security.<\/jats:p>","DOI":"10.1007\/s44196-024-00597-3","type":"journal-article","created":{"date-parts":[[2024,7,18]],"date-time":"2024-07-18T06:02:43Z","timestamp":1721282563000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":75,"title":["A Multitask Learning-Based Vision Transformer for Plant Disease Localization and Classification"],"prefix":"10.1007","volume":"17","author":[{"given":"S.","family":"Hemalatha","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jai Jaganath Babu","family":"Jayachandran","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,7,18]]},"reference":[{"key":"597_CR1","doi-asserted-by":"crossref","unstructured":"Jeger, M., Beresford, R., Bock, C., Brown, N., Fox, A., Newton, A., ... & Yuen, J.: Global challenges facing plant pathology: multidisciplinary approaches to meet the food security and environmental challenges in the mid-twenty-first century. CABI Agriculture and Bioscience 2(1), 1\u201318 (2021)","DOI":"10.1186\/s43170-021-00042-x"},{"key":"597_CR2","first-page":"58","volume":"4","author":"T Talaviya","year":"2020","unstructured":"Talaviya, T., Shah, D., Patel, N., Yagnik, H., Shah, M.: Implementation of artificial intelligence in agriculture for optimisation of irrigation and application of pesticides and herbicides. Artificial Intell Agricult 4, 58\u201373 (2020)","journal-title":"Artificial Intell Agricult"},{"key":"597_CR3","doi-asserted-by":"publisher","DOI":"10.1016\/j.aiia.2021.100035","author":"VG Dhanya","year":"2022","unstructured":"Dhanya, V.G., Subeesh, A., Kushwaha, N.L., Vishwakarma, D.K., Kumar, T.N., Ritika, G., Singh, A.N.: Deep learning based computer vision approaches for smart agricultural applications. Artificial Intell Agricult (2022). https:\/\/doi.org\/10.1016\/j.aiia.2021.100035","journal-title":"Artificial Intell Agricult"},{"issue":"3","key":"597_CR4","doi-asserted-by":"publisher","first-page":"478","DOI":"10.3390\/agriengineering3030032","volume":"3","author":"AA Ahmed","year":"2021","unstructured":"Ahmed, A.A., Reddy, G.H.: A mobile-based system for detecting plant leaf diseases using deep learning. AgriEngineering 3(3), 478\u2013493 (2021)","journal-title":"AgriEngineering"},{"key":"597_CR5","doi-asserted-by":"publisher","first-page":"1010981","DOI":"10.3389\/fpls.2022.1010981","volume":"13","author":"M Xu","year":"2022","unstructured":"Xu, M., Yoon, S., Jeong, Y., Park, D.S.: Transfer learning for versatile plant disease recognition with limited data. Front. Plant Sci. 13, 1010981 (2022). https:\/\/doi.org\/10.3389\/fpls.2022.1010981","journal-title":"Front. Plant Sci."},{"key":"597_CR6","unstructured":"Simonyan K, Zisserman A: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)"},{"key":"597_CR7","doi-asserted-by":"crossref","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 770\u2013778","DOI":"10.1109\/CVPR.2016.90"},{"key":"597_CR8","doi-asserted-by":"crossref","unstructured":"Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Rabinovich A Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 1\u20139 (2015)","DOI":"10.1109\/CVPR.2015.7298594"},{"issue":"7","key":"597_CR9","doi-asserted-by":"publisher","first-page":"939","DOI":"10.3390\/sym11070939","volume":"11","author":"M Arsenovic","year":"2019","unstructured":"Arsenovic, M., Karanovic, M., Sladojevic, S., Anderla, A., Stefanovic, D.: Solving current limitations of deep learning based approaches for plant disease detection. Symmetry 11(7), 939 (2019)","journal-title":"Symmetry"},{"issue":"12","key":"597_CR10","doi-asserted-by":"publisher","first-page":"5586","DOI":"10.1109\/TKDE.2021.3071423","volume":"34","author":"Y Zhang","year":"2021","unstructured":"Zhang, Y., Yang, Q.: A survey on multi-task learning. IEEE Trans. Knowl. Data Eng. 34(12), 5586\u20135609 (2021). https:\/\/doi.org\/10.1109\/TKDE.2021.3071423","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"597_CR11","unstructured":"Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Houlsby N An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929 (2020)"},{"issue":"16","key":"597_CR12","doi-asserted-by":"publisher","first-page":"17573","DOI":"10.1109\/JSEN.2021.3085158","volume":"21","author":"R Dwivedi","year":"2021","unstructured":"Dwivedi, R., Dey, S., Chakraborty, C., Tiwari, S.: Grape disease detection network based on multi-task learning and attention features. IEEE Sens. J. 21(16), 17573\u201317580 (2021). https:\/\/doi.org\/10.1109\/JSEN.2021.3085158","journal-title":"IEEE Sens. J."},{"key":"597_CR13","doi-asserted-by":"crossref","unstructured":"Thakur PS, Khanna P, Sheorey T, Ojha A Vision transformer for plant disease detection: PlantViT. In: International Conference on Computer Vision and Image Processing, 501\u2013511. Cham: Springer International Publishing (2021, December)","DOI":"10.1007\/978-3-031-11346-8_43"},{"key":"597_CR14","doi-asserted-by":"publisher","first-page":"56683","DOI":"10.1109\/ACCESS.2021.3077026","volume":"9","author":"L Li","year":"2021","unstructured":"Li, L., Zhang, S., Wang, B.: Plant disease detection and classification by deep learning\u2014a review. IEEE Access 9, 56683\u201356698 (2021). https:\/\/doi.org\/10.1109\/ACCESS.2021.3077026","journal-title":"IEEE Access"},{"key":"597_CR15","doi-asserted-by":"publisher","first-page":"418","DOI":"10.1016\/j.compag.2016.07.003","volume":"127","author":"GL Grinblat","year":"2016","unstructured":"Grinblat, G.L., Uzal, L.C., Larese, M.G., Granitto, P.M.: Deep learning for plant identification using vein morphological patterns. Comput. Electron. Agric. 127, 418\u2013424 (2016). https:\/\/doi.org\/10.1016\/j.compag.2016.07.003","journal-title":"Comput. Electron. Agric."},{"key":"597_CR16","doi-asserted-by":"publisher","first-page":"1419","DOI":"10.3389\/fpls.2016.01419","volume":"7","author":"SP Mohanty","year":"2016","unstructured":"Mohanty, S.P., Hughes, D.P., Salath\u00e9, M.: Using deep learning for image-based plant disease detection. Front. Plant Sci. 7, 1419 (2016). https:\/\/doi.org\/10.3389\/fpls.2016.01419","journal-title":"Front. Plant Sci."},{"key":"597_CR17","doi-asserted-by":"crossref","unstructured":"Kawasaki Y, Uga H, Kagiwada S, Iyatomi H Basic study of automated diagnosis of viral plant diseases using convolutional neural networks. In: Advances in visual computing: 11th international symposium ISVC 2015 Las Vegas NV USA December 14\u201316 2015 Proceedings Part II 11, 638\u2013645. Springer International Publishing (2015)","DOI":"10.1007\/978-3-319-27863-6_59"},{"key":"597_CR18","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1016\/j.compag.2018.08.048","volume":"154","author":"J Ma","year":"2018","unstructured":"Ma, J., Du, K., Zheng, F., Zhang, L., Gong, Z., Sun, Z.: A recognition method for cucumber diseases using leaf symptom images based on deep convolutional neural network. Comput. Electron. Agric. 154, 18\u201324 (2018). https:\/\/doi.org\/10.1016\/j.compag.2018.08.048","journal-title":"Comput. Electron. Agric."},{"key":"597_CR19","doi-asserted-by":"crossref","unstructured":"Mukti IZ, Biswas D (2019) Transfer learning based plant diseases detection using ResNet50. In: 2019 4th International conference on electrical information and communication technology (EICT), 1\u20136. IEEE (2019, December)","DOI":"10.1109\/EICT48899.2019.9068805"},{"key":"597_CR20","doi-asserted-by":"publisher","DOI":"10.1016\/j.compag.2020.105393","volume":"173","author":"J Chen","year":"2020","unstructured":"Chen, J., Chen, J., Zhang, D., Sun, Y., Nanehkaran, Y.A.: Using deep transfer learning for image-based plant disease identification. Comput. Electron. Agric. 173, 105393 (2020). https:\/\/doi.org\/10.1016\/j.compag.2020.105393","journal-title":"Comput. Electron. Agric."},{"key":"597_CR21","doi-asserted-by":"publisher","DOI":"10.1016\/j.ecoinf.2022.101679","volume":"69","author":"AS Keceli","year":"2022","unstructured":"Keceli, A.S., Kaya, A., Catal, C., Tekinerdogan, B.: Deep learning-based multi-task prediction system for plant disease and species detection. Eco. Inform. 69, 101679 (2022). https:\/\/doi.org\/10.1016\/j.ecoinf.2022.101679","journal-title":"Eco. Inform."},{"key":"597_CR22","doi-asserted-by":"publisher","unstructured":"Lee SH, Go\u00ebau, H., Bonnet, P., & Joly, A.: Conditional multi-task learning for plant disease identification. In: 2020 25th international conference on pattern recognition (ICPR), 3320\u20133327. IEEE (2021, January). https:\/\/doi.org\/10.1109\/ICPR48806.2021.9412180","DOI":"10.1109\/ICPR48806.2021.9412180"},{"key":"597_CR23","doi-asserted-by":"publisher","unstructured":"Boukabouya RA, Moussaoui A, Berrimi M: Vision Transformer based models for plant disease detection and diagnosis. In: 2022 5th international symposium on informatics and its applications (ISIA), 1\u20136. IEEE (2022, November). https:\/\/doi.org\/10.1109\/ISIA.2022.9923797","DOI":"10.1109\/ISIA.2022.9923797"},{"key":"597_CR24","doi-asserted-by":"publisher","unstructured":"Thai HT, Tran-Van NY, Le KH Artificial cognition for early leaf disease detection using vision transformers. In: 2021 International conference on advanced technologies for communications (ATC), 33\u201338. IEEE (2021, October). https:\/\/doi.org\/10.1109\/ATC53345.2021.9631065","DOI":"10.1109\/ATC53345.2021.9631065"},{"key":"597_CR25","doi-asserted-by":"crossref","unstructured":"Thakur PS, Khanna P, Sheorey T, Ojha, A (2022) Explainable vision transformer enabled convolutional neural network for plant disease identification: PlantXViT. arXiv preprint arXiv:2207.07919","DOI":"10.1016\/j.ecoinf.2023.102245"},{"issue":"13","key":"597_CR26","doi-asserted-by":"publisher","first-page":"6015","DOI":"10.3390\/s23136015","volume":"23","author":"D Zhu","year":"2023","unstructured":"Zhu, D., Tan, J., Wu, C., Yung, K., Ip, A.W.: Crop disease identification by fusing multiscale convolution and vision transformer. Sensors 23(13), 6015 (2023). https:\/\/doi.org\/10.3390\/s23136015","journal-title":"Sensors"},{"issue":"6","key":"597_CR27","doi-asserted-by":"publisher","first-page":"884","DOI":"10.3390\/agriculture12060884","volume":"12","author":"X Li","year":"2022","unstructured":"Li, X., Li, S.: Transformer help CNN see better: a lightweight hybrid apple disease identification model based on transformers. Agriculture 12(6), 884 (2022). https:\/\/doi.org\/10.3390\/agriculture12060884","journal-title":"Agriculture"},{"issue":"6","key":"597_CR28","doi-asserted-by":"publisher","DOI":"10.1016\/j.jksuci.2023.01.014","volume":"35","author":"X Li","year":"2023","unstructured":"Li, X., Li, X., Zhang, S., Zhang, G., Zhang, M., Shang, H.: SLViT: Shuffle-convolution-based lightweight Vision transformer for effective diagnosis of sugarcane leaf diseases. J King Saud University-Comput Inform Sci 35(6), 101401 (2023). https:\/\/doi.org\/10.1016\/j.jksuci.2023.01.014","journal-title":"J King Saud University-Comput Inform Sci"},{"key":"597_CR29","doi-asserted-by":"publisher","unstructured":"Hu R, Singh A (2021) Unit: Multimodal multitask learning with a unified transformer. In: Proceedings of the IEEE\/CVF international conference on computer vision, 1439\u20131449. https:\/\/doi.org\/10.1109\/ICCV48922.2021.00146","DOI":"10.1109\/ICCV48922.2021.00146"},{"key":"597_CR30","doi-asserted-by":"publisher","unstructured":"Bhattacharjee D, Zhang T, S\u00fcsstrunk S, Salzmann M (2022) Mult: An end-to-end multitask learning transformer. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, 12031\u201312041 https:\/\/doi.org\/10.1109\/CVPR52688.2022.01173","DOI":"10.1109\/CVPR52688.2022.01173"},{"key":"597_CR31","doi-asserted-by":"publisher","unstructured":"Park S, Kim G, Oh Y, Seo JB, Lee SM, Kim JH, Ye JC (2022) Multi-task vision transformer using low-level chest X-ray feature corpus for COVID-19 diagnosis and severity quantification. Med Image Anal 75, 102299 (2022). https:\/\/doi.org\/10.1016\/j.media.2021.102299","DOI":"10.1016\/j.media.2021.102299"},{"key":"597_CR32","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2023.3278896","author":"Y Tian","year":"2023","unstructured":"Tian, Y., Bai, K.: End-to-end multitask learning with vision transformer. IEEE Trans Neural Netw Learn Syst (2023). https:\/\/doi.org\/10.1109\/TNNLS.2023.3278896","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"597_CR33","doi-asserted-by":"publisher","unstructured":"Goncalves DN, Junior JM, Zamboni P, Pistori H, Li J, Nogueira K, Goncalves WN (2023) MTLSegFormer: Multi-task learning with transformers for semantic segmentation in precision agriculture. In: Proceedings of the IEEE\/CVF conference on computer vision and pattern recognition, 6289\u20136297. https:\/\/doi.org\/10.1109\/CVPR52688.2023.01278","DOI":"10.1109\/CVPR52688.2023.01278"},{"key":"597_CR34","unstructured":"Plant Village Dataset: https:\/\/data.mendeley.com\/datasets\/tywbtsjrjv\/1 Accessed on 24 May 2023"},{"key":"597_CR35","doi-asserted-by":"publisher","unstructured":"Singh D, Jain N, Jain P, Kayal P, Kumawat S, Batra N (2020) PlantDoc: a dataset for visual plant disease detection. In: Proceedings of the 7th ACM IKDD CoDS and 25th COMAD, 249\u2013253 (2020). https:\/\/doi.org\/10.1145\/3380545.3380640","DOI":"10.1145\/3380545.3380640"},{"key":"597_CR36","doi-asserted-by":"publisher","unstructured":"Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D (2017) Grad-cam: visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE international conference on computer vision, 618\u2013626 (2017). https:\/\/doi.org\/10.1109\/ICCV.2017.74","DOI":"10.1109\/ICCV.2017.74"}],"container-title":["International Journal of Computational Intelligence Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-024-00597-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s44196-024-00597-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s44196-024-00597-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,18]],"date-time":"2024-07-18T06:05:26Z","timestamp":1721282726000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s44196-024-00597-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,18]]},"references-count":36,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["597"],"URL":"https:\/\/doi.org\/10.1007\/s44196-024-00597-3","relation":{},"ISSN":["1875-6883"],"issn-type":[{"value":"1875-6883","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,18]]},"assertion":[{"value":"25 April 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 July 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 July 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no conflicts of interest related to the research presented in this manuscript.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"The research is original and has not been submitted elsewhere. Ethical guidelines and data-sharing policies have been adhered to.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics Approval"}},{"value":"We confirm that the submission is original, and has not been published elsewhere, and all co-authors agree with the submission.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to Publish"}}],"article-number":"188"}}