{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,12]],"date-time":"2026-06-12T01:27:33Z","timestamp":1781227653315,"version":"3.54.1"},"reference-count":28,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2023,9,15]],"date-time":"2023-09-15T00:00:00Z","timestamp":1694736000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Deanship of Scientific Research, Najran University","award":["NU\/RG\/MRC\/12\/10"],"award-info":[{"award-number":["NU\/RG\/MRC\/12\/10"]}]},{"name":"Kingdom of Saudi Arabia","award":["NU\/RG\/MRC\/12\/10"],"award-info":[{"award-number":["NU\/RG\/MRC\/12\/10"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>This paper presents a comprehensive study on the classification of brain tumor images using five pre-trained vision transformer (ViT) models, namely R50-ViT-l16, ViT-l16, ViT-l32, ViT-b16, and ViT-b32, employing a fine-tuning approach. The objective of this study is to advance the state-of-the-art in brain tumor classification by harnessing the power of these advanced models. The dataset utilized for experimentation consists of a total of 4855 images in the training set and 857 images in the testing set, encompassing four distinct tumor classes. The performance evaluation of each model is conducted through an extensive analysis encompassing precision, recall, F1-score, accuracy, and confusion matrix metrics. Among the models assessed, ViT-b32 demonstrates exceptional performance, achieving a high accuracy of 98.24% in accurately classifying brain tumor images. Notably, the obtained results outperform existing methodologies, showcasing the efficacy of the proposed approach. The contributions of this research extend beyond conventional methods, as it not only employs cutting-edge ViT models but also surpasses the performance of existing approaches for brain tumor image classification. This study not only demonstrates the potential of ViT models in medical image analysis but also provides a benchmark for future research in the field of brain tumor classification.<\/jats:p>","DOI":"10.3390\/s23187913","type":"journal-article","created":{"date-parts":[[2023,9,17]],"date-time":"2023-09-17T23:57:46Z","timestamp":1694995066000},"page":"7913","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":60,"title":["Advancing Brain Tumor Classification through Fine-Tuned Vision Transformers: A Comparative Study of Pre-Trained Models"],"prefix":"10.3390","volume":"23","author":[{"given":"Abdullah A.","family":"Asiri","sequence":"first","affiliation":[{"name":"Radiological Sciences Department, College of Applied Medical Sciences, Najran University, Najran 61441, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0633-5587","authenticated-orcid":false,"given":"Ahmad","family":"Shaf","sequence":"additional","affiliation":[{"name":"Department of Computer Science, COMSATS University Islamabad Sahiwal Campus, Sahiwal 57000, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tariq","family":"Ali","sequence":"additional","affiliation":[{"name":"Department of Computer Science, COMSATS University Islamabad Sahiwal Campus, Sahiwal 57000, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Muhammad Ahmad","family":"Pasha","sequence":"additional","affiliation":[{"name":"Department of Computer Science, COMSATS University Islamabad Sahiwal Campus, Sahiwal 57000, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0580-3921","authenticated-orcid":false,"given":"Muhammad","family":"Aamir","sequence":"additional","affiliation":[{"name":"Department of Computer Science, COMSATS University Islamabad Sahiwal Campus, Sahiwal 57000, Pakistan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4161-6875","authenticated-orcid":false,"given":"Muhammad","family":"Irfan","sequence":"additional","affiliation":[{"name":"Electrical Engineering Department, College of Engineering, Najran University, Najran 61441, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Saeed","family":"Alqahtani","sequence":"additional","affiliation":[{"name":"Radiological Sciences Department, College of Applied Medical Sciences, Najran University, Najran 61441, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8285-6915","authenticated-orcid":false,"given":"Ahmad Joman","family":"Alghamdi","sequence":"additional","affiliation":[{"name":"Radiological Sciences Department, College of Applied Medical Sciences, Taif University, Taif 21944, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ali H.","family":"Alghamdi","sequence":"additional","affiliation":[{"name":"Department of Radiological Sciences, Faculty of Applied Medical Sciences, The University of Tabuk, Tabuk 47512, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5039-8094","authenticated-orcid":false,"given":"Abdullah Fahad A.","family":"Alshamrani","sequence":"additional","affiliation":[{"name":"Department of Diagnostic Radiology Technology, College of Applied Medical Sciences, Taibah University, Madinah 41477, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6597-5090","authenticated-orcid":false,"given":"Magbool","family":"Alelyani","sequence":"additional","affiliation":[{"name":"Department of Radiological Sciences, College of Applied Medical Science, King Khalid University, Abha 61421, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sultan","family":"Alamri","sequence":"additional","affiliation":[{"name":"Radiological Sciences Department, College of Applied Medical Sciences, Taif University, Taif 21944, Saudi Arabia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,9,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"107960","DOI":"10.1016\/j.compeleceng.2022.107960","article-title":"A brain tumor identification and classification using deep learning based on CNN-LSTM method","volume":"101","author":"Vankdothu","year":"2022","journal-title":"Comput. Electr. Eng."},{"key":"ref_2","first-page":"3983","article-title":"A Novel Inherited Modeling Structure of Automatic Brain Tumor Segmentation from MRI","volume":"73","author":"Asiri","year":"2022","journal-title":"Comput. Mater. Contin."},{"key":"ref_3","unstructured":"Rosa, S.L., and Uccella, S. (2018). Reference Module in Biomedical Sciences, Elsevier."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Asiri, A.A., Shaf, A., Ali, T., Aamir, M., Irfan, M., Alqahtani, S., Mehdar, K.M., Halawani, H.T., Alghamdi, A.H., and Alshamrani, A.F.A. (2023). Brain tumor detection and classification using fine-tuned CNN with ResNet50 and U-Net model: A study on TCGA-LGG and TCIA dataset for MRI applications. Life, 13.","DOI":"10.3390\/life13071449"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Hossain, S., Chakrabarty, A., Gadekallu, T.R., Alazab, M., and Piran, M.J. (2023). ViTs, ensemble model, and transfer learning leveraging Explainable AI for brain tumor detection and classification. IEEE J. Biomed. Health Inform.","DOI":"10.1109\/JBHI.2023.3266614"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Asif, S., Wenhui, Y., Jinhai, S., Ain, Q.U., Yueyang, Y., and Jin, H. (2022, January 6\u20138). Modeling a fine-tuned deep convolutional neural network for diagnosis of kidney diseases from CT images. Proceedings of the 2022 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Las Vegas, NV, USA.","DOI":"10.1109\/BIBM55620.2022.9995615"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"7498","DOI":"10.3390\/curroncol29100590","article-title":"Classification of brain tumor from magnetic resonance imaging using ViTs ensembling","volume":"29","author":"Tummala","year":"2022","journal-title":"Curr. Oncol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"541663","DOI":"10.3389\/fonc.2020.541663","article-title":"Influence of magnetic field strength on magnetic resonance imaging radiomics features in brain imaging, an in vitro and in vivo study","volume":"10","author":"Ammari","year":"2021","journal-title":"Front. Oncol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2432","DOI":"10.1200\/JCO.2017.72.7636","article-title":"Brain tumor imaging","volume":"35","author":"Brindle","year":"2017","journal-title":"J. Clin. Oncol."},{"key":"ref_10","unstructured":"Salmon, E., Ir, C.B., and Hustinx, R. (2015). Seminars in Nuclear Medicine, Elsevier."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1186\/s12938-022-01022-6","article-title":"Feature extraction from MRI ADC images for brain tumor classification using machine learning techniques","volume":"21","author":"Vijithananda","year":"2022","journal-title":"Biomed. Eng. Online"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/j.compmedimag.2019.05.001","article-title":"Brain tumor classification for MR images using transfer learning and fine-tuning","volume":"75","author":"Swati","year":"2019","journal-title":"Comput. Med. Imaging Graph."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1007\/s10916-019-1416-0","article-title":"Brain tumor segmentation using convolutional neural networks in MRI images","volume":"43","author":"Thaha","year":"2019","journal-title":"J. Med. Syst."},{"key":"ref_14","first-page":"1","article-title":"Brain tumor detection and classification by MRI using biologically inspired orthogonal wavelet transform and deep learning techniques","volume":"2022","author":"Arif","year":"2022","journal-title":"J. Healthc. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Jia, Q., and Shu, H. (2021, January 27). Bitr-unet: A cnn-transformer combined network for mri brain tumor segmentation. Proceedings of the Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries: 7th International Workshop, BrainLes 2021, Held in Conjunction with MICCAI 2021, Virtual Event. Part II.","DOI":"10.1007\/978-3-031-09002-8_1"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Kim, S., S\u00fcsstrunk, S., and Salzmann, M. (2020). Volumetric Transformer Networks. arXiv.","DOI":"10.1007\/978-3-030-58604-1_34"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"5543","DOI":"10.1007\/s00521-020-05332-5","article-title":"Multiscale-based multimodal image classification of brain tumor using deep learning method","volume":"33","author":"Rajasree","year":"2021","journal-title":"Neural Comput. Appl."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"3161","DOI":"10.1007\/s40747-021-00563-y","article-title":"Brain tumor detection and classification using machine learning: A comprehensive survey","volume":"8","author":"Amin","year":"2022","journal-title":"Complex Intell. Syst."},{"key":"ref_19","unstructured":"Vaswani, A. (2017). Attention is all you need. Adv. Neural Inf. Process. Syst., 30."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1001","DOI":"10.1007\/s40747-022-00815-5","article-title":"Deep learning based brain tumor segmentation: A survey","volume":"9","author":"Liu","year":"2023","journal-title":"Complex Intell. Syst."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"89281","DOI":"10.1109\/ACCESS.2020.2993618","article-title":"Convolutional neural network based on complex networks for brain tumor image classification with a modified activation function","volume":"8","author":"Huang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_22","first-page":"5735","article-title":"Block-Wise Neural Network for Brain Tumor Identification in Magnetic Resonance Images","volume":"73","author":"Asiri","year":"2022","journal-title":"Comput. Mater. Contin."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"973","DOI":"10.1007\/s10278-023-00789-x","article-title":"PatchResNet: Multiple patch division-based deep feature fusion framework for brain tumor classification using MRI images","volume":"36","author":"Muezzinoglu","year":"2023","journal-title":"J. Digit. Imaging"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Aggarwal, M., Tiwari, A.K., Sarathi, M.P., and Bijalwan, A. (2023). An early detection and segmentation of Brain Tumor using Deep Neural Network. BMC Med. Inform. Decis. Mak., 23.","DOI":"10.1186\/s12911-023-02174-8"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"127","DOI":"10.32604\/iasc.2023.032391","article-title":"Multi-Level Deep Generative Adversarial Networks for Brain Tumor Classification on Magnetic Resonance Images","volume":"36","author":"Asiri","year":"2023","journal-title":"Intell. Autom. Soft Comput."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"36266","DOI":"10.1109\/ACCESS.2019.2904145","article-title":"A hybrid feature extraction method with regularized extreme learning machine for brain tumor classification","volume":"7","author":"Gumaei","year":"2019","journal-title":"IEEE Access"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Asiri, A.A., Shaf, A., Ali, T., Shakeel, U., Irfan, M., Mehdar, K.M., Halawani, H.T., Alghamdi, A.H., Alshamrani, A.F.A., and Alqhtani, S.M. (2023). Exploring the power of deep learning: Fine-tuned ViT for accurate and efficient brain tumor detection in MRI scans. Diagnostics, 13.","DOI":"10.3390\/diagnostics13122094"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1007\/s11517-020-02290-x","article-title":"Tumor type detection in brain MR images of the deep model developed using hypercolumn technique, attention modules, and residual blocks","volume":"59","author":"Ergen","year":"2021","journal-title":"Med. Biol. Eng. Comput."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/18\/7913\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:51:46Z","timestamp":1760129506000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/18\/7913"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,15]]},"references-count":28,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2023,9]]}},"alternative-id":["s23187913"],"URL":"https:\/\/doi.org\/10.3390\/s23187913","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,15]]}}}