{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T15:58:41Z","timestamp":1780502321961,"version":"3.54.1"},"reference-count":48,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2024,5,21]],"date-time":"2024-05-21T00:00:00Z","timestamp":1716249600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Center for Equitable Artificial Intelligence and Machine Learning Systems (CEAMLS), Morgan State University","award":["11202202"],"award-info":[{"award-number":["11202202"]}]},{"name":"Center for Equitable Artificial Intelligence and Machine Learning Systems (CEAMLS), Morgan State University","award":["1OT2OD032581"],"award-info":[{"award-number":["1OT2OD032581"]}]},{"name":"National Institutes of Health (NIH) Agreement","award":["11202202"],"award-info":[{"award-number":["11202202"]}]},{"name":"National Institutes of Health (NIH) Agreement","award":["1OT2OD032581"],"award-info":[{"award-number":["1OT2OD032581"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>The accurate classification of brain tumors is an important step for early intervention. Artificial intelligence (AI)-based diagnostic systems have been utilized in recent years to help automate the process and provide more objective and faster diagnosis. This work introduces an enhanced AI-based architecture for improved brain tumor classification. We introduce a hybrid architecture that integrates vision transformer (ViT) and deep neural networks to create an ensemble classifier, resulting in a more robust brain tumor classification framework. The analysis pipeline begins with preprocessing and data normalization, followed by extracting three types of MRI-derived information-rich features. The latter included higher-order texture and structural feature sets to harness the spatial interactions between image intensities, which were derived using Haralick features and local binary patterns. Additionally, local deeper features of the brain images are extracted using an optimized convolutional neural networks (CNN) architecture. Finally, ViT-derived features are also integrated due to their ability to handle dependencies across larger distances while being less sensitive to data augmentation. The extracted features are then weighted, fused, and fed to a machine learning classifier for the final classification of brain MRIs. The proposed weighted ensemble architecture has been evaluated on publicly available and locally collected brain MRIs of four classes using various metrics. The results showed that leveraging the benefits of individual components of the proposed architecture leads to improved performance using ablation studies.<\/jats:p>","DOI":"10.3390\/a17060221","type":"journal-article","created":{"date-parts":[[2024,5,21]],"date-time":"2024-05-21T03:26:27Z","timestamp":1716261987000},"page":"221","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["A Hybrid Learning-Architecture for Improved Brain Tumor Recognition"],"prefix":"10.3390","volume":"17","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-0304-1659","authenticated-orcid":false,"given":"Jose","family":"Dixon","sequence":"first","affiliation":[{"name":"Electrical and Computer Engineering Department, School of Engineering, Morgan State University, Baltimore, MD 21251, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-2744-5475","authenticated-orcid":false,"given":"Oluwatunmise","family":"Akinniyi","sequence":"additional","affiliation":[{"name":"Electrical and Computer Engineering Department, School of Engineering, Morgan State University, Baltimore, MD 21251, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8115-9480","authenticated-orcid":false,"given":"Abeer","family":"Abdelhamid","sequence":"additional","affiliation":[{"name":"Electronics and Communications Engineering Department, Mansoura University, Mansoura 35516, Egypt"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4817-4478","authenticated-orcid":false,"given":"Gehad A.","family":"Saleh","sequence":"additional","affiliation":[{"name":"Department of Diagnostic and Interventional Radiology, Faculty of Medicine, Mansoura University, Mansoura 35516, Egypt"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0405-9088","authenticated-orcid":false,"given":"Md Mahmudur","family":"Rahman","sequence":"additional","affiliation":[{"name":"Department of Computer Science, School of Computer, Mathematical and Natural Sciences, Morgan State University, Baltimore, MD 21251, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3318-2851","authenticated-orcid":false,"given":"Fahmi","family":"Khalifa","sequence":"additional","affiliation":[{"name":"Electrical and Computer Engineering Department, School of Engineering, Morgan State University, Baltimore, MD 21251, USA"},{"name":"Electronics and Communications Engineering Department, Mansoura University, Mansoura 35516, Egypt"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,5,21]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"iv1","DOI":"10.1093\/neuonc\/noaa200","article-title":"CBTRUS statistical report: Primary brain and other central nervous system tumors diagnosed in the United States in 2013\u20132017","volume":"22","author":"Ostrom","year":"2020","journal-title":"Neuro-Oncology"},{"key":"ref_2","unstructured":"Society, N.B.T. (2023, October 21). Brain Tumor Facts 2023. Available online: https:\/\/braintumor.org\/brain-tumors\/about-brain-tumors\/brain-tumor-facts\/."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"432","DOI":"10.1016\/S0140-6736(18)30990-5","article-title":"Primary brain tumours in adults","volume":"392","author":"Lapointe","year":"2018","journal-title":"Lancet"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1231","DOI":"10.1093\/neuonc\/noab106","article-title":"The 2021 WHO classification of tumors of the central nervous system: A summary","volume":"23","author":"Louis","year":"2021","journal-title":"Neuro-Oncology"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Bezdan, T., Zivkovic, M., Tuba, E., Strumberger, I., Bacanin, N., and Tuba, M. (2020, January 21\u201323). Glioma brain tumor grade classification from mri using convolutional neural networks designed by modified fa. Proceedings of the International Conference on Intelligent and Fuzzy Systems, Izmir, Turkey.","DOI":"10.1007\/978-3-030-51156-2_111"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"937","DOI":"10.1056\/NEJMra1810772","article-title":"Pituitary-tumor endocrinopathies","volume":"382","author":"Melmed","year":"2020","journal-title":"N. Engl. J. Med."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"397","DOI":"10.1093\/neuros\/nyx103","article-title":"Current clinical brain tumor imaging","volume":"81","author":"Mabray","year":"2017","journal-title":"Neurosurgery"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"874","DOI":"10.1016\/j.amjmed.2017.12.039","article-title":"Brain tumors","volume":"131","author":"Lee","year":"2018","journal-title":"Am. J. Med."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"9223","DOI":"10.1038\/s41598-020-65956-4","article-title":"Noninvasive diffusion magnetic resonance imaging of brain tumour cell size for the early detection of therapeutic response","volume":"10","author":"Roberts","year":"2020","journal-title":"Sci. Rep."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Cheng, J., Huang, W., Cao, S., Yang, R., Yang, W., Yun, Z., Wang, Z., and Feng, Q. (2015). Enhanced performance of brain tumor classification via tumor region augmentation and partition. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0144479"},{"key":"ref_11","first-page":"177","article-title":"Brain Tumor Detection and Classification Using Deep Learning Classifier on MRI Images","volume":"10","author":"Rathi","year":"2015","journal-title":"Res. J. Appl. Sci. Eng. Technol."},{"key":"ref_12","first-page":"7746","article-title":"A Hybrid Framework for Brain Tumor Classification using Grey Wolf Optimization and Multi-Class Support Vector Machine","volume":"8","author":"Kumar","year":"2019","journal-title":"Int. J. Recent Technol. Eng."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ismael, M.R., and Abdel-Qader, I. (2018, January 3\u20135). Brain tumor classification via statistical features and back-propagation neural network. Proceedings of the 2018 IEEE International Conference on Electro\/Information Technology (EIT), Rochester, MI, USA.","DOI":"10.1109\/EIT.2018.8500308"},{"key":"ref_14","first-page":"65","article-title":"Analysis of a novel MRI based brain tumour classification using probabilistic neural network (PNN)","volume":"4","author":"Abir","year":"2018","journal-title":"Int. J. Sci. Res. Sci. Eng. Technol."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Afshar, P., Plataniotis, K.N., and Mohammadi, A. (2019, January 12\u201317). Capsule networks for brain tumor classification based on MRI images and coarse tumor boundaries. Proceedings of the ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brighton, UK.","DOI":"10.1109\/ICASSP.2019.8683759"},{"key":"ref_16","unstructured":"Abiwinanda, N., Hanif, M., Hesaputra, S.T., Handayani, A., and Mengko, T.R. (2019). World Congress on Medical Physics and Biomedical Engineering 2018, Prague, Czech Republic, 3\u20138 June 2018, Springer."},{"key":"ref_17","unstructured":"Cheng, J. (2023, December 11). Figshare. Dataset. Available online: https:\/\/figshare.com\/articles\/dataset\/brain_tumor_dataset\/1512427\/5."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Deepak, S., and Ameer, P. (2019). Brain tumor classification using deep CNN features via transfer learning. Comput. Biol. Med., 111.","DOI":"10.1016\/j.compbiomed.2019.103345"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"17809","DOI":"10.1109\/ACCESS.2019.2892455","article-title":"Content-based brain tumor retrieval for MR images using transfer learning","volume":"7","author":"Swati","year":"2019","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"36266","DOI":"10.1109\/ACCESS.2019.2904145","article-title":"A hybrid feature extraction method with regularized extreme learning machine for brain tumor classification","volume":"7","author":"Gumaei","year":"2019","journal-title":"IEEE Access"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.bbe.2018.10.004","article-title":"Magnetic resonance imaging-based brain tumor grades classification and grading via convolutional neural networks and genetic algorithms","volume":"39","author":"Anaraki","year":"2019","journal-title":"Biocybern. Biomed. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"3007","DOI":"10.1007\/s40747-021-00321-0","article-title":"A decision support system for multimodal brain tumor classification using deep learning","volume":"8","author":"Sharif","year":"2021","journal-title":"Complex Intell. Syst."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"31709","DOI":"10.1007\/s11042-023-14828-w","article-title":"An enhanced deep learning method for multi-class brain tumor classification using deep transfer learning","volume":"82","author":"Asif","year":"2023","journal-title":"Multimed. Tools Appl."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e22956","DOI":"10.1002\/ima.22956","article-title":"MultiFeNet: Multi-scale feature scaling in deep neural network for the brain tumour classification in MRI images","volume":"34","author":"Agrawal","year":"2023","journal-title":"Int. J. Imaging Syst. Technol."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zulfiqar, F., Bajwa, U.I., and Mehmood, Y. (2023). Multi-class classification of brain tumor types from MR images using EfficientNets. Biomed. Signal Process. Control, 84.","DOI":"10.1016\/j.bspc.2023.104777"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Sahoo, S., Mishra, S., Panda, B., Bhoi, A.K., and Barsocchi, P. (2023). An Augmented Modulated Deep Learning Based Intelligent Predictive Model for Brain Tumor Detection Using GAN Ensemble. Sensors, 23.","DOI":"10.3390\/s23156930"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s13755-022-00203-w","article-title":"BTC-fCNN: Fast Convolution Neural Network for Multi-class Brain Tumor Classification","volume":"11","author":"Nasr","year":"2023","journal-title":"Health Inf. Sci. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"130584","DOI":"10.1109\/ACCESS.2023.3334434","article-title":"Brain Tumor Categorization and Retrieval Using Deep Brain Incep Res Architecture Based Reinforcement Learning Network","volume":"11","author":"Chaki","year":"2023","journal-title":"IEEE Access"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"121453","DOI":"10.1016\/j.eswa.2023.121453","article-title":"Crossover smell agent optimized multilayer perceptron for precise brain tumor classification on MRI images","volume":"238","author":"Arumugam","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"ref_30","unstructured":"Chaki, J., and Wozniak, M. (2023, December 11). Brain Tumor MRI Dataset. Available online: https:\/\/ieee-dataport.org\/documents\/brain-tumor-mri-dataset."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"5321","DOI":"10.1007\/s00521-022-06953-8","article-title":"Pooling in convolutional neural networks for medical image analysis: A survey and an empirical study","volume":"34","author":"Nirthika","year":"2022","journal-title":"Neural Comput. Appl."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"610","DOI":"10.1109\/TSMC.1973.4309314","article-title":"Textural features for image classification","volume":"6","author":"Haralick","year":"1973","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"67123","DOI":"10.1109\/ACCESS.2019.2918361","article-title":"Morphological arrhythmia automated diagnosis method using gray-level co-occurrence matrix enhanced convolutional neural network","volume":"7","author":"Sun","year":"2019","journal-title":"IEEE Access"},{"key":"ref_34","first-page":"1","article-title":"A robust brain MRI classification with GLCM features","volume":"37","author":"Jafarpour","year":"2012","journal-title":"Int. J. Comput. Appl."},{"key":"ref_35","first-page":"687","article-title":"Classifying benign and malignant mass using GLCM and GLRLM based texture features from mammogram","volume":"1","author":"Mohanty","year":"2011","journal-title":"Int. J. Eng. Res. Appl."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1016\/j.procs.2018.05.057","article-title":"Application of feature extraction and classification methods for histopathological image using GLCM, LBP, LBGLCM, GLRLM and SFTA","volume":"132","author":"Akdemir","year":"2018","journal-title":"Procedia Comput. Sci."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Park, B., Shin, T., Cho, J.S., Lim, J.H., and Park, K.J. (2023). Improving blueberry firmness classification with spectral and textural features of microstructures using hyperspectral microscope imaging and deep learning. Postharvest Biol. Technol., 195.","DOI":"10.1016\/j.postharvbio.2022.112154"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1177\/0278364904045481","article-title":"On the relationship between classical grid search and probabilistic roadmaps","volume":"23","author":"LaValle","year":"2004","journal-title":"Int. J. Robot. Res."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"117549","DOI":"10.1016\/j.eswa.2022.117549","article-title":"COVID-19 detection on Chest X-ray images: A comparison of CNN architectures and ensembles","volume":"204","author":"Breve","year":"2022","journal-title":"Expert Syst. Appl."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_41","unstructured":"Shreffler, J., and Huecker, M.R. (2024, January 10). Diagnostic Testing Accuracy: Sensitivity, Specificity, Predictive Values and Likelihood Ratios. Available online: https:\/\/europepmc.org\/article\/nbk\/nbk557491."},{"key":"ref_42","unstructured":"London, I.C. (2024, May 10). IXI Dataset. Available online: https:\/\/brain-development.org\/ixi-dataset\/."},{"key":"ref_43","first-page":"818","article-title":"Data from REMBRANDT","volume":"10","author":"Scarpace","year":"2015","journal-title":"Cancer Imaging Arch."},{"key":"ref_44","first-page":"1","article-title":"Radiology data from the cancer genome atlas glioblastoma multiforme [TCGA-GBM] collection","volume":"11","author":"Scarpace","year":"2016","journal-title":"Cancer Imaging Arch."},{"key":"ref_45","first-page":"1","article-title":"Radiology data from the cancer genome atlas low grade glioma [TCGA-LGG] collection","volume":"2","author":"Pedano","year":"2016","journal-title":"Cancer Imaging Arch."},{"key":"ref_46","unstructured":"Nickparvar, M. (2021). Brain Tumor MRI Dataset, Kaggle."},{"key":"ref_47","first-page":"539","article-title":"Brain MRI images for brain tumor detection","volume":"216","author":"Chakrabarty","year":"2019","journal-title":"J. Exp. Med."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Batool, A., and Byun, Y.C. (2024). Brain tumor detection with integrating traditional and computational intelligence approaches across diverse imaging modalities-Challenges and future directions. Comput. Biol. Med., 175.","DOI":"10.1016\/j.compbiomed.2024.108412"}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/17\/6\/221\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:45:29Z","timestamp":1760107529000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/17\/6\/221"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,21]]},"references-count":48,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["a17060221"],"URL":"https:\/\/doi.org\/10.3390\/a17060221","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,21]]}}}