{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,20]],"date-time":"2026-06-20T16:36:46Z","timestamp":1781973406027,"version":"3.54.5"},"reference-count":44,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,11,26]],"date-time":"2024-11-26T00:00:00Z","timestamp":1732579200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neuroinform."],"abstract":"<jats:p>Brain tumor classification is a critical task in medical imaging, as accurate diagnosis directly influences treatment planning and patient outcomes. Traditional methods often fall short in achieving the required precision due to the complex and heterogeneous nature of brain tumors. In this study, we propose an innovative approach to brain tumor multi-classification by leveraging an ensemble learning method that combines advanced deep learning models with an optimal weighting strategy. Our methodology integrates Vision Transformers (ViT) and EfficientNet-V2 models, both renowned for their powerful feature extraction capabilities in medical imaging. This model enhances the feature extraction step by capturing both global and local features, thanks to the combination of different deep learning models with the ViT model. These models are then combined using a weighted ensemble approach, where each model's prediction is assigned a weight. To optimize these weights, we employ a genetic algorithm, which iteratively selects the best weight combinations to maximize classification accuracy. We trained and validated our ensemble model using a well-curated dataset comprising labeled brain MRI images. The model's performance was benchmarked against standalone ViT and EfficientNet-V2 models, as well as other traditional classifiers. The ensemble approach achieved a notable improvement in classification accuracy, precision, recall, and F1-score compared to individual models. Specifically, our model attained an accuracy rate of 95%, significantly outperforming existing methods. This study underscores the potential of combining advanced deep learning models with a genetic algorithm-optimized weighting strategy to tackle complex medical classification tasks. The enhanced diagnostic precision offered by our ensemble model can lead to better-informed clinical decisions, ultimately improving patient outcomes. Furthermore, our approach can be generalized to other medical imaging classification problems, paving the way for broader applications of AI in healthcare. This advancement in brain tumor classification contributes valuable insights to the field of medical AI, supporting the ongoing efforts to integrate advanced computational tools in clinical practice.<\/jats:p>","DOI":"10.3389\/fninf.2024.1444650","type":"journal-article","created":{"date-parts":[[2024,11,26]],"date-time":"2024-11-26T06:28:57Z","timestamp":1732602537000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":34,"title":["Enhanced brain tumor diagnosis using combined deep learning models and weight selection technique"],"prefix":"10.3389","volume":"18","author":[{"given":"Karim","family":"Gasmi","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Najib","family":"Ben Aoun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Khalaf","family":"Alsalem","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ibtihel Ben","family":"Ltaifa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ibrahim","family":"Alrashdi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lassaad Ben","family":"Ammar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Manel","family":"Mrabet","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Abdulaziz","family":"Shehab","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,11,26]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"352","DOI":"10.3390\/brainsci11030352","article-title":"Differential deep convolutional neural network model for brain tumor classification","volume":"11","author":"Abd El Kader","year":"2021","journal-title":"Brain Sci"},{"key":"B2","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1007\/978-981-10-9035-6_33","article-title":"\u201cBrain tumor classification using convolutional neural network,\u201d","volume-title":"World Congress on Medical Physics and Biomedical Engineering 2018: June 3\u20138, 2018, Prague, Czech Republic","author":"Abiwinanda","year":"2019"},{"key":"B3","unstructured":"Numerical simulation and development of brain tumor segmentation and classification of brain tumor using improved support vector machine\n          \n          35\n          44\n          \n            \n              Ansari\n              A. S.\n            \n          \n          Int. J. Intell. Syst. Applic. Eng\n          11\n          2023"},{"key":"B4","doi-asserted-by":"publisher","first-page":"31709","DOI":"10.1007\/s11042-023-14828-w","article-title":"An enhanced deep learning method for multi-class brain tumor classification using deep transfer learning","volume":"82","author":"Asif","year":"2023","journal-title":"Multimed. Tools Appl"},{"key":"B5","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1016\/j.media.2007.06.004","article-title":"Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain","volume":"12","author":"Avants","year":"2008","journal-title":"Med. Image Anal"},{"key":"B6","first-page":"3882","article-title":"\u201cAccurate automatic glioma segmentation in brain mri images based on capsnet,\u201d","volume-title":"2021 43rd Annual International Conference of the IEEE Engineering in Medicine &Biology Society (EMBC)","author":"Aziz","year":"2021"},{"key":"B7","doi-asserted-by":"publisher","first-page":"4577","DOI":"10.15837\/ijccc.2023.1.4577","article-title":"Optimized CNN-based brain tumor segmentation and classification using artificial bee colony and thresholding","volume":"18","author":"Babu","year":"2023","journal-title":"Int. J. Comput. Commun. Control"},{"key":"B8","doi-asserted-by":"publisher","first-page":"9069","DOI":"10.1007\/s00521-022-06929-8","article-title":"An improved hybrid classification of brain tumor mri images based on conglomeration feature extraction techniques","volume":"34","author":"Bansal","year":"2022","journal-title":"Neur. Comput. Appl"},{"key":"B9","first-page":"213","article-title":"\u201cEnd-to-end object detection with transformers,\u201d","volume-title":"European Conference on Computer Vision","author":"Carion","year":"2020"},{"key":"B10","doi-asserted-by":"publisher","first-page":"1384","DOI":"10.3390\/diagnostics11081384","article-title":"Transmed: transformers advance multi-modal medical image classification","volume":"11","author":"Dai","year":"2021","journal-title":"Diagnostics"},{"key":"B11","doi-asserted-by":"publisher","first-page":"8357","DOI":"10.1007\/s12652-020-02568-w","article-title":"Automated categorization of brain tumor from mri using cnn features and SVM","volume":"12","author":"Deepak","year":"2021","journal-title":"J. Ambient Intell. Humaniz. Comput"},{"key":"B12","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1007\/978-981-13-5934-7_15","article-title":"\u201cMachine learning based approach for detection of lung cancer in dicom ct image,\u201d","volume-title":"Ambient Communications and Computer Systems","author":"Dev","year":"2019"},{"key":"B13","article-title":"An image is worth 16x16 words: transformers for image recognition at scale","author":"Dosovitskiy","year":"2020","journal-title":"arXiv preprint arXiv:2010.11929"},{"key":"B14","article-title":"An image is worth 16x16 words: Transformers for image recognition at scale","author":"Dosovitskiy","year":"2021","journal-title":"arXiv preprint arXiv:2010.11929"},{"key":"B15","doi-asserted-by":"publisher","first-page":"64754","DOI":"10.1109\/ACCESS.2024.3395803","article-title":"Optimal ensemble learning model for dyslexia prediction based on an adaptive genetic algorithm","volume":"12","author":"Gasmi","year":"2024","journal-title":"IEEE Access"},{"key":"B16","doi-asserted-by":"publisher","first-page":"22560","DOI":"10.1109\/ACCESS.2020.2969805","article-title":"Enlarged training dataset by pairwise gans for molecular-based brain tumor classification","volume":"8","author":"Ge","year":"2020","journal-title":"IEEE Access"},{"key":"B17","first-page":"272","article-title":"\u201cSwin unetr: Swin transformers for semantic segmentation of brain tumors in MRI images,\u201d","volume-title":"International MICCAI Brainlesion Workshop","author":"Hatamizadeh","year":"2021"},{"key":"B18","first-page":"2","article-title":"Learning and relearning in boltzmann machines","volume":"1","author":"Hinton","year":"1986","journal-title":"Parallel Distr. Proc"},{"key":"B19","doi-asserted-by":"publisher","first-page":"111981","DOI":"10.1016\/j.knosys.2024.111981","article-title":"Improving brain tumor classification with combined convolutional neural networks and transfer learning","volume":"299","author":"\u0130ncir","year":"","journal-title":"Knowl.-Based Syst"},{"key":"B20","doi-asserted-by":"publisher","first-page":"12185","DOI":"10.1007\/s11042-023-15754-7","article-title":"A study on effective data preprocessing and augmentation method in diabetic retinopathy classification using pre-trained deep learning approaches","volume":"83","author":"\u0130ncir","year":"","journal-title":"Multimed. Tools Appl"},{"key":"B21","first-page":"1","article-title":"\u201cA study on the segmentation and classification of diabetic retinopathy images using the k-means clustering method,\u201d","volume-title":"2024 32nd Signal Processing and Communications Applications Conference (SIU)","author":"\u0130ncir","year":""},{"key":"B22","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1007\/s00138-021-01262-x","article-title":"An empirical study of different machine learning techniques for brain tumor classification and subsequent segmentation using hybrid texture feature","volume":"33","author":"Jena","year":"2022","journal-title":"Mach. Vis. Appl"},{"key":"B23","doi-asserted-by":"publisher","first-page":"2222","DOI":"10.3390\/s21062222","article-title":"Mri-based brain tumor classification using ensemble of deep features and machine learning classifiers","volume":"21","author":"Kang","year":"2021","journal-title":"Sensors"},{"key":"B24","doi-asserted-by":"publisher","first-page":"178","DOI":"10.1016\/j.neucom.2018.09.043","article-title":"Segmentation of breast anatomy for automated whole breast ultrasound images with boundary regularized convolutional encoder-decoder network","volume":"321","author":"Lei","year":"2018","journal-title":"Neurocomputing"},{"key":"B25","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1109\/IIC.2015.7150592","article-title":"\u201cMRI brain cancer classification using hybrid classifier (SVM-KNN),\u201d","volume-title":"2015 International Conference on Industrial Instrumentation and Control (ICIC)","author":"Machhale","year":"2015"},{"key":"B26","doi-asserted-by":"publisher","first-page":"1240","DOI":"10.1109\/TMI.2016.2538465","article-title":"Brain tumor segmentation using convolutional neural networks in mri images","volume":"35","author":"Pereira","year":"2016","journal-title":"IEEE Trans. Med. Imaging"},{"key":"B27","first-page":"12116","article-title":"\u201cDo vision transformers see like convolutional neural networks?\u201d","author":"Raghu","year":"2021","journal-title":"Advances in Neural Information Processing Systems"},{"key":"B28","doi-asserted-by":"crossref","first-page":"654","DOI":"10.1109\/ICIP.2019.8804467","article-title":"\u201cRotation invariant cnn using scattering transform for image classification,\u201d","volume-title":"2019 IEEE International Conference on Image Processing (ICIP)","author":"Rodriguez","year":"2019"},{"key":"B29","doi-asserted-by":"publisher","first-page":"174","DOI":"10.1016\/j.jocs.2018.12.003","article-title":"Multi-grade brain tumor classification using deep CNN with extensive data augmentation","volume":"30","author":"Sajjad","year":"2019","journal-title":"J. Comput. Sci"},{"key":"B30","doi-asserted-by":"publisher","first-page":"105778","DOI":"10.1016\/j.bspc.2023.105778","article-title":"Deep learning and optimized learning machine for brain tumor classification","volume":"89","author":"Sandhiya","year":"2024","journal-title":"Biomed. Signal Process. Control"},{"key":"B31","doi-asserted-by":"publisher","first-page":"983","DOI":"10.1109\/JBHI.2021.3100758","article-title":"Brain tumor classification using fine-tuned googlenet features and machine learning algorithms: IOMT enabled cad system","volume":"26","author":"Sekhar","year":"2021","journal-title":"IEEE J. Biomed. Health Inform"},{"key":"B32","doi-asserted-by":"publisher","first-page":"2023","DOI":"10.1007\/s40747-021-00310-3","article-title":"An improved framework for brain tumor analysis using MRI based on yolov2 and convolutional neural network","volume":"7","author":"Sharif","year":"2021","journal-title":"Complex Intell. Syst"},{"key":"B33","article-title":"How to train your VIT? Data, augmentation, and regularization in vision transformers","author":"Steiner","year":"2021","journal-title":"arXiv preprint arXiv:2106.10270"},{"key":"B34","article-title":"Explainable cost-sensitive deep neural networks for brain tumor detection from brain MRI images considering data imbalance","author":"Tanvir Rouf Shawon","year":"2023","journal-title":"arXiv e-prints arXiv-2308"},{"key":"B35","first-page":"020023","article-title":"\u201cMRI image processing method on brain tumors: a review,\u201d","volume-title":"AIP Conference Proceedings","author":"Tomasila","year":"2020"},{"key":"B36","doi-asserted-by":"publisher","first-page":"107960","DOI":"10.1016\/j.compeleceng.2022.107960","article-title":"A brain tumor identification and classification using deep learning based on CNN-LSTM method","volume":"101","author":"Vankdothu","year":"2022","journal-title":"Comput. Electr. Eng"},{"key":"B37","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1007\/s40708-017-0075-5","article-title":"Identification and classification of brain tumor mri images with feature extraction using dwt and probabilistic neural network","volume":"5","author":"Varuna Shree","year":"2018","journal-title":"Brain Infor"},{"key":"B38","article-title":"\u201cAttention is all you need,\u201d","author":"Vaswani","year":"2017","journal-title":"Advances in Neural Information Processing Systems"},{"key":"B39","first-page":"109","article-title":"\u201cTransbts: multimodal brain tumor segmentation using transformer,\u201d","volume-title":"International Conference on Medical Image Computing and Computer-Assisted Intervention","author":"Wenxuan","year":"2021"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.1109\/ICINPRO43533.2018.9096860","article-title":"\u201cWavelet pooling for convolutional neural networks,\u201d","author":"Williams","year":"2018","journal-title":"International Conference on Learning Representations"},{"key":"B41","first-page":"1","article-title":"Brain tumor segmentation using fuzzy OTSU threshold morphological algorithm","volume":"53","author":"Wisaeng","year":"2023","journal-title":"IAENG Int. J. Appl. Mathem"},{"key":"B42","first-page":"45","article-title":"\u201cMil-vt: multiple instance learning enhanced vision transformer for fundus image classification,\u201d","volume-title":"International Conference on Medical Image Computing and Computer-Assisted Intervention","author":"Yu","year":"2021"},{"key":"B43","doi-asserted-by":"publisher","first-page":"1609","DOI":"10.1002\/mrm.22147","article-title":"Classification of brain tumor type and grade using mri texture and shape in a machine learning scheme","volume":"62","author":"Zacharaki","year":"2009","journal-title":"Magn. Reson. Med"},{"key":"B44","doi-asserted-by":"publisher","first-page":"1465173","DOI":"10.1155\/2022\/1465173","article-title":"Brainnet: optimal deep learning feature fusion for brain tumor classification","volume":"2022","author":"Zahid","year":"2022","journal-title":"Comput. Intell. Neurosci"}],"container-title":["Frontiers in Neuroinformatics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fninf.2024.1444650\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,11,26]],"date-time":"2024-11-26T06:29:06Z","timestamp":1732602546000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fninf.2024.1444650\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,11,26]]},"references-count":44,"alternative-id":["10.3389\/fninf.2024.1444650"],"URL":"https:\/\/doi.org\/10.3389\/fninf.2024.1444650","relation":{},"ISSN":["1662-5196"],"issn-type":[{"value":"1662-5196","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,11,26]]},"article-number":"1444650"}}