{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T19:32:40Z","timestamp":1793129560672,"version":"4.5.0"},"reference-count":43,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2024,6,14]],"date-time":"2024-06-14T00:00:00Z","timestamp":1718323200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Cancers"],"abstract":"<jats:p>Cancer diagnosis and classification are pivotal for effective patient management and treatment planning. In this study, a comprehensive approach is presented utilizing ensemble deep learning techniques to analyze breast cancer histopathology images. Our datasets were based on two widely employed datasets from different centers for two different tasks: BACH and BreakHis. Within the BACH dataset, a proposed ensemble strategy was employed, incorporating VGG16 and ResNet50 architectures to achieve precise classification of breast cancer histopathology images. Introducing a novel image patching technique to preprocess a high-resolution image facilitated a focused analysis of localized regions of interest. The annotated BACH dataset encompassed 400 WSIs across four distinct classes: Normal, Benign, In Situ Carcinoma, and Invasive Carcinoma. In addition, the proposed ensemble was used on the BreakHis dataset, utilizing VGG16, ResNet34, and ResNet50 models to classify microscopic images into eight distinct categories (four benign and four malignant). For both datasets, a five-fold cross-validation approach was employed for rigorous training and testing. Preliminary experimental results indicated a patch classification accuracy of 95.31% (for the BACH dataset) and WSI image classification accuracy of 98.43% (BreakHis). This research significantly contributes to ongoing endeavors in harnessing artificial intelligence to advance breast cancer diagnosis, potentially fostering improved patient outcomes and alleviating healthcare burdens.<\/jats:p>","DOI":"10.3390\/cancers16122222","type":"journal-article","created":{"date-parts":[[2024,6,14]],"date-time":"2024-06-14T08:02:26Z","timestamp":1718352146000},"page":"2222","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":89,"title":["Ensemble Deep Learning-Based Image Classification for Breast Cancer Subtype and Invasiveness Diagnosis from Whole Slide Image Histopathology"],"prefix":"10.3390","volume":"16","author":[{"given":"Aadhi Aadhavan","family":"Balasubramanian","sequence":"first","affiliation":[{"name":"Khoury College of Computer Sciences, Northeastern University, Boston, MA 02115, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1949-6715","authenticated-orcid":false,"given":"Salah Mohammed Awad","family":"Al-Heejawi","sequence":"additional","affiliation":[{"name":"College of Engineering, Northeastern University, Boston, MA 02115, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4735-3343","authenticated-orcid":false,"given":"Akarsh","family":"Singh","sequence":"additional","affiliation":[{"name":"College of Engineering, Northeastern University, Boston, MA 02115, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anne","family":"Breggia","sequence":"additional","affiliation":[{"name":"MaineHealth Institute for Research, Scarborough, ME 04074, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bilal","family":"Ahmad","sequence":"additional","affiliation":[{"name":"Maine Medical Center, Portland, ME 04102, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert","family":"Christman","sequence":"additional","affiliation":[{"name":"Maine Medical Center, Portland, ME 04102, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephen T.","family":"Ryan","sequence":"additional","affiliation":[{"name":"Maine Medical Center, Portland, ME 04102, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8703-6986","authenticated-orcid":false,"given":"Saeed","family":"Amal","sequence":"additional","affiliation":[{"name":"The Roux Institute, Department of Bioengineering, College of Engineering, Northeastern University, Boston, MA 02115, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,6,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"17","DOI":"10.3322\/caac.21763","article-title":"Cancer statistics, 2023","volume":"73","author":"Siegel","year":"2023","journal-title":"CA Cancer J. Clin."},{"key":"ref_2","unstructured":"American Cancer Society (2024). Cancer Facts & Figures 2024, American Cancer Society."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1002\/jmri.27409","article-title":"Histological validation of MRI: A review of challenges in registration of imaging and whole-mount histopathology","volume":"55","author":"Alyami","year":"2022","journal-title":"J. Magn. Reson. Imaging"},{"key":"ref_4","unstructured":"\u00c7inar, U. (2023). Integrating Hyperspectral Imaging and Microscopy for Hepatocellular Carcinoma Detection from H&E Stained Histopathology Images. [Ph.D. Thesis, Middle East Technical University]."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1837","DOI":"10.1109\/JBHI.2020.2991043","article-title":"AI in medical imaging informatics: Current challenges and future directions","volume":"24","author":"Panayides","year":"2020","journal-title":"IEEE J. Biomed. Health Inform."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Brancati, N., Frucci, M., and Riccio, D. (2018, January 27\u201329). Multi-classification of breast cancer histology images by using a fine-tuning strategy. Proceedings of the Image Analysis and Recognition: 15th International Conference, ICIAR 2018, P\u00f3voa de Varzim, Portugal.","DOI":"10.1007\/978-3-319-93000-8_87"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"122","DOI":"10.1016\/j.media.2019.05.010","article-title":"BACH: Grand challenge on breast cancer histology images","volume":"56","author":"Aresta","year":"2019","journal-title":"Med. Image Anal."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Chennamsetty, S.S., Safwan, M., and Alex, V. (2018, January 27\u201329). Classification of breast cancer histology image using ensemble of pre-trained neural networks. Proceedings of the Image Analysis and Recognition: 15th International Conference, ICIAR 2018, P\u00f3voa de Varzim, Portugal.","DOI":"10.1007\/978-3-319-93000-8_91"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12911-019-0913-x","article-title":"Breast cancer histopathology image classification through assembling multiple compact CNNs","volume":"19","author":"Zhu","year":"2019","journal-title":"BMC Med. Inform. Decis. Mak."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1455","DOI":"10.1109\/TBME.2015.2496264","article-title":"A dataset for breast cancer histopathological image classification","volume":"63","author":"Spanhol","year":"2015","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_13","unstructured":"Wang, Y., Sun, L., Ma, K., and Fang, J. (2018, January 27\u201329). Breast cancer microscope image classification based on CNN with image deformation. Proceedings of the Image Analysis and Recognition: 15th International Conference, ICIAR 2018, P\u00f3voa de Varzim, Portugal."},{"key":"ref_14","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.ymeth.2019.06.014","article-title":"Breast cancer histopathological image classification using a hybrid deep neural network","volume":"173","author":"Yan","year":"2020","journal-title":"Methods"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Bagchi, A., Pramanik, P., and Sarkar, R. (2022). A multi-stage approach to breast cancer classification using histopathology images. Diagnostics, 13.","DOI":"10.2139\/ssrn.4065219"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"8904768","DOI":"10.1155\/2022\/8904768","article-title":"Classification of breast cancer histopathological images using DenseNet and transfer learning","volume":"2022","author":"Wakili","year":"2022","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"123592","DOI":"10.1016\/j.physa.2019.123592","article-title":"BreastNet: A novel convolutional neural network model through histopathological images for the diagnosis of breast cancer","volume":"545","author":"Ergen","year":"2020","journal-title":"Phys. A Stat. Mech. Its Appl."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"155362","DOI":"10.1109\/ACCESS.2020.3019327","article-title":"Classification of breast cancer histopathological images using discriminative patches screened by generative adversarial networks","volume":"8","author":"Man","year":"2020","journal-title":"IEEE Access"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Boumaraf, S., Liu, X., Zheng, Z., Ma, X., and Ferkous, C. (2021). A new transfer learning based approach to magnification dependent and independent classification of breast cancer in histopathological images. Biomed. Signal Process. Control., 63.","DOI":"10.1016\/j.bspc.2020.102192"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Soumik, M.F.I., Aziz, A.Z.B., and Hossain, M.A. (2021, January 8\u20139). Improved transfer learning based deep learning model for breast cancer histopathological image classification. Proceedings of the 2021 International Conference on Automation, Control and Mechatronics for Industry 4.0 (ACMI), Rajshahi, Bangladesh.","DOI":"10.1109\/ACMI53878.2021.9528263"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Liu, M., He, Y., Wu, M., and Zeng, C. (2022). Breast histopathological image classification method based on autoencoder and siamese framework. Information, 13.","DOI":"10.3390\/info13030107"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Chattopadhyay, S., Dey, A., Singh, P.K., and Sarkar, R. (2022). DRDA-Net: Dense residual dual-shuffle attention network for breast cancer classification using histopathological images. Comput. Biol. Med., 145.","DOI":"10.1016\/j.compbiomed.2022.105437"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Kon\u00e9, I., and Boulmane, L. (2018, January 27\u201329). Hierarchical ResNeXt models for breast cancer histology image classification. Proceedings of the Image Analysis and Recognition: 15th International Conference, ICIAR 2018, P\u00f3voa de Varzim, Portugal.","DOI":"10.1007\/978-3-319-93000-8_90"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"155","DOI":"10.32996\/jcsts.2024.6.1.16","article-title":"Transforming Breast Cancer Identification: An In-Depth Examination of Advanced Machine Learning Models Applied to Histopathological Images","volume":"6","author":"Ray","year":"2024","journal-title":"J. Comput. Sci. Technol. Stud."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1016\/j.bbe.2023.12.003","article-title":"A hybrid lightweight breast cancer classification framework using the histopathological images","volume":"44","author":"Addo","year":"2024","journal-title":"Biocybern. Biomed. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Sahran, S., Qasem, A., Omar, K., Albashih, D., Adam, A., Abdullah, S.N.H.S., Abdullah, A., Hussain, R.I., Ismail, F., and Abdullah, N. (2018). Machine learning methods for breast cancer diagnostic. Breast Cancer Surgery, IntechOpen.","DOI":"10.5772\/intechopen.79446"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Alirezazadeh, P., Dornaika, F., and Moujahid, A. (2023). Chasing a Better Decision Margin for Discriminative Histopathological Breast Cancer Image Classification. Electronics, 12.","DOI":"10.3390\/electronics12204356"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Bayramoglu, N., Kannala, J., and Heikkil\u00e4, J. (2016, January 4\u20138). Deep learning for magnification independent breast cancer histopathology image classification. Proceedings of the 2016 23rd International conference on pattern recognition (ICPR), Cancun, Mexico.","DOI":"10.1109\/ICPR.2016.7900002"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"621","DOI":"10.1002\/ima.22403","article-title":"Residual learning based CNN for breast cancer histopathological image classification","volume":"30","author":"Gour","year":"2020","journal-title":"Int. J. Imaging Syst. Technol."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Titoriya, A., and Sachdeva, S. (2019, January 21\u201322). Breast cancer histopathology image classification using AlexNet. Proceedings of the 2019 4th International Conference on Information Systems and Computer Networks (ISCON), Mathura, UP, India.","DOI":"10.1109\/ISCON47742.2019.9036160"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s13755-018-0057-x","article-title":"Transfer learning based histopathologic image classification for breast cancer detection","volume":"6","author":"Deniz","year":"2018","journal-title":"Health Inf. Sci. Syst."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Vesal, S., Ravikumar, N., Davari, A., Ellmann, S., and Maier, A. (2018, January 27\u201329). Classification of breast cancer histology images using transfer learning. Proceedings of the Image Analysis and Recognition: 15th International Conference, ICIAR 2018, P\u00f3voa de Varzim, Portugal.","DOI":"10.1007\/978-3-319-93000-8_92"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2751","DOI":"10.1007\/s00371-021-02153-y","article-title":"Transfer learning-assisted multi-resolution breast cancer histopathological images classification","volume":"38","author":"Ahmad","year":"2022","journal-title":"Vis. Comput."},{"key":"ref_35","first-page":"1","article-title":"Accurate automated detection of invasive ductal carcinoma in whole-slide images of breast cancer tissues using deep learning","volume":"21","author":"Song","year":"2020","journal-title":"BMC Bioinform."},{"key":"ref_36","unstructured":"Araujo, T., Aresta, G., Castro, E., Rouco, J., Aguiar, P., Eloy, C., Polonia, A., and Campilho, A. (2019). Classification of breast cancer histology images using Convolutional Neural Networks. PLoS ONE, 14."},{"key":"ref_37","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient convolutional neural networks for mobile vision applications. arXiv."},{"key":"ref_38","unstructured":"Say\u0131n, \u0130., Soyda\u015f, M.A., Mert, Y.E., Yarkada\u015f, A., Erg\u00fcn, B., S\u00f6zen Yeh, S., and \u00dcvet, H. (arXiv, 2023). Comparative Analysis of Deep Learning Architectures for Breast Cancer Diagnosis Using the BreaKHis Dataset, arXiv."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Parvin, F., and Hasan, M.A.M. (2020, January 5\u20137). A comparative study of different types of convolutional neural networks for breast cancer histopathological image classification. Proceedings of the 2020 IEEE Region 10 Symposium (TENSYMP), Dhaka, Bangladesh.","DOI":"10.1109\/TENSYMP50017.2020.9230787"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zerouaoui, H., and Idri, A. (2022). Deep hybrid architectures for binary classification of medical breast cancer images. Biomed. Signal Process. Control., 71.","DOI":"10.1016\/j.bspc.2021.103226"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Singh, A., Randive, S., Breggia, A., Ahmad, B., Christman, R., and Amal, S. (2023). Enhancing Prostate Cancer Diagnosis with a Novel Artificial Intelligence-Based Web Application: Synergizing Deep Learning Models, Multimodal Data, and Insights from Usability Study with Pathologists. Cancers, 15.","DOI":"10.3390\/cancers15235659"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Singh, A., Wan, M., Harrison, L., Breggia, A., Christman, R., Winslow, R.L., and Amal, S. (2023, January 27\u201331). Visualizing Decisions and Analytics of Artificial Intelligence based Cancer Diagnosis and Grading of Specimen Digitized Biopsy: Case Study for Prostate Cancer. Proceedings of the 28th International Conference on Intelligent User Interfaces, New York, NY, USA.","DOI":"10.1145\/3581754.3584177"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1294068","DOI":"10.3389\/fradi.2023.1294068","article-title":"Applications of AI in multi-modal imaging for cardiovascular disease","volume":"3","author":"Milosevic","year":"2024","journal-title":"Front. Radiol."}],"container-title":["Cancers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-6694\/16\/12\/2222\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:58:51Z","timestamp":1760108331000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-6694\/16\/12\/2222"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,14]]},"references-count":43,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["cancers16122222"],"URL":"https:\/\/doi.org\/10.3390\/cancers16122222","relation":{},"ISSN":["2072-6694"],"issn-type":[{"value":"2072-6694","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,14]]}}}