{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,10]],"date-time":"2026-11-10T15:27:54Z","timestamp":1794324474945,"version":"4.9.0"},"reference-count":47,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,9,16]],"date-time":"2022-09-16T00:00:00Z","timestamp":1663286400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,9,16]],"date-time":"2022-09-16T00:00:00Z","timestamp":1663286400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Basque Country project MIFLUDAN"},{"name":"eVida Research Group IT 905-16"},{"name":"FPI (formaci\u00f3n de personal investigador) Grant"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Breast cancer is a common malignancy and a leading cause of cancer-related deaths in women worldwide. Its early diagnosis can significantly reduce the morbidity and mortality rates in women. To this end, histopathological diagnosis is usually followed as the gold standard approach. However, this process is tedious, labor-intensive, and may be subject to inter-reader variability. Accordingly, an automatic diagnostic system can assist to improve the quality of diagnosis. This paper presents a deep learning approach to automatically classify hematoxylin-eosin-stained breast cancer microscopy images into normal tissue, benign lesion, in situ carcinoma, and invasive carcinoma using our collected dataset. Our proposed model exploited six intermediate layers of the Xception (Extreme Inception) network to retrieve robust and abstract features from input images. First, we optimized the proposed model on the original (unnormalized) dataset using 5-fold cross-validation. Then, we investigated its performance on four normalized datasets resulting from Reinhard, Ruifrok, Macenko, and Vahadane stain normalization. For original images, our proposed framework yielded an accuracy of 98% along with a kappa score of 0.969. Also, it achieved an average AUC-ROC score of 0.998 as well as a mean AUC-PR value of 0.995. Specifically, for in situ carcinoma and invasive carcinoma, it offered sensitivity of 96% and 99%, respectively. For normalized images, the proposed architecture performed better for Makenko normalization compared to the other three techniques. In this case, the proposed model achieved an accuracy of 97.79% together with a kappa score of 0.965. Also, it attained an average AUC-ROC score of 0.997 and a mean AUC-PR value of 0.991. Especially, for in situ carcinoma and invasive carcinoma, it offered sensitivity of 96% and 99%, respectively. These results demonstrate that our proposed model outperformed the baseline AlexNet as well as state-of-the-art VGG16, VGG19, Inception-v3, and Xception models with their default settings. Furthermore, it can be inferred that although stain normalization techniques offered competitive performance, they could not surpass the results of the original dataset.<\/jats:p>","DOI":"10.1038\/s41598-022-19278-2","type":"journal-article","created":{"date-parts":[[2022,9,16]],"date-time":"2022-09-16T12:04:09Z","timestamp":1663329849000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":91,"title":["Multiclass classification of breast cancer histopathology images using multilevel features of deep convolutional neural network"],"prefix":"10.1038","volume":"12","author":[{"given":"Zabit","family":"Hameed","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Begonya","family":"Garcia-Zapirain","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jos\u00e9 Javier","family":"Aguirre","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mario Arturo","family":"Isaza-Ruget","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,9,16]]},"reference":[{"key":"19278_CR1","doi-asserted-by":"publisher","first-page":"209","DOI":"10.3322\/caac.21660","volume":"71","author":"H Sung","year":"2021","unstructured":"Sung, H. et al. Global cancer statistics 2020: Globocan estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J. Clin. 71, 209\u2013249 (2021).","journal-title":"CA Cancer J. Clin."},{"key":"19278_CR2","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1016\/j.gendis.2018.05.001","volume":"5","author":"Y Feng","year":"2018","unstructured":"Feng, Y. et al. Breast cancer development and progression: Risk factors, cancer stem cells, signaling pathways, genomics, and molecular pathogenesis. Genes Dis. 5, 77\u2013106 (2018).","journal-title":"Genes Dis."},{"key":"19278_CR3","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s00428-014-1593-7","volume":"465","author":"D Vuong","year":"2014","unstructured":"Vuong, D., Simpson, P. T., Green, B., Cummings, M. C. & Lakhani, S. R. Molecular classification of breast cancer. Virchows Arch. 465, 1\u201314 (2014).","journal-title":"Virchows Arch."},{"key":"19278_CR4","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1016\/j.ejrad.2012.03.005","volume":"82","author":"C Dromain","year":"2013","unstructured":"Dromain, C. et al. Computed-aided diagnosis (CAD) in the detection of breast cancer. Eur. J. Radiol. 82, 417\u2013423 (2013).","journal-title":"Eur. J. Radiol."},{"key":"19278_CR5","doi-asserted-by":"publisher","first-page":"1572","DOI":"10.3390\/s17071572","volume":"17","author":"L Wang","year":"2017","unstructured":"Wang, L. Early diagnosis of breast cancer. Sensors 17, 1572 (2017).","journal-title":"Sensors"},{"key":"19278_CR6","doi-asserted-by":"publisher","first-page":"1400","DOI":"10.1109\/TBME.2014.2303852","volume":"61","author":"M Veta","year":"2014","unstructured":"Veta, M., Pluim, J. P., Van Diest, P. J. & Viergever, M. A. Breast cancer histopathology image analysis: A review. IEEE Trans. Biomed. Eng. 61, 1400\u20131411 (2014).","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"19278_CR7","first-page":"1","volume":"14","author":"C Elfgen","year":"2019","unstructured":"Elfgen, C. et al. Comparative analysis of confocal microscopy on fresh breast core needle biopsies and conventional histology. Diagnost. Pathol. 14, 1\u20138 (2019).","journal-title":"Diagnost. Pathol."},{"key":"19278_CR8","doi-asserted-by":"publisher","first-page":"4373","DOI":"10.3390\/s20164373","volume":"20","author":"Z Hameed","year":"2020","unstructured":"Hameed, Z., Zahia, S., Garcia-Zapirain, B., Javier Aguirre, J. & Mar\u00eda Vanegas, A. Breast cancer histopathology image classification using an ensemble of deep learning models. Sensors 20, 4373 (2020).","journal-title":"Sensors"},{"key":"19278_CR9","doi-asserted-by":"publisher","first-page":"1122","DOI":"10.1001\/jama.2015.1405","volume":"313","author":"JG Elmore","year":"2015","unstructured":"Elmore, J. G. et al. Diagnostic concordance among pathologists interpreting breast biopsy specimens. JAMA 313, 1122\u20131132 (2015).","journal-title":"JAMA"},{"key":"19278_CR10","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1016\/j.breast.2019.12.007","volume":"49","author":"A Ibrahim","year":"2020","unstructured":"Ibrahim, A. et al. Artificial intelligence in digital breast pathology: Techniques and applications. The Breast 49, 267\u2013273 (2020).","journal-title":"The Breast"},{"key":"19278_CR11","doi-asserted-by":"crossref","unstructured":"Lowe, D.\u00a0G. Object recognition from local scale-invariant features. In Proceedings of the Seventh IEEE International Conference on Computer Vision, Corfu, Greece, 20\u201325 September 1999, vol.\u00a02, 1150\u20131157 (IEEE, 1999).","DOI":"10.1109\/ICCV.1999.790410"},{"key":"19278_CR12","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T. & Van\u00a0Gool, L. Surf: Speeded up robust features. In European conference on computer vision, Graz, Austria, 7-13 May 2006, 404\u2013417 (Springer, 2006).","DOI":"10.1007\/11744023_32"},{"key":"19278_CR13","doi-asserted-by":"publisher","first-page":"971","DOI":"10.1109\/TPAMI.2002.1017623","volume":"24","author":"T Ojala","year":"2002","unstructured":"Ojala, T., Pietikainen, M. & Maenpaa, T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24, 971\u2013987 (2002).","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"19278_CR14","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun, Y., Bengio, Y. & Hinton, G. Deep learning. Nature 521, 436\u2013444 (2015).","journal-title":"Nature"},{"key":"19278_CR15","unstructured":"Goodfellow, I., Bengio, Y. & Courville, A. Deep Learning (MIT Press, 2016)."},{"key":"19278_CR16","doi-asserted-by":"publisher","first-page":"2278","DOI":"10.1109\/5.726791","volume":"86","author":"Y LeCun","year":"1998","unstructured":"LeCun, Y., Bottou, L., Bengio, Y. & Haffner, P. Gradient-based learning applied to document recognition. Proc. IEEE 86, 2278\u20132324 (1998).","journal-title":"Proc. IEEE"},{"key":"19278_CR17","unstructured":"Krizhevsky, A., Sutskever, I. & Hinton, G.\u00a0E. Imagenet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems (NIPS), Lake Tahoe, NV, USA, 3\u20136 December 2012, 1097\u20131105 (2012)."},{"key":"19278_CR18","unstructured":"Simonyan, K. & Zisserman, A. Very deep convolutional networks for large-scale image recognition. In International Conference on Learning Representations (ICLR), San Diego, CA, USA, May 7\u20139, 2015 (2015)."},{"key":"19278_CR19","doi-asserted-by":"crossref","unstructured":"Szegedy, C. et\u00a0al. Going deeper with convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1\u20139 (2015).","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"19278_CR20","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 770\u2013778 (2016).","DOI":"10.1109\/CVPR.2016.90"},{"key":"19278_CR21","doi-asserted-by":"publisher","first-page":"1455","DOI":"10.1109\/TBME.2015.2496264","volume":"63","author":"FA Spanhol","year":"2015","unstructured":"Spanhol, F. A., Oliveira, L. S., Petitjean, C. & Heutte, L. A dataset for breast cancer histopathological image classification. IEEE Trans. Biomed. Eng. 63, 1455\u20131462 (2015).","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"19278_CR22","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1016\/j.media.2019.05.010","volume":"56","author":"G Aresta","year":"2019","unstructured":"Aresta, G. et al. Bach: Grand challenge on breast cancer histology images. Med. Image Anal. 56, 122\u2013139 (2019).","journal-title":"Med. Image Anal."},{"key":"19278_CR23","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0214587","volume":"14","author":"Y Jiang","year":"2019","unstructured":"Jiang, Y., Chen, L., Zhang, H. & Xiao, X. Breast cancer histopathological image classification using convolutional neural networks with small se-resnet module. PLoS ONE 14, e0214587 (2019).","journal-title":"PLoS ONE"},{"key":"19278_CR24","doi-asserted-by":"publisher","first-page":"1003","DOI":"10.2991\/ijcis.d.210301.002","volume":"14","author":"H Elmannai","year":"2021","unstructured":"Elmannai, H., Hamdi, M. & AlGarni, A. Deep learning models combining for breast cancer histopathology image classification. Int. J. Comput. Intell. Syst. 14, 1003\u20131013 (2021).","journal-title":"Int. J. Comput. Intell. Syst."},{"key":"19278_CR25","doi-asserted-by":"crossref","unstructured":"Chollet, F. Xception: Deep learning with depthwise separable convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1251\u20131258 (2017).","DOI":"10.1109\/CVPR.2017.195"},{"key":"19278_CR26","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1016\/j.icte.2021.11.010","volume":"8","author":"S Sharma","year":"2022","unstructured":"Sharma, S. & Kumar, S. The xception model: A potential feature extractor in breast cancer histology images classification. ICT Express 8, 101\u2013108 (2022).","journal-title":"ICT Express"},{"key":"19278_CR27","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1016\/j.ymeth.2019.06.014","volume":"173","author":"R Yan","year":"2020","unstructured":"Yan, R. et al. Breast cancer histopathological image classification using a hybrid deep neural network. Methods 173, 52\u201360 (2020).","journal-title":"Methods"},{"key":"19278_CR28","doi-asserted-by":"publisher","first-page":"3337","DOI":"10.3390\/cancers12113337","volume":"12","author":"F Bianconi","year":"2020","unstructured":"Bianconi, F., Kather, J. N. & Reyes-Aldasoro, C. C. Experimental assessment of color deconvolution and color normalization for automated classification of histology images stained with hematoxylin and eosin. Cancers 12, 3337 (2020).","journal-title":"Cancers"},{"key":"19278_CR29","doi-asserted-by":"crossref","unstructured":"Kassani, S.\u00a0H., Kassani, P.\u00a0H., Wesolowski, M.\u00a0J., Schneider, K.\u00a0A. & Deters, R. Breast cancer diagnosis with transfer learning and global pooling. In 2019 International Conference on Information and Communication Technology Convergence (ICTC), 519\u2013524 (IEEE, 2019).","DOI":"10.1109\/ICTC46691.2019.8939878"},{"key":"19278_CR30","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2020.104129","volume":"128","author":"M Salvi","year":"2021","unstructured":"Salvi, M., Acharya, U. R., Molinari, F. & Meiburger, K. M. The impact of pre-and post-image processing techniques on deep learning frameworks: A comprehensive review for digital pathology image analysis. Comput. Biol. Med. 128, 104129 (2021).","journal-title":"Comput. Biol. Med."},{"key":"19278_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-017-17204-5","volume":"7","author":"P Bankhead","year":"2017","unstructured":"Bankhead, P. et al. Qupath: Open source software for digital pathology image analysis. Sci. Rep. 7, 1\u20137 (2017).","journal-title":"Sci. Rep."},{"key":"19278_CR32","doi-asserted-by":"publisher","first-page":"34","DOI":"10.1109\/38.946629","volume":"21","author":"E Reinhard","year":"2001","unstructured":"Reinhard, E., Adhikhmin, M., Gooch, B. & Shirley, P. Color transfer between images. IEEE Comput. Graph. Appl. 21, 34\u201341 (2001).","journal-title":"IEEE Comput. Graph. Appl."},{"key":"19278_CR33","first-page":"291","volume":"23","author":"AC Ruifrok","year":"2001","unstructured":"Ruifrok, A. C. et al. Quantification of histochemical staining by color deconvolution. Anal. Quant. Cytol. Histol. 23, 291\u2013299 (2001).","journal-title":"Anal. Quant. Cytol. Histol."},{"key":"19278_CR34","doi-asserted-by":"crossref","unstructured":"Macenko, M. et\u00a0al. A method for normalizing histology slides for quantitative analysis. In 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro, 1107\u20131110 (IEEE, 2009).","DOI":"10.1109\/ISBI.2009.5193250"},{"key":"19278_CR35","doi-asserted-by":"crossref","unstructured":"Vahadane, A. et\u00a0al. Structure-preserved color normalization for histological images. In 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI), 1012\u20131015 (IEEE, 2015).","DOI":"10.1109\/ISBI.2015.7164042"},{"key":"19278_CR36","doi-asserted-by":"publisher","first-page":"533","DOI":"10.1007\/BF00158587","volume":"26","author":"HO Lyon","year":"1994","unstructured":"Lyon, H. O. et al. Standardization of reagents and methods used in cytological and histological practice with emphasis on dyes, stains and chromogenic reagents. Histochem. J. 26, 533\u2013544 (1994).","journal-title":"Histochem. J."},{"key":"19278_CR37","doi-asserted-by":"publisher","first-page":"42","DOI":"10.1016\/j.micron.2018.07.005","volume":"114","author":"S Roy","year":"2018","unstructured":"Roy, S., Kumar Jain, A., Lal, S. & Kini, J. A study about color normalization methods for histopathology images. Micron 114, 42\u201361 (2018).","journal-title":"Micron"},{"key":"19278_CR38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12911-019-0913-x","volume":"19","author":"C Zhu","year":"2019","unstructured":"Zhu, C. et al. Breast cancer histopathology image classification through assembling multiple compact cnns. BMC Med. Inform. Decis. Mak. 19, 1\u201317 (2019).","journal-title":"BMC Med. Inform. Decis. Mak."},{"key":"19278_CR39","unstructured":"Abadi, M. et\u00a0al. TensorFlow: Large-scale machine learning on heterogeneous systems (2015)."},{"key":"19278_CR40","unstructured":"Lin, M., Chen, Q. & Yan, S. Network in network. arXiv preprint arXiv:1312.4400 (2013)."},{"key":"19278_CR41","unstructured":"Ioffe, S. & Szegedy, C. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In International Conference on Machine Learning, 448\u2013456 (PMLR, 2015)."},{"key":"19278_CR42","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J. & Wojna, Z. Rethinking the inception architecture for computer vision. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2818\u20132826 (2016).","DOI":"10.1109\/CVPR.2016.308"},{"key":"19278_CR43","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Ioffe, S., Vanhoucke, V. & Alemi, A.\u00a0A. Inception-v4, inception-resnet and the impact of residual connections on learning. In Thirty-First AAAI Conference on Artificial Intelligence (2017).","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"19278_CR44","doi-asserted-by":"publisher","first-page":"427","DOI":"10.1016\/j.ipm.2009.03.002","volume":"45","author":"M Sokolova","year":"2009","unstructured":"Sokolova, M. & Lapalme, G. A systematic analysis of performance measures for classification tasks. Inf. Process. Manag. 45, 427\u2013437 (2009).","journal-title":"Inf. Process. Manag."},{"key":"19278_CR45","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-019-50587-1","volume":"9","author":"\u0141 R\u0105czkowski","year":"2019","unstructured":"R\u0105czkowski, \u0141, Mo\u017cejko, M., Zambonelli, J. & Szczurek, E. Ara: Accurate, reliable and active histopathological image classification framework with Bayesian deep learning. Sci. Rep. 9, 1\u201312 (2019).","journal-title":"Sci. Rep."},{"key":"19278_CR46","unstructured":"Kingma, D.\u00a0P. & Ba, J. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"19278_CR47","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0267955","volume":"17","author":"Y Hao","year":"2022","unstructured":"Hao, Y. et al. Breast cancer histopathological images classification based on deep semantic features and gray level co-occurrence matrix. PLoS ONE 17, e0267955 (2022).","journal-title":"PLoS ONE"}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-19278-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-19278-2","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-19278-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,10]],"date-time":"2022-11-10T16:22:16Z","timestamp":1668097336000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-022-19278-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,9,16]]},"references-count":47,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["19278"],"URL":"https:\/\/doi.org\/10.1038\/s41598-022-19278-2","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,9,16]]},"assertion":[{"value":"24 December 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 August 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 September 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"15600"}}