{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,6]],"date-time":"2026-08-06T10:09:16Z","timestamp":1786010956501,"version":"3.56.0"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,1,30]],"date-time":"2023-01-30T00:00:00Z","timestamp":1675036800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,1,30]],"date-time":"2023-01-30T00:00:00Z","timestamp":1675036800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"3BIGS Research Fund","award":["3BIGS-R-20210005"],"award-info":[{"award-number":["3BIGS-R-20210005"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Imaging"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Grading of cancer histopathology slides requires more pathologists and expert clinicians as well as it is time consuming to look manually into whole-slide images. Hence, an automated classification of histopathological breast cancer sub-type is useful for clinical diagnosis and therapeutic responses. Recent deep learning methods for medical image analysis suggest the utility of automated radiologic imaging classification for relating disease characteristics or diagnosis and patient stratification.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>To develop a hybrid model using the convolutional neural network (CNN) and the long short-term memory recurrent neural network (LSTM RNN) to classify four benign and four\u00a0malignant breast cancer subtypes. The proposed CNN-LSTM leveraging on ImageNet uses a transfer learning approach in classifying and predicting four subtypes\u00a0of each. The proposed model was evaluated on the BreakHis dataset comprises 2480 benign and 5429 malignant cancer images acquired at magnifications of 40\u00d7, 100\u00d7, 200\u00d7 and 400\u00d7.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>The proposed hybrid CNN-LSTM model was compared with the existing CNN models used for breast histopathological image classification such as VGG-16, ResNet50, and Inception models. All the models were built using three different optimizers such as adaptive moment estimator (Adam), root mean square propagation (RMSProp), and stochastic gradient descent (SGD) optimizers by varying numbers of epochs. From the results, we noticed that the Adam optimizer was the best optimizer with maximum accuracy and minimum model loss for both the training and validation sets. The proposed hybrid CNN-LSTM model showed the highest overall accuracy of 99% for binary classification of benign and malignant cancer, and, whereas, 92.5% for multi-class classifier of benign and malignant cancer subtypes, respectively.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>To conclude, the proposed transfer learning approach outperformed the state-of-the-art machine and deep learning models in classifying benign and malignant cancer subtypes. The proposed method is feasible in classification of other cancers as well as diseases.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12880-023-00964-0","type":"journal-article","created":{"date-parts":[[2023,1,30]],"date-time":"2023-01-30T11:03:11Z","timestamp":1675076591000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":177,"title":["Classification of benign and malignant subtypes of breast cancer histopathology imaging using hybrid CNN-LSTM based transfer learning"],"prefix":"10.1186","volume":"23","author":[{"given":"Mahati Munikoti","family":"Srikantamurthy","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"V. P. Subramanyam","family":"Rallabandi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dawood Babu","family":"Dudekula","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sathishkumar","family":"Natarajan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Junhyung","family":"Park","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,1,30]]},"reference":[{"key":"964_CR1","doi-asserted-by":"publisher","first-page":"209","DOI":"10.3322\/caac.21660","volume":"71","author":"H Sung","year":"2021","unstructured":"Sung H, et al. Global Cancer Statistics 2020: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 186 countries. CA Cancer J Clin. 2021;71:209\u201349.","journal-title":"CA Cancer J Clin"},{"key":"964_CR2","unstructured":"Simonyan K, Zisserman A. Very deep convolutional networks for large-scale image recognition.arXiv reprint. 2015."},{"key":"964_CR3","unstructured":"Krizhevsky A, Sutskever I, Hinton GE. ImageNet classification with deep convolutional neural networks. In: Burges CJC, Bottou L, Welling M, Ghahramani A, Weinberger KQ, editors. In: Proceedings of the 26th Neural Information Processing Systems (NIPS\u2019 12). Lake Tahoe, Nevada; 2013"},{"key":"964_CR4","doi-asserted-by":"crossref","unstructured":"Huang G, Liu Z, Maaten L, Weinberger KQ. Densely connected convolutional network. arXiv:1608.06993. 2018.","DOI":"10.1109\/CVPR.2017.243"},{"key":"964_CR5","doi-asserted-by":"publisher","first-page":"1218","DOI":"10.1007\/s10278-020-00357-7","volume":"33","author":"H Zhang","year":"2020","unstructured":"Zhang H, Han L, Chen K, et al. Diagnostic efficiency of the breast ultrasound computer-aided prediction model based on convolutional neural network in breast cancer. J Digit Imaging. 2020;33:1218\u201323.","journal-title":"J Digit Imaging"},{"key":"964_CR6","doi-asserted-by":"publisher","first-page":"e0177544","DOI":"10.1371\/journal.pone.0177544","volume":"12","author":"T Ara\u00fajo","year":"2017","unstructured":"Ara\u00fajo T, Aresta G, et al. Classification of breast cancer histology images using convolutional neural networks. PLoS ONE. 2017;12:e0177544.","journal-title":"PLoS ONE"},{"key":"964_CR7","doi-asserted-by":"crossref","unstructured":"Nahid AA, Mehrabi MA, Kong Y. Histopathological breast cancer image classification by deep neural network techniques guided by local clustering. Biomed Res Int. 2018;2018:2362108.","DOI":"10.1155\/2018\/2362108"},{"key":"964_CR8","doi-asserted-by":"publisher","first-page":"248","DOI":"10.1016\/j.cmpb.2015.12.014","volume":"127","author":"J Arevalo","year":"2016","unstructured":"Arevalo J, Gonza\u00b4lez FA, Ramos-Polla\u00b4n R, Oliveira JL, Lopez MAG. Representation learning for mammography mass lesion classification with convolutional neural networks. Comput Methods Programs Biomed. 2016;127:248\u201357.","journal-title":"Comput Methods Programs Biomed"},{"key":"964_CR9","doi-asserted-by":"publisher","first-page":"034501","DOI":"10.1117\/1.JMI.3.3.034501","volume":"3","author":"BQ Huynh","year":"2016","unstructured":"Huynh BQ, Li H, Giger ML. Digital mammographic tumor classification using transfer learning from deep convolutional neural networks. J Med Imaging. 2016;3:034501.","journal-title":"J Med Imaging"},{"key":"964_CR10","doi-asserted-by":"publisher","first-page":"104407","DOI":"10.1016\/j.compbiomed.2021.104407","volume":"133","author":"E Ye\u015fim","year":"2021","unstructured":"Ye\u015fim E, Muhammed Y, Ahmet C. Convolutional neural networks based classification of breast ultrasonography images by hybrid method with respect to benign, malignant, and normal using mRMR. Comput Biol Med. 2021;133:104407.","journal-title":"Comput Biol Med"},{"key":"964_CR11","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1016\/j.patcog.2017.05.010","volume":"71","author":"Y Zheng","year":"2017","unstructured":"Zheng Y, et al. Feature extraction from histopathological images based on nucleus-guided convolutional neural network for breast lesion classification. Pattern Recogn. 2017;71:14\u201325.","journal-title":"Pattern Recogn"},{"key":"964_CR12","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1016\/j.media.2018.07.004","volume":"49","author":"YR Van Eycke","year":"2018","unstructured":"Van Eycke YR, et al. Segmentation of glandular epithelium in colorectal tumours to automatically compartmentalise IHC biomarker quantification: a deep learning approach. Med Image Anal. 2018;49:35\u201345.","journal-title":"Med Image Anal"},{"key":"964_CR13","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1016\/j.eswa.2018.09.049","volume":"117","author":"PJ Sudharshan","year":"2019","unstructured":"Sudharshan PJ, et al. Multiple instance learning for histopathological breast cancer image classification. Expert Syst Appl. 2019;117:103\u201311.","journal-title":"Expert Syst Appl"},{"key":"964_CR14","doi-asserted-by":"publisher","first-page":"214","DOI":"10.1016\/j.neucom.2016.01.034","volume":"191","author":"J Xu","year":"2016","unstructured":"Xu J, Luo X, Wang G, Gilmore H, Madabhushi A. A deep convolutional neural network for segmenting and classifying epithelial and stromal regions in histopathological images. Neurocomput. 2016;191:214\u201323.","journal-title":"Neurocomput"},{"key":"964_CR15","doi-asserted-by":"publisher","first-page":"306","DOI":"10.1016\/j.media.2015.10.005","volume":"26","author":"X Zhang","year":"2015","unstructured":"Zhang X, et al. High-throughput histopathological image analysis via robust cell segmentation and hashing. Med Image Anal. 2015;26:306\u201315.","journal-title":"Med Image Anal"},{"key":"964_CR16","doi-asserted-by":"publisher","first-page":"2043","DOI":"10.1016\/j.patcog.2010.01.005","volume":"43","author":"OS Al-Kadi","year":"2010","unstructured":"Al-Kadi OS. Texture measures combination for improved meningioma classification of histopathological images. Pattern Recogn. 2010;43:2043\u201353.","journal-title":"Pattern Recogn"},{"key":"964_CR17","doi-asserted-by":"crossref","unstructured":"Szegedy C, Vanhoucke V, Ioffe, Shlens J, Wojna Z. Rethinking the Inception Architecture for Computer Vision. arXiv 2015; reprint arXiv:1512.00567.","DOI":"10.1109\/CVPR.2016.308"},{"key":"964_CR18","unstructured":"Barret Z, Vasudevan V, Shlens J, Quoc VL. Learning transferable architectures for scalable image recognition. arXiv 2017; preprint arXiv:1707.07012."},{"key":"964_CR19","doi-asserted-by":"publisher","first-page":"1455","DOI":"10.1109\/TBME.2015.2496264","volume":"63","author":"FA Spanhol","year":"2016","unstructured":"Spanhol FA, Oliveira LS, Petitjean C, Heutte L. A dataset for breast cancer histopathological image classification. IEEE Trans Biomed Eng. 2016;63:1455\u201362.","journal-title":"IEEE Trans Biomed Eng"},{"key":"964_CR20","doi-asserted-by":"crossref","unstructured":"Gupta V, Bhavsar A. Sequential modeling of deep features for breast cancer histopathological image classification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, IEEE 2018. p.\u00a02254\u20132261.","DOI":"10.1109\/CVPRW.2018.00302"},{"key":"964_CR21","doi-asserted-by":"publisher","first-page":"19","DOI":"10.3390\/info9010019","volume":"9","author":"AA Nahid","year":"2018","unstructured":"Nahid AA, Kong Y. Histopathological breast-image classification using local and frequency domains by convolutional neural network. Information. 2018;9:19.","journal-title":"Information"},{"key":"964_CR22","unstructured":"Wei B, Han Z, He X, Yin Y. Deep learning model-based breast cancer histopathological image classification. In: Proc IEEE 2nd International Conference on Cloud Computing and Big Data Analysis (ICCCBDA), IEEE 2017. pp.\u00a0348\u2013353."},{"key":"964_CR23","doi-asserted-by":"crossref","unstructured":"Das K, Karri SPK, Roy AG, Chatterjee J, Sheet D. Classifying histopathology whole-slides using fusion of decisions from deep convolutional network on a collection of random multi-views at multi-magnification. In: Proc IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017), IEEE, 2017. pp.\u00a01024\u20131027.","DOI":"10.1109\/ISBI.2017.7950690"},{"key":"964_CR24","doi-asserted-by":"publisher","first-page":"4172","DOI":"10.1038\/s41598-017-04075-z","volume":"7","author":"Z Han","year":"2017","unstructured":"Han Z, Wei B, Zheng Y, Yin Y, Li K, Li S. Breast cancer multi-classification from histopathological images with structured deep learning model. Sci Rep. 2017;7:4172.","journal-title":"Sci Rep"},{"key":"964_CR25","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1016\/j.artmed.2018.04.005","volume":"88","author":"Z Gandomkar","year":"2018","unstructured":"Gandomkar Z, Brennan PC, Mello-Thomas C. MuDeRN: multicategory classification of breast histopathological image using deep residual networks. Artif Intell Med. 2018;88:14\u201324.","journal-title":"Artif Intell Med"},{"key":"964_CR26","doi-asserted-by":"publisher","first-page":"24680","DOI":"10.1109\/ACCESS.2018.2831280","volume":"6","author":"D Bardou","year":"2018","unstructured":"Bardou D, Zhang K, Ahmad SM. Classification of breast cancer based on histology images using convolutional neural networks. IEEE Access. 2018;6:24680\u201393.","journal-title":"IEEE Access"},{"key":"964_CR27","first-page":"152","volume":"18","author":"MA Nawaz","year":"2018","unstructured":"Nawaz MA, Sewissy AA, Soliman THA. Automated classification of breast cancer histology images using deep learning based convolutional neural networks. Inter J Comput Sci Netw Secur. 2018;18:152\u201360.","journal-title":"Inter J Comput Sci Netw Secur"},{"key":"964_CR28","doi-asserted-by":"crossref","unstructured":"Rakhlin A, Shvets A, Iglovikov V, Kalinin AA. Deep convolutional neural networks for breast cancer histology image analysis. arXiv:1802.00752v2, 2018.","DOI":"10.1101\/259911"},{"key":"964_CR29","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1016\/j.compeleceng.2019.04.012","volume":"76","author":"S \u00d6zt\u00fcrk","year":"2019","unstructured":"\u00d6zt\u00fcrk S, Akdemir B. HIC-net: a deep convolutional neural network model for classification of histopathological breast images. Comput Elect Eng. 2019;76:299\u2013310.","journal-title":"Comput Elect Eng"},{"key":"964_CR30","first-page":"618","volume":"10","author":"AD Walid","year":"2019","unstructured":"Walid AD, Gomaa M, Khaled H, Fahmy A. Deep learning approaches for data augmentation and classification of breast masses using ultrasound images. Int J Adv Comput Sci Appl. 2019;10:618\u201327.","journal-title":"Int J Adv Comput Sci Appl"},{"key":"964_CR31","doi-asserted-by":"publisher","first-page":"113387","DOI":"10.1016\/j.eswa.2020.113387","volume":"151","author":"BM Priego-Torres","year":"2020","unstructured":"Priego-Torres BM, Sanchez-Morillo D, Fernandez-Granero MA, Garcia-Rojo M. Automatic segmentation of whole-slide H&E stained breast histopathology images using a deep convolutional neural network architecture. Expert Syst Appl. 2020;151:113387.","journal-title":"Expert Syst Appl"},{"key":"964_CR32","doi-asserted-by":"publisher","first-page":"11579","DOI":"10.1038\/s41598-021-90444-8","volume":"11","author":"M Khened","year":"2021","unstructured":"Khened M, Kori A, Rajkumar H, Krishnamurthi G, Srinivasan B. A generalized deep learning framework for whole-slide image segmentation and analysis. Sci Rep. 2021;11:11579.","journal-title":"Sci Rep"},{"key":"964_CR33","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1016\/j.ejmp.2021.02.006","volume":"83","author":"I Castiglioni","year":"2021","unstructured":"Castiglioni I, Rundo L, Codari M, et al. AI applications to medical images: from machine learning to deep learning. Phys Med. 2021;83:9\u201324.","journal-title":"Phys Med"},{"key":"964_CR34","doi-asserted-by":"crossref","unstructured":"Howard FM, Dolezal J, Kochanny S et al. The impact of digital histopathology batch effect on deep learning model accuracy and bias. bioRxiv 2020.","DOI":"10.1101\/2020.12.03.410845"},{"key":"964_CR35","doi-asserted-by":"crossref","unstructured":"Tellez D, Litjens G, B\u00e1ndi P, Bulten W, Bokhorst JM, Ciompi F, van der Laak J. Quantifying the effects of data augmentation and stain color normalization in convolutional neural networks for computational pathology. Med Image Anal. 2019;58:101544","DOI":"10.1016\/j.media.2019.101544"},{"key":"964_CR36","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","volume":"115","author":"O Russakovsky","year":"2015","unstructured":"Russakovsky O, Deng J, Su H, et al. ImageNet large scale visual recognition challenge. Int J Comput Vis. 2015;115:211\u201352.","journal-title":"Int J Comput Vis"},{"key":"964_CR37","unstructured":"Tan C, Sun F, Kong T et al. A survey on deep transfer learning. In: K\u016frkov\u00e1 V, Manolopoulos Y, Hammer B, Iliadis L, Maglogiannis I, editors. Artificial Neural Networks and Machine Learning\u2014ICANN 2018. Springer."},{"key":"964_CR38","first-page":"70","volume":"254","author":"J Krause","year":"2021","unstructured":"Krause J, Grabsch HI, Kloor M, et al. Deep learning detects genetic alterations in cancer histology generated by adversarial networks. J Pathol. 2021;254:70\u20139.","journal-title":"J Pathol"},{"key":"964_CR39","doi-asserted-by":"crossref","unstructured":"Zhou B, Khosla A, Lapedriza A, Oliva A, Torralba A. Learning deep features for discriminative localization. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, IEEE Computer Society: Washington, DC, USA, 2016; pp.\u00a02921\u20132929.","DOI":"10.1109\/CVPR.2016.319"},{"key":"964_CR40","doi-asserted-by":"publisher","first-page":"e0130140","DOI":"10.1371\/journal.pone.0130140","volume":"10","author":"S Bach","year":"2015","unstructured":"Bach S, Binder A, Montavon G, Klauschen F, M\u00fcller KR, Samek W. On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PLoS ONE. 2015;10:e0130140.","journal-title":"PLoS ONE"},{"key":"964_CR41","doi-asserted-by":"publisher","first-page":"24273","DOI":"10.1109\/ACCESS.2021.3056516","volume":"9","author":"I Hirra","year":"2021","unstructured":"Hirra I, et al. Breast cancer classification from histopathological images using patch-based deep learning modeling. IEEE Access. 2021;9:24273\u201387.","journal-title":"IEEE Access"}],"container-title":["BMC Medical Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12880-023-00964-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12880-023-00964-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12880-023-00964-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,30]],"date-time":"2023-01-30T11:06:38Z","timestamp":1675076798000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedimaging.biomedcentral.com\/articles\/10.1186\/s12880-023-00964-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,30]]},"references-count":41,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["964"],"URL":"https:\/\/doi.org\/10.1186\/s12880-023-00964-0","relation":{},"ISSN":["1471-2342"],"issn-type":[{"value":"1471-2342","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,1,30]]},"assertion":[{"value":"12 August 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 January 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 January 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Not applicable.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"19"}}