{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,5,14]],"date-time":"2025-05-14T12:00:13Z","timestamp":1747224013599,"version":"3.40.5"},"reference-count":62,"publisher":"IGI Global","issue":"4","license":[{"start":{"date-parts":[[2020,10,1]],"date-time":"2020-10-01T00:00:00Z","timestamp":1601510400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/3.0\/deed.en_US"},{"start":{"date-parts":[[2020,10,1]],"date-time":"2020-10-01T00:00:00Z","timestamp":1601510400000},"content-version":"am","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/3.0\/deed.en_US"},{"start":{"date-parts":[[2020,10,1]],"date-time":"2020-10-01T00:00:00Z","timestamp":1601510400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/3.0\/deed.en_US"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2020,10,1]]},"abstract":"<p>Deep learning methods are characterized by their capacity to learn data representation compared to the traditional machine learning algorithms. However, these methods are prone to overfitting on small volumes of data. The objective of this research is to overcome this limitation by improving the generalization in the proposed deep learning framework based on various techniques: data augmentation, small models, optimizer selection, and ensemble learning. For ensembling, the authors used selected models from different checkpoints and both voting and unweighted average methods for combination. The experimental study on the lymphomas histopathological dataset highlights the efficiency of the MobileNet2 network combined with the stochastic gradient descent (SGD) optimizer in terms of generalization. The best results have been achieved by the combination of the best three checkpoint models (98.67% of accuracy). These findings provide important insights into the efficiency of the checkpoint ensemble learning method for histopathological image classification.<\/p>","DOI":"10.4018\/ijcini.2020100104","type":"journal-article","created":{"date-parts":[[2020,9,2]],"date-time":"2020-09-02T14:50:56Z","timestamp":1599058256000},"page":"62-81","source":"Crossref","is-referenced-by-count":3,"title":["Efficient Regularization Framework for Histopathological Image Classification Using Convolutional Neural Networks."],"prefix":"10.4018","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8683-3163","authenticated-orcid":true,"given":"Nassima","family":"Dif","sequence":"first","affiliation":[{"name":"EEDIS Laboratory ,Djillali Liabes University, Sidi Bel Abbes, Algeria"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3391-6280","authenticated-orcid":true,"given":"Zakaria","family":"Elberrichi","sequence":"additional","affiliation":[{"name":"EEDIS Laboratory, Djillali Liabes University, Sidi Bel Abbes, Algeria"}]}],"member":"2432","reference":[{"key":"IJCINI.2020100104-0","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2559.2011.03814.x"},{"key":"IJCINI.2020100104-1","article-title":"NHL Pathological Image Classification Based on Hierarchical Local Information and GoogLeNet-Based Representations.","author":"J.Bai","year":"2019","journal-title":"BioMed Research International"},{"key":"IJCINI.2020100104-2","unstructured":"Boulch, A. (2017). Sharesnet: reducing residual network parameter number by sharing weights."},{"key":"IJCINI.2020100104-3","doi-asserted-by":"publisher","DOI":"10.1002\/hon.660"},{"key":"IJCINI.2020100104-4","doi-asserted-by":"crossref","unstructured":"Chen, H., Dou, Q., Wang, X., Qin, J., & Heng, P. A. (2016, February). Mitosis detection in breast cancer histology images via deep cascaded networks. In Proceedings of theThirtieth AAAI Conference on Artificial Intelligence. AAAI Press.","DOI":"10.1609\/aaai.v30i1.10140"},{"key":"IJCINI.2020100104-5","unstructured":"Chen, H., Lundberg, S., & Lee, S. I. (2017). Checkpoint Ensembles: Ensemble Methods from a Single Training Process."},{"key":"IJCINI.2020100104-6","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.195"},{"key":"IJCINI.2020100104-7","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-40763-5_51"},{"key":"IJCINI.2020100104-8","doi-asserted-by":"crossref","unstructured":"Codella, N., Moradi, M., Matasar, M., Sveda-Mahmood, T., & Smith, J. R. (2016, March). Lymphoma diagnosis in histopathology using a multi-stage visual learning approach. In Medical Imaging 2016: Digital Pathology. International Society for Optics and Photonics.","DOI":"10.1117\/12.2217158"},{"key":"IJCINI.2020100104-9","article-title":"Ensemble deep learning for speech recognition.","author":"L.Deng","year":"2014","journal-title":"Fifteenth Annual Conference of the International Speech Communication Association"},{"key":"IJCINI.2020100104-10","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-23192-1_40"},{"key":"IJCINI.2020100104-11","doi-asserted-by":"publisher","DOI":"10.4018\/IJSIR.2019040102"},{"key":"IJCINI.2020100104-12","doi-asserted-by":"publisher","DOI":"10.4018\/IJSITA.2018040103"},{"issue":"Jul","key":"IJCINI.2020100104-13","first-page":"2121","article-title":"Adaptive subgradient methods for online learning and stochastic optimization.","volume":"12","author":"J.Duchi","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"IJCINI.2020100104-14","first-page":"282","article-title":"Ensemble of Convolutional Neural Networks for Heart Segmentation.","author":"W.Fok","year":"2018","journal-title":"International Workshop on Statistical Atlases and Computational Models of the Heart"},{"key":"IJCINI.2020100104-15","first-page":"770","article-title":"Deep residual learning for image recognition.","author":"K.He","year":"2016","journal-title":"Proceedings of the IEEE conference on computer vision and pattern recognition"},{"key":"IJCINI.2020100104-16","doi-asserted-by":"publisher","DOI":"10.1109\/ISBI.2011.5872508"},{"key":"IJCINI.2020100104-17","unstructured":"Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., \u2026 Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications."},{"key":"IJCINI.2020100104-18","first-page":"7","article-title":"Deep learning for digital pathology image analysis: A comprehensive tutorial with selected use cases.","author":"A.Janowczyk","year":"2016","journal-title":"Journal of Pathology Informatics"},{"key":"IJCINI.2020100104-19","doi-asserted-by":"publisher","DOI":"10.1080\/02664763.2018.1441383"},{"key":"IJCINI.2020100104-20","doi-asserted-by":"publisher","DOI":"10.1186\/s12880-018-0286-0"},{"key":"IJCINI.2020100104-21","unstructured":"Kainz, P., Pfeiffer, M., & Urschler, M. (2015). Semantic segmentation of colon glands with deep convolutional neural networks and total variation segmentation."},{"key":"IJCINI.2020100104-22","unstructured":"Kingma, D. P., & Ba, J. (2014). Adam: A method for stochastic optimization."},{"key":"IJCINI.2020100104-23","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D18-1449"},{"key":"IJCINI.2020100104-24","doi-asserted-by":"publisher","DOI":"10.1016\/j.csbj.2018.01.001"},{"key":"IJCINI.2020100104-25","unstructured":"Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems (pp. 1097-1105). Academic Press."},{"key":"IJCINI.2020100104-26","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2017.07.005"},{"key":"IJCINI.2020100104-27","first-page":"145","author":"T.Meng","year":"2010","journal-title":"Histology image classification using supervised classification and multimodal fusion. In Proceedings of the 2010 IEEE international symposium on multimedia"},{"journal-title":"Deep Incremental Boosting","year":"2016","author":"A.Mosca","key":"IJCINI.2020100104-28"},{"key":"IJCINI.2020100104-29","doi-asserted-by":"publisher","DOI":"10.1016\/j.aci.2018.06.002"},{"journal-title":"General Purpose (GenP)","year":"2019","author":"L.Nanni","key":"IJCINI.2020100104-30"},{"key":"IJCINI.2020100104-31","doi-asserted-by":"crossref","unstructured":"Nanni (b), L., Brahnam, S., & Maguolo, G. (2019). Data Augmentation for Building an Ensemble of Convolutional Neural Networks. In Innovation in Medicine and Healthcare Systems, and Multimedia (pp. 61-69). Springer.","DOI":"10.1007\/978-981-13-8566-7_6"},{"key":"IJCINI.2020100104-32","doi-asserted-by":"publisher","DOI":"10.1109\/IPTA.2016.7821039"},{"key":"IJCINI.2020100104-33","doi-asserted-by":"publisher","DOI":"10.1145\/2818346.2830593"},{"key":"IJCINI.2020100104-34","doi-asserted-by":"publisher","DOI":"10.1109\/TITB.2010.2050695"},{"key":"IJCINI.2020100104-35","doi-asserted-by":"publisher","DOI":"10.1109\/ICNN.1993.298623"},{"key":"IJCINI.2020100104-36","doi-asserted-by":"publisher","DOI":"10.1214\/aoms\/1177729586"},{"key":"IJCINI.2020100104-37","doi-asserted-by":"publisher","DOI":"10.1016\/j.compbiomed.2017.10.012"},{"key":"IJCINI.2020100104-38","unstructured":"Ruder, S. (2016). An overview of gradient descent optimization algorithms."},{"key":"IJCINI.2020100104-39","unstructured":"Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1988). Learning representations by back-propagating errors. Cognitive modeling, 5(3), 1."},{"key":"IJCINI.2020100104-40","first-page":"4510","article-title":"Mobilenetv2: Inverted residuals and linear bottlenecks.","author":"M.Sandler","year":"2018","journal-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition"},{"key":"IJCINI.2020100104-41","doi-asserted-by":"publisher","DOI":"10.1145\/3287921.3287971"},{"key":"IJCINI.2020100104-42","doi-asserted-by":"publisher","DOI":"10.1109\/MAPR.2018.8337514"},{"key":"IJCINI.2020100104-43","doi-asserted-by":"crossref","unstructured":"Sennrich, R., Haddow, B., & Birch, A. (2016). Edinburgh neural machine translation systems for wmt 16.","DOI":"10.18653\/v1\/W16-2323"},{"key":"IJCINI.2020100104-44","doi-asserted-by":"publisher","DOI":"10.1007\/s11517-008-0380-5"},{"key":"IJCINI.2020100104-45","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(12)60605-9"},{"key":"IJCINI.2020100104-46","unstructured":"Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition."},{"key":"IJCINI.2020100104-47","unstructured":"Skalic, M., Pekalski, M., & Pan, X. E. (2017). Deep learning methods for efficient large scale video labeling."},{"key":"IJCINI.2020100104-48","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-016-1318-9"},{"key":"IJCINI.2020100104-49","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-66179-7_12"},{"issue":"8","key":"IJCINI.2020100104-50","doi-asserted-by":"crossref","first-page":"1636","DOI":"10.1109\/TMI.2017.2687466","article-title":"Low dimensional representation of fisher vectors for microscopy image classification.","volume":"36","author":"Y.Song","year":"2017","journal-title":"IEEE Transactions on Medical Imaging"},{"issue":"1","key":"IJCINI.2020100104-51","first-page":"1929","article-title":"Dropout: A simple way to prevent neural networks from overfitting.","volume":"15","author":"N.Srivastava","year":"2014","journal-title":"Journal of Machine Learning Research"},{"key":"IJCINI.2020100104-52","first-page":"1","article-title":"Going deeper with convolutions.","author":"C.Szegedy","year":"2015","journal-title":"Proceedings of the IEEE conference on computer vision and pattern recognition"},{"journal-title":"Divide the gradient by a running average of its recent magnitude","year":"2017","author":"T.Tieleman","key":"IJCINI.2020100104-53"},{"key":"IJCINI.2020100104-54","doi-asserted-by":"crossref","unstructured":"Tosta, T. A. A., Neves, L. A., & do Nascimento, M. Z. (2017). Segmentation methods of H&E-stained histological images of lymphoma: a review. Informatics in medicine unlocked, 9, 35-43.","DOI":"10.1016\/j.imu.2017.05.009"},{"key":"IJCINI.2020100104-55","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-77538-8_4"},{"key":"IJCINI.2020100104-56","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., . . . Polosukhin, I. (2017). Attention is all you need. In Advances in neural information processing systems (pp. 5998-6008). Academic Press."},{"key":"IJCINI.2020100104-57","doi-asserted-by":"publisher","DOI":"10.1017\/S1431927615000379"},{"key":"IJCINI.2020100104-58","doi-asserted-by":"crossref","unstructured":"Wang, H., Cruz-Roa, A., Basavanhally, A., Gilmore, H., Shih, N., Feldman, M., . . . Madabhushi, A. (2014, March). Cascaded ensemble of convolutional neural networks and handcrafted features for mitosis detection. In Medical Imaging 2014: Digital Pathology (p. 90410B). International Society for Optics and Photonics.","DOI":"10.1117\/12.2043902"},{"key":"IJCINI.2020100104-59","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-42999-1_6"},{"key":"IJCINI.2020100104-60","doi-asserted-by":"crossref","unstructured":"Zeiler, M. D., & Fergus, R. (2014, September). Visualizing and understanding convolutional networks. In Proceedings of the European conference on computer vision (pp. 818-833). Springer.","DOI":"10.1007\/978-3-319-10590-1_53"},{"key":"IJCINI.2020100104-61","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2018.00716"}],"container-title":["International Journal of Cognitive Informatics and Natural Intelligence"],"original-title":[],"language":"ng","link":[{"URL":"https:\/\/www.igi-global.com\/viewtitle.aspx?TitleId=261773","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,16]],"date-time":"2022-11-16T01:02:54Z","timestamp":1668560574000},"score":1,"resource":{"primary":{"URL":"https:\/\/services.igi-global.com\/resolvedoi\/resolve.aspx?doi=10.4018\/IJCINI.2020100104"}},"subtitle":[""],"short-title":[],"issued":{"date-parts":[[2020,10,1]]},"references-count":62,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,10]]}},"URL":"https:\/\/doi.org\/10.4018\/ijcini.2020100104","relation":{},"ISSN":["1557-3958","1557-3966"],"issn-type":[{"type":"print","value":"1557-3958"},{"type":"electronic","value":"1557-3966"}],"subject":[],"published":{"date-parts":[[2020,10,1]]}}}