{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,24]],"date-time":"2026-04-24T15:02:18Z","timestamp":1777042938572,"version":"3.51.4"},"reference-count":23,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2021,8,13]],"date-time":"2021-08-13T00:00:00Z","timestamp":1628812800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Informatics"],"abstract":"<jats:p>Convolutional neural networks (CNNs) are widely used among the various deep learning techniques available because of their superior performance in the fields of computer vision and natural language processing. CNNs can effectively extract the locality and correlation of input data using structures in which convolutional layers are successively applied to the input data. In general, the performance of neural networks has improved as the depth of CNNs has increased. However, an increase in the depth of a CNN is not always accompanied by an increase in the accuracy of the neural network. This is because the gradient vanishing problem may arise, causing the weights of the weighted layers to fail to converge. Accordingly, the gradient flows of the VGGNet, ResNet, SENet, and DenseNet models were analyzed and compared in this study, and the reasons for the differences in the error rate performances of the models were derived.<\/jats:p>","DOI":"10.3390\/informatics8030053","type":"journal-article","created":{"date-parts":[[2021,8,13]],"date-time":"2021-08-13T09:22:38Z","timestamp":1628846558000},"page":"53","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":22,"title":["Performance Comparison of CNN Models Using Gradient Flow Analysis"],"prefix":"10.3390","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1720-0012","authenticated-orcid":false,"given":"Seol-Hyun","family":"Noh","sequence":"first","affiliation":[{"name":"Department of Statistical Data Science, ICT Convergence Engineering, Anyang University, Anyang 14028, Korea"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1016\/j.patcog.2017.10.013","article-title":"Recent advances in convolutional neural networks","volume":"77","author":"Gu","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s10462-018-9654-y","article-title":"A review on deep learning for recommender systems: Challenges and remedies","volume":"52","author":"Batmaz","year":"2019","journal-title":"Artif. Intell. Rev."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"105612","DOI":"10.1016\/j.asoc.2019.105612","article-title":"Network anomaly detection using channel boosted and residual learning based deep convolutional neural network","volume":"83","author":"Chouhan","year":"2019","journal-title":"Appl. Soft Comput."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1093\/jmicro\/dfz002","article-title":"Transfer learning based deep CNN for segmentation and detection of mitoses in breast cancer histopathological images","volume":"68","author":"Wahab","year":"2019","journal-title":"Microscopy"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"104457","DOI":"10.1016\/j.compbiomed.2021.104457","article-title":"Automated detection of coronary artery disease, myocardial infarction and congestive heart failure using GaborCNN model with ECG signals","volume":"134","author":"Jahmunah","year":"2021","journal-title":"Comput. Biol. Med."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"103999","DOI":"10.1016\/j.compbiomed.2020.103999","article-title":"Automated diagnostic tool for hypertension using convolutional neural network","volume":"126","author":"Soh","year":"2020","journal-title":"Comput. Biol. Med."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"94424","DOI":"10.1109\/ACCESS.2019.2926523","article-title":"Automatical detection Approach for Bioresorbable Vascular Scaffolds Using U-shape Convolutional Neural Network","volume":"7","author":"Zhou","year":"2019","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"39734","DOI":"10.1109\/ACCESS.2018.2855420","article-title":"Combining convolutional neural network and distance distribution matrix for identification of congestive heart failure","volume":"6","author":"Li","year":"2018","journal-title":"IEEE Access"},{"key":"ref_9","unstructured":"Canziani, A., Paszke, A., and Culurciello, E. (2016). An analysis of deep neural network models for practical applications. arXiv."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Lu, Z., Rallapalli, S., Chan, K.S., and La Porta, T. (2017, January 23\u201327). Modeling the resource requirements of convolutional neural networks on mobile devices. Proceedings of the 25th ACM international conference on Multimedia, Mountain View, CA, USA.","DOI":"10.1145\/3123266.3123389"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Hua, W., Zhou, Y., De Sa, C., Zhang, A., and Edward Suh, G. (2019, January 12\u201316). Boosting the performance of CNN accelerators with dynamic fine-grained channel gating. Proceedings of the 52nd Annual IEEE\/ACM International Symposium on Microarchitecture, Columbums, OH, USA.","DOI":"10.1145\/3352460.3358283"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/2200000006","article-title":"Learning deep architectures for AI","volume":"2","author":"Bengio","year":"2009","journal-title":"Found. Trends Mach. Learn."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1798","DOI":"10.1109\/TPAMI.2013.50","article-title":"Representation Learning: A review and new perspectives","volume":"35","author":"Bengio","year":"2013","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1016\/j.neunet.2014.09.003","article-title":"Deep learning in neural networks: An overview","volume":"61","author":"Schmidhuber","year":"2015","journal-title":"Neural Netw."},{"key":"ref_16","first-page":"1097","article-title":"ImageNet Classification with Deep Convolutional Neural Networks","volume":"25","author":"Krizhevsky","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_17","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very Deep Convolutional Networks for Large-Scale Image Recognition. arXiv."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely Connected Convolutional Networks. Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1109\/72.279181","article-title":"Learning long-term dependencies with gradient descent is difficult","volume":"5","author":"Bengio","year":"1994","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_21","first-page":"249","article-title":"Understanding the difficulty of training deep feedforward neural networks","volume":"9","author":"Glorot","year":"2010","journal-title":"Int. Conf. Artif. Intell. Stat."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Hu, J., Shen, L., and Sun, G. (2018, January 18\u201323). Squeeze-and-Excitation Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00745"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"322","DOI":"10.1109\/TNNLS.2020.2978577","article-title":"Statistical Loss and Analysis for Deep Learning in Hyperspectral Image Classification","volume":"32","author":"Gong","year":"2021","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."}],"container-title":["Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2227-9709\/8\/3\/53\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:45:41Z","timestamp":1760165141000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2227-9709\/8\/3\/53"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,13]]},"references-count":23,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2021,9]]}},"alternative-id":["informatics8030053"],"URL":"https:\/\/doi.org\/10.3390\/informatics8030053","relation":{},"ISSN":["2227-9709"],"issn-type":[{"value":"2227-9709","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,13]]}}}