{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T20:06:57Z","timestamp":1777147617706,"version":"3.51.4"},"reference-count":60,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,3,6]],"date-time":"2023-03-06T00:00:00Z","timestamp":1678060800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computation"],"abstract":"<jats:p>Convolutional neural networks (CNNs) are one of the main types of neural networks used for image recognition and classification. CNNs have several uses, some of which are object recognition, image processing, computer vision, and face recognition. Input for convolutional neural networks is provided through images. Convolutional neural networks are used to automatically learn a hierarchy of features that can then be utilized for classification, as opposed to manually creating features. In achieving this, a hierarchy of feature maps is constructed by iteratively convolving the input image with learned filters. Because of the hierarchical method, higher layers can learn more intricate features that are also distortion and translation invariant. The main goals of this study are to help academics understand where there are research gaps and to talk in-depth about CNN\u2019s building blocks, their roles, and other vital issues.<\/jats:p>","DOI":"10.3390\/computation11030052","type":"journal-article","created":{"date-parts":[[2023,3,6]],"date-time":"2023-03-06T04:29:58Z","timestamp":1678076998000},"page":"52","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":491,"title":["Theoretical Understanding of Convolutional Neural Network: Concepts, Architectures, Applications, Future Directions"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-9248-7423","authenticated-orcid":false,"given":"Mohammad Mustafa","family":"Taye","sequence":"first","affiliation":[{"name":"Data Science and Artificial Intelligence, Philadelphia University, Amman 19392, Jordan"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s42979-021-00592-x","article-title":"Machine Learning: Algorithms, Real-World Applications, and Research Directions","volume":"2","author":"Sarker","year":"2021","journal-title":"SN Comput. Sci."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Du, K.-L., and Swamy, M.N.S. (2019). Fundamentals of Machine Learning. Neural Netw. Stat. Learn., 21\u201363.","DOI":"10.1007\/978-1-4471-7452-3_2"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3212","DOI":"10.1109\/TNNLS.2018.2876865","article-title":"Object detection with deep learning: A review","volume":"30","author":"ZZhao","year":"2019","journal-title":"IEEE Trans. Neural Networks Learn. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Indrakumari, R., Poongodi, T., and Singh, K. (2021). Introduction to Deep Learning. EAI\/Springer Innov. Commun. Comput., 1\u201322.","DOI":"10.1007\/978-3-030-66519-7_1"},{"key":"ref_5","unstructured":"(2022, August 11). AI vs Machine Learning vs Deep Learning|Edureka. Available online: https:\/\/www.edureka.co\/blog\/ai-vs-machine-learning-vs-deep-learning\/."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"5981","DOI":"10.1109\/TNNLS.2018.2815435","article-title":"Low-complexity approximate convolutional neural networks","volume":"29","author":"Cintra","year":"2018","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1038\/nmeth.3707","article-title":"Deep learning","volume":"13","author":"Rusk","year":"2017","journal-title":"Nat. Methods"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"53040","DOI":"10.1109\/ACCESS.2019.2912200","article-title":"Review of deep learning algorithms and architectures","volume":"7","author":"Shrestha","year":"2019","journal-title":"IEEE Access"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1109\/TKDE.2020.2981333","article-title":"Deep Learning on Graphs: A Survey","volume":"34","author":"Zhang","year":"2022","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2021\/5548884","article-title":"The Understanding of Deep Learning: A Comprehensive Review","volume":"2021","author":"Mishra","year":"2021","journal-title":"Math. Probl. Eng."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"9375","DOI":"10.1109\/ACCESS.2017.2788044","article-title":"Deep Learning Applications in Medical Image Analysis","volume":"6","author":"Ker","year":"2017","journal-title":"IEEE Access"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1007\/s13748-019-00203-0","article-title":"Convolutional neural network: A review of models, methodologies, and applications to object detection","volume":"9","author":"Dhillon","year":"2019","journal-title":"Prog. Artif. Intell."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Li, Z., Liu, F., Yang, W., Peng, S., and Zhou, J. (2021). A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects. IEEE Trans. Neural Networks Learn. Syst., 1\u201321.","DOI":"10.1109\/TNNLS.2021.3132836"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"5455","DOI":"10.1007\/s10462-020-09825-6","article-title":"A survey of the recent architectures of deep convolutional neural networks","volume":"53","author":"Khan","year":"2020","journal-title":"Artif. Intell. Rev."},{"key":"ref_15","unstructured":"(2022, August 08). Introduction to Convolutional Neural Networks (CNNs)|The Most Popular Deep Learning architecture|by Louis Bouchard|What is Artificial Intelligence|Medium. Available online: https:\/\/medium.com\/what-is-artificial-intelligence\/introduction-to-convolutional-neural-networks-cnns-the-most-popular-deep-learning-architecture-b938f62f133f."},{"key":"ref_16","unstructured":"Koushik, J. (2022, August 13). Understanding Convolutional Neural Networks. Available online: http:\/\/arxiv.org\/abs\/1605.09081."},{"key":"ref_17","unstructured":"Bezdan, T., and D\u017eakula, N.B. (2019). International Scientific Conference on Information Technology and Data Related Research, Singidunum University."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Zhang, J., Huang, J., Chen, X., and Zhang, D. (2019, January 27\u201328). How to fully exploit the abilities of aerial image detectors. Proceedings of the IEEE International Conference on Computer Vision Workshops 2019, Seoul, Republic of Korea.","DOI":"10.1109\/ICCVW.2019.00007"},{"key":"ref_19","unstructured":"Rodriguez, R., Gonzalez, C.I., Martinez, G.E., and Melin, P. (2021). Fuzzy Logic Hybrid Extensions of Neural and Optimization Algorithms: Theory and Applications, Springer."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/s10462-018-9654-y","article-title":"A review on deep learning for recommender systems: Challenges and remedies","volume":"52","author":"Batmaz","year":"2019","journal-title":"Artif. Intell. Rev."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1186\/s40537-017-0101-8","article-title":"Understanding deep learning via back-tracking and deconvolution","volume":"4","author":"Fang","year":"2017","journal-title":"J. Big Data"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1186\/s40537-021-00444-8","article-title":"Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions","volume":"8","author":"Alzubaidi","year":"2021","journal-title":"J. Big Data"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Du, K.L., and Swamy, M.N.S. (2019). Neural Networks and Statistical Learning, Springer. [2nd ed.].","DOI":"10.1007\/978-1-4471-7452-3"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.neucom.2018.09.038","article-title":"Recent advances in convolutional neural network acceleration","volume":"323","author":"Zhang","year":"2019","journal-title":"Neurocomputing"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Bhatt, D., Patel, C., Talsania, H., Patel, J., Vaghela, R., Pandya, S., Modi, K., and Ghayvat, H. (2021). CNN variants for computer vision: History, architecture, application, challenges and future scope. Electronics, 10.","DOI":"10.3390\/electronics10202470"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Prakash, K.B., Kannan, R., Alexander, S.A., and Kanagachidambaresan, G.R. (2021). Advanced Deep Learning for Engineers and Scientists: A Practical Approach, Springer.","DOI":"10.1007\/978-3-030-66519-7"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Goyal, P., Girshick, R., He, K., and Doll\u00e1r, P. (2017). Focal loss for dense object detection. arXiv.","DOI":"10.1109\/ICCV.2017.324"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhang, S., Wen, L., Bian, X., Lei, Z., and Li, S. (2018, January 18\u201323). Single-shot refinement neural network for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2018, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00442"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Hsieh, M.-R., Lin, Y.-L., and Hsu, W. (2017, January 22\u201329). Drone-based object counting by spatially regularized regional proposal network. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.446"},{"key":"ref_31","unstructured":"Yang, F., Fan, H., Chu, P., Blasch, E., and Ling, H. (2019). Proceedings of the IEEE International Conference on Computer Vision 2019, IEEE."},{"key":"ref_32","unstructured":"Zhou, X., Wang, D., and Kr\u00e4henb\u00fchl, P. (2019). Objects as points. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Kong, T., Sun, F., Liu, H., Jiang, Y., and Shi, J. (2019). Foveabox: Beyond anchor-based object detector. arXiv.","DOI":"10.1109\/TIP.2020.3002345"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Lin, T.-Y., Doll\u00e1r, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21\u201326). Feature Pyramid networks for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2017, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.106"},{"key":"ref_35","unstructured":"Ghiasi, G., Lin, T.-Y., and Le, Q. Proceedings of the 32nd International Conference on Neural Information Processing Systems, Curran Associates Inc."},{"key":"ref_36","unstructured":"M\u00fcller, R., Kornblith, S., and Hinton, G. (2019). Advances in Neural Information Processing Systems 2019, Neural Information Processing Systems Foundation, Inc. (NeurIPS)."},{"key":"ref_37","unstructured":"Doll\u00e1r, K., and Girshick, R. (2017, January 22\u201329). Mask R-CNN. Proceedings of the IEEE International Conference on Computer Vision 2017, Venice, Italy."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Cai, Z., and Vasconcelos, N. (2018, January 18\u201323). Cascade r-cnn: Delving into high quality object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2018, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00644"},{"key":"ref_39","unstructured":"Duan, K., Bai, S., Xie, L., Qi, H., Huang, Q., and Tian, Q. (2019). Proceedings of the IEEE International Conference on Computer Vision 2019, IEEE."},{"key":"ref_40","unstructured":"Li, Z., Peng, C., Yu, G., Zhang, X., Deng, Y., and Sun, J. (2017). Light-head r-cnn: In defense of twostage object detector. arXiv."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep Learning with Depthwise Separable Convolutions. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Law, H., and Deng, J. (2018, January 8\u201314). Cornernet: Detecting objects as paired keypoints. Proceedings of the European Conference on Computer Vision (ECCV) 2018, Munich, Germany.","DOI":"10.1007\/978-3-030-01264-9_45"},{"key":"ref_43","unstructured":"Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv."},{"key":"ref_44","first-page":"953","article-title":"CNN Architectures: Alex Net, Le Net, VGG, Google Net, Res Net","volume":"8","author":"Swapna","year":"2020","journal-title":"Int. J. Recent Technol. Eng."},{"key":"ref_45","unstructured":"Bochkovskiy, A., Wang, C.-Y., and Liao, H.-Y. (2020). YOLOv4: Optimal speed and accuracy of object detection. arXiv."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Wang, C.-Y., Liao, H.-Y., Yeh, I.-H., Wu, Y.-H., Chen, P.-Y., and Hsieh, J.-W. (2019). CSPNet: A new backbone that can enhance learning capability of CNN. arXiv.","DOI":"10.1109\/CVPRW50498.2020.00203"},{"key":"ref_47","unstructured":"Yun, S., Han, D., Oh, S., Chun, S., Choe, J., and Yoo, Y. (2019). Proceedings of the IEEE International Conference on Computer Vision 2019, IEEE."},{"key":"ref_48","unstructured":"Fu, C.-Y., Liu, W., Ranga, A., Tyagi, A., and Berg, A. (2017). DSSD: Deconvolutional single shot detector. arXiv."},{"key":"ref_49","unstructured":"Law, H., Teng, Y., Russakovsky, O., and Deng, J. (2019). Cornernet-lite: Efficient keypoint based object detection. arXiv."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1109\/LGRS.2017.2778181","article-title":"Semantic segmentation of aerial images with shuffling convolutional neural networks","volume":"15","author":"Chen","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_51","unstructured":"Pailla, D. (2019). Proceedings of the IEEE\/CVF International Conference on Computer Vision Workshops 2019, IEEE."},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Terrail, J.D., and Jurie, F. (2017, January 17\u201320). On the use of deep neural networks for the detection of small vehicles in ortho-images. Proceedings of the 2017 IEEE International Conference on Image Processing (ICIP 2017), Beijing, China.","DOI":"10.1109\/ICIP.2017.8297076"},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Shen, J., and Shafiq, M.O. (2018, January 17\u201320). Deep Learning Convolutional Neural Networks with Dropout\u2014A Parallel Approach. Proceedings of the 17th IEEE International Conference on Machine Learning and Applications, ICMLA 2018, Orlando, FL, USA.","DOI":"10.1109\/ICMLA.2018.00092"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"23729","DOI":"10.1007\/s11042-020-08976-6","article-title":"A review of object detection based on deep learning","volume":"79","author":"Xiao","year":"2020","journal-title":"Multimed. Tools Appl."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"117583","DOI":"10.1016\/j.eswa.2022.117583","article-title":"Impact of activation functions and number of layers on detection of exudates using circular Hough transform and convolutional neural networks","volume":"203","author":"Adem","year":"2022","journal-title":"Expert. Syst. Appl."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_57","unstructured":"Nwankpa, C., Ijomah, W., Gachagan, A., and Marshall, S. (2018). Activation Functions: Comparison of trends in Practice and Research for Deep Learning. arXiv."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Zhang, Z. (2018, January 4\u20136). Improved Adam Optimizer for Deep Neural Networks. Proceedings of the 2018 IEEE\/ACM 26th International Symposium on Quality of Service (IWQoS), Banff, AB, Canada.","DOI":"10.1109\/IWQoS.2018.8624183"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1016\/j.apenergy.2017.01.003","article-title":"A GPU deep learning metaheuristic based model for time series forecasting","volume":"201","author":"Coelho","year":"2017","journal-title":"Appl. Energy"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"164229","DOI":"10.1109\/ACCESS.2019.2945338","article-title":"Understanding edge computing: Engineering evolution with artificial intelligence","volume":"7","author":"Huh","year":"2019","journal-title":"IEEE Access"}],"container-title":["Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-3197\/11\/3\/52\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:48:43Z","timestamp":1760122123000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-3197\/11\/3\/52"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,6]]},"references-count":60,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["computation11030052"],"URL":"https:\/\/doi.org\/10.3390\/computation11030052","relation":{},"ISSN":["2079-3197"],"issn-type":[{"value":"2079-3197","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,6]]}}}