{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,14]],"date-time":"2026-07-14T17:53:05Z","timestamp":1784051585118,"version":"3.55.0"},"reference-count":48,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2023,3,9]],"date-time":"2023-03-09T00:00:00Z","timestamp":1678320000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61603003"],"award-info":[{"award-number":["61603003"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In deeper layers, ResNet heavily depends on skip connections and Relu. Although skip connections have demonstrated their usefulness in networks, a major issue arises when the dimensions between layers are not consistent. In such cases, it is necessary to use techniques such as zero-padding or projection to match the dimensions between layers. These adjustments increase the complexity of the network architecture, resulting in an increase in parameter number and a rise in computational costs. Another problem is the vanishing gradient caused by utilizing Relu. In our model, after making appropriate adjustments to the inception blocks, we replace the deeper layers of ResNet with modified inception blocks and Relu with our non-monotonic activation function (NMAF). To reduce parameter number, we use symmetric factorization and 1\u00d71 convolutions. Utilizing these two techniques contributed to reducing the parameter number by around 6 M parameters, which has helped reduce the run time by 30 s\/epoch. Unlike Relu, NMAF addresses the deactivation problem of the non-positive number by activating the negative values and outputting small negative numbers instead of zero in Relu, which helped in enhancing the convergence speed and increasing the accuracy by 5%, 15%, and 5% for the non-noisy datasets, and 5%, 6%, 21% for non-noisy datasets.<\/jats:p>","DOI":"10.3390\/s23062976","type":"journal-article","created":{"date-parts":[[2023,3,10]],"date-time":"2023-03-10T02:05:54Z","timestamp":1678413954000},"page":"2976","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["A Novel Image Classification Method Based on Residual Network, Inception, and Proposed Activation Function"],"prefix":"10.3390","volume":"23","author":[{"given":"Ali Abdullah","family":"Yahya","sequence":"first","affiliation":[{"name":"School of Computer and Information, Anqing Normal University, Anqing 246011, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kui","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Computer and Information, Anqing Normal University, Anqing 246011, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1069-3993","authenticated-orcid":false,"given":"Ammar","family":"Hawbani","sequence":"additional","affiliation":[{"name":"School of Computer and Technology, University of Science and Technology of China, Hefei 230027, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yibin","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer and Information, Anqing Normal University, Anqing 246011, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ali Naser","family":"Hadi","sequence":"additional","affiliation":[{"name":"School of Computer and Information, Hefei University of Technology, Hefei 230009, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,3,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1109\/JSAC.2022.3221998","article-title":"Progressive deep Image compression for hybrid contexts of image classification and reconstruction","volume":"41","author":"Lei","year":"2022","journal-title":"IEEE J. Sel. Areas Commun."},{"key":"ref_2","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1109\/72.279181","article-title":"Learning long-term dependencies with gradient descent is difficult","volume":"5","author":"Bengio","year":"1994","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Girshick, R. (2015, January 7\u201313). Fast R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.169"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1285","DOI":"10.1109\/TMI.2016.2528162","article-title":"Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning","volume":"35","author":"Shin","year":"2016","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 1\u20135). Ablation-CAM: Visual explanations for deep convolutional network via gradient-free localization. Proceedings of the IEEE International Conference on Computer Vision, Snowmass, CO, USA.","DOI":"10.1109\/ICCV.2017.74"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Yahya, A.A., Tan, J., and Hu, M. (2021). A Novel handwritten digit classification system based on convolutional neural network approach. Sensors, 21.","DOI":"10.3390\/s21186273"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 11\u201314). Identity mappings in deep residual networks. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46493-0_38"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhang, X., and Saniie, J. (2022, January 10\u201313). Reinforcement learning based neural architecture search for flaw detection in intelligent ultrasonic imaging NDE system. Proceedings of the IEEE International Ultrasonics Symposium, Venice, Italy.","DOI":"10.1109\/IUS54386.2022.9957772"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1299","DOI":"10.1109\/TMI.2016.2535302","article-title":"Convolutional neural networks for medical image analysis: Full training or fine tuning?","volume":"35","author":"Tajbakhsh","year":"2016","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Lange, S., Ulbrich, F., and Goehring, D. (2016, January 19\u201322). Online vehicle detection using deep neural networks and lidar based preselected image patches. Proceedings of the IEEE Intelligent Vehicles Symposium, Gothenburg, Sweden.","DOI":"10.1109\/IVS.2016.7535503"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"104693","DOI":"10.1016\/j.micpro.2022.104693","article-title":"The IoT-based real-time image processing for animal recognition and classification using deep convolutional neural network (DCNN)","volume":"95","author":"Surya","year":"2022","journal-title":"Microprocess. Microsyst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"105807","DOI":"10.1016\/j.compbiomed.2022.105807","article-title":"Automatic eczema classification in clinical images based on hybrid deep neural network","volume":"147","author":"Rasheed","year":"2022","journal-title":"Comput. Biol. Med."},{"key":"ref_14","first-page":"1775","article-title":"Image-based soft drink type classification and dietary assessment system using deep convolutional neural network with transfer learning","volume":"34","author":"Hafiz","year":"2022","journal-title":"J. King Saud Univ.-Comput. Inf. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Han, L., Yu, C., Xiao, K., and Zhao, X. (2019). Anew method of mixed gas identification based on a convolutional neural network for time series classification. Sensors, 19.","DOI":"10.3390\/s19091960"},{"key":"ref_16","unstructured":"Glorot, X., and Bengio, Y. (2010, January 13\u201315). Understanding the difficulty of training deep feedforward neural networks. Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, Chia Laguna Resort, Sardinia, Italy."},{"key":"ref_17","unstructured":"Cal\u0131k, R.C., and Demirci, M.F. (November, January 28). Cifar-10 image classification with convolutional neural networks for embedded systems. Proceedings of the IEEE\/ACS 15th International Conference on Computer Systems and Applications (AICCSA), Aqaba, Jordan."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.neucom.2020.05.022","article-title":"More trainable inception-ResNet for face recognition","volume":"411","author":"Peng","year":"2022","journal-title":"Neurocomputing"},{"key":"ref_19","unstructured":"Lin1, M., Chen, Q., and Yan, S. (2013). Network In Network. arXiv."},{"key":"ref_20","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet classification with deep convolutional neural networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Maaten, L.V.D., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1016\/j.gltp.2021.08.027","article-title":"ResNet-50 vs VGG-19 vs training from scratch: A comparative analysis of the segmentation and classification of Pneumonia from chest X-ray images","volume":"2","author":"Ikechukwu","year":"2021","journal-title":"Glob. Trans. Proc."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"102313","DOI":"10.1016\/j.media.2021.102313","article-title":"ResGANet: Residual group attention network for medical image classification and segmentation","volume":"76","author":"Cheng","year":"2022","journal-title":"Med. Image Anal."},{"key":"ref_25","unstructured":"Sarwinda, D., Paradisa, R.H., Bustamam, A., and Anggia, P. (2020, January 19\u201320). Deep learning in image classification using residual network (ResNet) variants for detection of colorectal cancer. Proceedings of the 5th International Conference on Computer Science and Computational Intelligence, Bandung, West Jave, Indonesia."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Zoph, B., Vasudevan, V., Shlens, J., and Le, Q.V. (2018, January 18\u201323). Learning transferable architectures for scalable image recognition. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00907"},{"key":"ref_27","unstructured":"Zoph, B., and Le, Q.V. (2017, January 24\u201326). Neural architecture search with reinforcement learning. Proceedings of the International Conference on Learning Representations, Toulon, France."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7\u201312). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"ref_29","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (July, January 26). Rethinking the inception architecture for computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Ioffe, S., Vanhoucke, V., and Alemi, A.A. (2017, January 4\u20139). Inception-v4, inception-resnet and the impact of residual connections on learning. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.","DOI":"10.1609\/aaai.v31i1.11231"},{"key":"ref_31","unstructured":"Clevert, D.-A., Unterthiner, T., and Hochreiter, S. (2016, January 2\u20134). Fast and accurate deep network learning by exponential linear units (elus). Proceedings of the 4th International Conference on Learning Representations, San Juan, Puerto Rico."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"6232","DOI":"10.1109\/TGRS.2016.2584107","article-title":"Deep feature extraction and classification of hyperspectral images based on convolutional neural networks","volume":"54","author":"Chen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"3639","DOI":"10.1109\/TGRS.2016.2636241","article-title":"Deep recurrent neural networks for hyperspectral image classification","volume":"55","author":"Mou","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Nindam, S., Manmai, T., and Lee, H.J. (2022, January 19\u201320). Multi-label classification of Jasmine Rice germination using deep neural network. Proceedings of the 7th International Conference on Business and Industrial Research, Bangkok, Thailand.","DOI":"10.1109\/ICBIR54589.2022.9786383"},{"key":"ref_35","first-page":"103057","article-title":"Deep multi-task learning for malware image classification","volume":"64","author":"Bensaoud","year":"2022","journal-title":"J. Inf. Secur. Appl."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Zhong, Z., Li, J., Ma, L., Jiang, H., and Zhao, H. (2017, January 23\u201328). Deep residual networks for hyperspectral image classification. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Fort Worth, TX, USA.","DOI":"10.1109\/IGARSS.2017.8127330"},{"key":"ref_38","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient convolutional neural networks for mobile vision applications. arXiv."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Guo, Y., Dong, H., Song, F., Zhu, C., and Liu, J. (2018, January 27\u201329). Breast cancer histology image classification based on deep neural networks. Proceedings of the International Conference Image Analysis and Recognition, P\u00f3voa de Varzim, Portugal.","DOI":"10.1007\/978-3-319-93000-8_94"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"101678","DOI":"10.1016\/j.bspc.2019.101678","article-title":"Deep neural network with generative adversarial networks pre-training for brain tumor classification based on MR images","volume":"57","author":"Ghassemi","year":"2020","journal-title":"Biomed. Signal Process. Control."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Xie, S., Girshick, R., Doll\u00e1r, P., Tu, Z., and He, K. (2017, January 21\u201326). Aggregated residual transformations for deep neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.634"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"105392","DOI":"10.1016\/j.compbiomed.2022.105392","article-title":"Cervical cancer diagnosis based on modified uniform local ternary patterns and feed forward multilayer network optimized by genetic algorithm","volume":"144","author":"Ershad","year":"2022","journal-title":"Comput. Biol. Med."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Attallah, O. (2023). Cervical cancer diagnosis based on multi-domain features using deep learning enhanced by handcrafted descriptors. Appl. Sci., 13.","DOI":"10.3390\/app13031916"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"6111","DOI":"10.1007\/s00521-019-04097-w","article-title":"A transfer convolutional neural network for fault diagnosis based on ResNet-50","volume":"32","author":"Wen","year":"2020","journal-title":"Neural Comput. Appl."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Maniatopoulos, A., and Mitianoudis, N. (2021). Learnable leaky relu (LeLeLU): An alternative accuracy-optimized activation function. Information, 12.","DOI":"10.3390\/info12120513"},{"key":"ref_46","unstructured":"Ho-Phuoc, T. (2019). CIFAR10 to compare visual recognition performance between deep neural networks and humans. arXiv."},{"key":"ref_47","unstructured":"Doon, R., Rawat, T.K., and Gautam, S. (December, January 30). Cifar-10 classification using deep convolutional neural network. Proceedings of the IEEE Punecon, Pune, India."},{"key":"ref_48","unstructured":"Ramachandran, P., Zoph, B., and Le, Q.V. (May, January 30). Searching for activation functions. Proceedings of the ICLR 2018 Conference Blind Submission, Vancouver, BC, Canada."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/6\/2976\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:51:52Z","timestamp":1760122312000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/6\/2976"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,9]]},"references-count":48,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["s23062976"],"URL":"https:\/\/doi.org\/10.3390\/s23062976","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,9]]}}}