{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,15]],"date-time":"2025-12-15T14:14:04Z","timestamp":1765808044448,"version":"build-2065373602"},"reference-count":49,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2022,5,6]],"date-time":"2022-05-06T00:00:00Z","timestamp":1651795200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Manually designing a convolutional neural network (CNN) is an important deep learning method for solving the problem of image classification. However, most of the existing CNN structure designs consume a significant amount of time and computing resources. Over the years, the demand for neural architecture search (NAS) methods has been on the rise. Therefore, we propose a novel deep architecture generation model based on Aquila optimization (AO) and a genetic algorithm (GA). The main contributions of this paper are as follows: Firstly, a new encoding strategy representing the CNN coding structure is proposed, so that the evolutionary computing algorithm can be combined with CNN. Secondly, a new mechanism for updating location is proposed, which incorporates three typical operators from GA cleverly into the model we have designed so that the model can find the optimal solution in the limited search space. Thirdly, the proposed method can deal with the variable-length CNN structure by adding skip connections. Fourthly, combining traditional CNN layers and residual blocks and introducing a grouping strategy provides greater possibilities for searching for the optimal CNN structure. Additionally, we use two notable datasets, consisting of the MNIST and CIFAR-10 datasets for model evaluation. The experimental results show that our proposed model has good results in terms of search accuracy and time.<\/jats:p>","DOI":"10.3390\/e24050656","type":"journal-article","created":{"date-parts":[[2022,5,6]],"date-time":"2022-05-06T14:49:38Z","timestamp":1651848578000},"page":"656","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Efficient Network Architecture Search Using Hybrid Optimizer"],"prefix":"10.3390","volume":"24","author":[{"given":"Ting-Ting","family":"Wang","sequence":"first","affiliation":[{"name":"College of Computer Science and Engineering, Shandong University of Science and Technology, Qingdao 266590, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2117-0618","authenticated-orcid":false,"given":"Shu-Chuan","family":"Chu","sequence":"additional","affiliation":[{"name":"College of Computer Science and Engineering, Shandong University of Science and Technology, Qingdao 266590, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5943-1070","authenticated-orcid":false,"given":"Chia-Cheng","family":"Hu","sequence":"additional","affiliation":[{"name":"College of Artificial Intelligence, Yango University, Fuzhou 350015, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Han-Dong","family":"Jia","sequence":"additional","affiliation":[{"name":"College of Computer Science and Engineering, Shandong University of Science and Technology, Qingdao 266590, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3128-9025","authenticated-orcid":false,"given":"Jeng-Shyang","family":"Pan","sequence":"additional","affiliation":[{"name":"College of Computer Science and Engineering, Shandong University of Science and Technology, Qingdao 266590, China"},{"name":"Department of Information Management, Chaoyang University of Technology, Taichung 41349, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,5,6]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"823","DOI":"10.1080\/01431160600746456","article-title":"A survey of image classification methods and techniques for improving classification performance","volume":"28","author":"Lu","year":"2007","journal-title":"Int. J. Remote Sens."},{"key":"ref_2","first-page":"1","article-title":"A deep learning and image recognition system for image recognition","volume":"3","author":"Huang","year":"2019","journal-title":"Data Sci. Pattern Recognit."},{"key":"ref_3","first-page":"226","article-title":"Design of Real-time Face Position Tracking and Gesture Recognition System based on Image Segmentation Algorithm","volume":"5","author":"Liao","year":"2020","journal-title":"J. Netw. Intell."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"544","DOI":"10.1136\/amiajnl-2011-000464","article-title":"Natural language processing: An introduction","volume":"18","author":"Nadkarni","year":"2011","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1055\/s-0038-1634681","article-title":"Natural language processing in medicine: An overview","volume":"35","author":"Spyns","year":"1996","journal-title":"Methods Inf. Med."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"LeCun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_7","unstructured":"Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). Imagenet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst., 25."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 7\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1162\/artl.2009.15.2.15202","article-title":"A hypercube-based encoding for evolving large-scale neural networks","volume":"15","author":"Stanley","year":"2009","journal-title":"Artif. Life"},{"key":"ref_10","unstructured":"Zoph, B., and Le, Q.V. (2016). Neural architecture search with reinforcement learning. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"107968","DOI":"10.1016\/j.knosys.2021.107968","article-title":"Self-attention neural architecture search for semantic image segmentation","volume":"239","author":"Fan","year":"2022","journal-title":"Knowl.-Based Syst."},{"key":"ref_12","unstructured":"Baker, B., Gupta, O., Naik, N., and Raskar, R. (2016). Designing neural network architectures using reinforcement learning. arXiv."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zoph, B., Vasudevan, V., Shlens, J., and Le, Q.V. (2018, January 18\u201322). Learning Transferable Architectures for Scalable Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake, UT, USA.","DOI":"10.1109\/CVPR.2018.00907"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"394","DOI":"10.1109\/TEVC.2019.2916183","article-title":"Evolving deep convolutional neural networks for image classification","volume":"24","author":"Sun","year":"2019","journal-title":"IEEE Trans. Evol. Comput."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, B., Sun, Y., Xue, B., and Zhang, M. (2018, January 8\u201313). Evolving deep convolutional neural networks by variable-length particle swarm optimization for image classification. Proceedings of the 2018 IEEE Congress on Evolutionary Computation (CEC), Rio de Janeiro, Brazil.","DOI":"10.1109\/CEC.2018.8477735"},{"key":"ref_16","unstructured":"Kennedy, J., and Eberhart, R. (December, January 27). Particle swarm optimization. Proceedings of the ICNN\u201995-International Conference on Neural Networks, Perth, WA, Australia."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"106939","DOI":"10.1016\/j.knosys.2021.106939","article-title":"Fuzzy Hierarchical Surrogate Assists Probabilistic Particle Swarm Optimization for expensive high dimensional problem","volume":"220","author":"Chu","year":"2021","journal-title":"Knowl.-Based Syst."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.ins.2012.10.012","article-title":"Diversity enhanced particle swarm optimization with neighborhood search","volume":"223","author":"Wang","year":"2013","journal-title":"Inf. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"62","DOI":"10.1016\/j.swevo.2019.05.010","article-title":"Particle swarm optimization of deep neural networks architectures for image classification","volume":"49","author":"Junior","year":"2019","journal-title":"Swarm Evol. Comput."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"14369","DOI":"10.1109\/ACCESS.2021.3052489","article-title":"Particle swarm optimization for automatically evolving convolutional neural networks for image classification","volume":"9","author":"Lawrence","year":"2021","journal-title":"IEEE Access"},{"key":"ref_21","unstructured":"Pham, H., Guan, M., Zoph, B., Le, Q., and Dean, J. (2018, January 10\u201315). Efficient neural architecture search via parameters sharing. Proceedings of the International Conference on Machine Learning, Stockholm, Sweden."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Li, C., Peng, J., Yuan, L., Wang, G., Liang, X., Lin, L., and Chang, X. (2020, January 13\u201319). Block-wisely supervised neural architecture search with knowledge distillation. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00206"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Fukushima, K., and Miyake, S. (1982). Neocognitron: A Self-Organizing Neural Network Model for a Mechanism of Visual Pattern Recognition. Competition and Cooperation in Neural Nets, Springer.","DOI":"10.1007\/978-3-642-46466-9_18"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"611","DOI":"10.1007\/s13244-018-0639-9","article-title":"Convolutional Neural Networks: An Overview and Application in Radiology","volume":"9","author":"Yamashita","year":"2018","journal-title":"Insights Into Imaging"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Liu, X., Li, J., Hu, C., and Pan, J.S. (2017, January 3\u20135). Deep convolutional neural networks-based age and gender classification with facial images. Proceedings of the 2017 First International Conference on Electronics Instrumentation & Information Systems (EIIS), Harbin, China.","DOI":"10.1109\/EIIS.2017.8298719"},{"key":"ref_26","first-page":"392","article-title":"Pose Measurement of Excavator Based on Convolutional Neural Network","volume":"6","author":"Shi","year":"2021","journal-title":"J. Netw. Intell."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Botalb, A., Moinuddin, M., Al-Saggaf, U., and Ali, S.S. (2018, January 13\u201314). Contrasting Convolutional Neural Network (CNN) with Multi-Layer Perceptron (MLP) for Big Data Analysis. Proceedings of the 2018 International Conference on Intelligent and Advanced System (ICIAS), Kuala Lumpur, Malaysia.","DOI":"10.1109\/ICIAS.2018.8540626"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Singh, G., and Sachan, M. (2014, January 18\u201320). Multi-layer perceptron (MLP) neural network technique for offline handwritten Gurmukhi character recognition. Proceedings of the 2014 IEEE International Conference on Computational Intelligence and Computing Research, Coimbatore, India.","DOI":"10.1109\/ICCIC.2014.7238334"},{"key":"ref_29","first-page":"71","article-title":"Complementary features combined in a MLP-based system to recognize handwritten devnagari character","volume":"2","author":"Arora","year":"2011","journal-title":"J. Inf. Hiding Multimed. Signal Process."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Mirjalili, S. (2019). Genetic algorithm. Evolutionary Algorithms and Neural Networks, Springer.","DOI":"10.1007\/978-3-319-93025-1"},{"key":"ref_31","first-page":"1111","article-title":"A Clustering Scheme for Wireless Sensor Networks based on Genetic Algorithm and Dominating Set","volume":"19","author":"Pan","year":"2018","journal-title":"J. Internet Technol."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"107250","DOI":"10.1016\/j.cie.2021.107250","article-title":"Aquila optimizer: A novel meta-heuristic optimization algorithm","volume":"157","author":"Abualigah","year":"2021","journal-title":"Comput. Ind. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Wang, S., Jia, H., Abualigah, L., Liu, Q., and Zheng, R. (2021). An Improved Hybrid Aquila Optimizer and Harris Hawks Algorithm for Solving Industrial Engineering Optimization Problems. Processes, 9.","DOI":"10.3390\/pr9091551"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/j.asoc.2014.06.034","article-title":"A novel particle swarm optimization algorithm with Levy flight","volume":"23","year":"2014","journal-title":"Appl. Soft Comput."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"106443","DOI":"10.1016\/j.asoc.2020.106443","article-title":"A parallel compact cuckoo search algorithm for three-dimensional path planning","volume":"94","author":"Song","year":"2020","journal-title":"Appl. Soft Comput."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1162\/neco.1989.1.4.541","article-title":"Backpropagation applied to handwritten zip code recognition","volume":"1","author":"LeCun","year":"1989","journal-title":"Neural Comput."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1109\/MSP.2012.2211477","article-title":"The MNIST Database of Handwritten Digit Images for Machine Learning Research [Best of the Web]","volume":"29","author":"Deng","year":"2012","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Abouelnaga, Y., Ali, O.S., Rady, H., and Moustafa, M. (2016, January 15\u201317). CIFAR-10: KNN-Based Ensemble of Classifiers. Proceedings of the 2016 International Conference on Computational Science and Computational Intelligence (CSCI), Las Vegas, NV, USA.","DOI":"10.1109\/CSCI.2016.0225"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"309","DOI":"10.3389\/fnins.2017.00309","article-title":"CIFAR10-DVS: An Event-Stream Dataset for Object Classification","volume":"11","author":"Li","year":"2017","journal-title":"Front. Neurosci."},{"key":"ref_40","unstructured":"Allen-Zhu, Z., and Li, Y. (2019, January 8\u201314). What Can ResNet Learn Efficiently, Going Beyond Kernels?. Proceedings of the 33rd International Conference on Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_41","unstructured":"Sabour, S., Frosst, N., and Hinton, G.E. (2017, January 4\u20139). Dynamic routing between capsules. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_42","unstructured":"Wan, L., Zeiler, M., Zhang, S., Le Cun, Y., and Fergus, R. (2013, January 17\u201319). Regularization of neural networks using dropconnect. Proceedings of the 30th International Conference on Machine Learning, Atlanta, GA, USA."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Xie, L., and Yuille, A. (2017, January 22\u201329). Genetic CNN. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.","DOI":"10.1109\/ICCV.2017.154"},{"key":"ref_44","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely Connected Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Miikkulainen, R., Liang, J., Meyerson, E., Rawal, A., Fink, D., Francon, O., Raju, B., Shahrzad, H., Navruzyan, A., and Duffy, N. (2019). Evolving deep neural networks. Artificial Intelligence in the Age of Neural Networks and Brain Computing, Elsevier.","DOI":"10.1016\/B978-0-12-815480-9.00015-3"},{"key":"ref_47","unstructured":"Real, E., Moore, S., Selle, A., Saxena, S., Suematsu, Y.L., Tan, J., Le, Q.V., and Kurakin, A. (2017, January 6\u201311). Large-Scale Evolution of Image Classifiers. Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia."},{"key":"ref_48","unstructured":"Shlens, J. (2014). A tutorial on principal component analysis. arXiv."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Wang, Y., Rong, Y., Pan, H., Liu, K., Hu, Y., Wu, F., Peng, W., Xue, X., and Chen, J. (2020). PCA Based Kernel Initialization for Convolutional Neural Networks. Data Mining and Big Data, Springer.","DOI":"10.1007\/978-981-15-7205-0_7"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/5\/656\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:07:19Z","timestamp":1760137639000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/5\/656"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,6]]},"references-count":49,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2022,5]]}},"alternative-id":["e24050656"],"URL":"https:\/\/doi.org\/10.3390\/e24050656","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2022,5,6]]}}}