{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,17]],"date-time":"2026-06-17T02:24:38Z","timestamp":1781663078786,"version":"3.54.5"},"reference-count":39,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2015,6,11]],"date-time":"2015-06-11T00:00:00Z","timestamp":1433980800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Presenting a satisfactory and efficient training algorithm for artificial neural networks (ANN) has been a challenging task in the supervised learning area. Particle swarm optimization (PSO) is one of the most widely used algorithms due to its simplicity of implementation and fast convergence speed. On the other hand, Cuckoo Search (CS) algorithm has been proven to have a good ability for finding the global optimum; however, it has a slow convergence rate. In this study, a hybrid algorithm based on PSO and CS is proposed to make use of the advantages of both PSO and CS algorithms. The proposed hybrid algorithm is employed as a new training method for feedforward neural networks (FNNs). To investigate the performance of the proposed algorithm, two benchmark problems are used and the results are compared with those obtained from FNNs trained by original PSO and CS algorithms. The experimental results show that the proposed hybrid algorithm outperforms both PSO and CS in training FNNs.<\/jats:p>","DOI":"10.3390\/a8020292","type":"journal-article","created":{"date-parts":[[2015,6,11]],"date-time":"2015-06-11T10:44:59Z","timestamp":1434019499000},"page":"292-308","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":79,"title":["Training Artificial Neural Networks by a Hybrid PSO-CS Algorithm"],"prefix":"10.3390","volume":"8","author":[{"given":"Jeng-Fung","family":"Chen","sequence":"first","affiliation":[{"name":"Department of Industrial Engineering and Systems Management, Feng Chia University, Taichung 40724, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8937-5102","authenticated-orcid":false,"given":"Quang","family":"Do","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronic Engineering, University of Transport Technology, Hanoi 100000, Vietnam"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ho-Nien","family":"Hsieh","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering and Systems Management, Feng Chia University, Taichung 40724, Taiwan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2015,6,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1016\/j.eswa.2007.10.005","article-title":"Neural networks and statistical techniques: A review of applications","volume":"36","author":"Paliwal","year":"2009","journal-title":"Expert Syst. Appl."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1016\/j.engappai.2006.06.005","article-title":"Optimizing feedforward Artificial Neural Network Architecture","volume":"20","author":"Vosniakos","year":"2007","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/0893-6080(89)90003-8","article-title":"On the approximate realization of continuous mappings by neural networks","volume":"2","author":"Funahashi","year":"1989","journal-title":"Neural Netw."},{"key":"ref_4","unstructured":"Norgaard, M.R.O., Poulsen, N.K., and Hansen, L.K. (2000). Neural Networks for Modeling and Control of Dynamic Systems. A Practitioner\u2019s Handbook, Springer."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1457","DOI":"10.1016\/j.asoc.2010.04.017","article-title":"Clustered-hybrid multilayer perceptron network for pattern recognition application","volume":"11","year":"2011","journal-title":"Appl. Soft Comput."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1016\/0893-6080(89)90020-8","article-title":"Multilayer feedforward networks are universal approximators","volume":"2","author":"Homik","year":"1989","journal-title":"Neural Netw."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1016\/S0096-3003(96)00338-4","article-title":"Approximating polynomial functions by feedforward artificial neural network: Capacity analysis and design","volume":"90","author":"Malakooti","year":"1998","journal-title":"Appl. Math. Comput."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1109\/79.180705","article-title":"Progress in supervised neural networks","volume":"10","author":"Hush","year":"1993","journal-title":"IEEE Signal Proc. Mag."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"989","DOI":"10.1109\/72.329697","article-title":"Training feedforward networks with the Marquardt algorithm","volume":"5","author":"Hagar","year":"1994","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/0096-3003(94)90134-1","article-title":"An adaptive conjugate gradient learning algorithm for efficient training of neural networks","volume":"62","author":"Adeli","year":"1994","journal-title":"Appl. Math. Comput."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1016\/j.amc.2009.02.038","article-title":"An online gradient method with momentum for two-layer feedforward neural networks","volume":"212","author":"Zhang","year":"2009","journal-title":"Appl. Math. Comput."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1016\/S0305-0483(99)00027-4","article-title":"Comparing backpropagation with a genetic algorithm for neural network training","volume":"27","author":"Gupta","year":"1999","journal-title":"Omega"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"11125","DOI":"10.1016\/j.amc.2012.04.069","article-title":"Training feedforward neural networks using hybrid particle swarm optimization and gravitational search algorithm","volume":"218","author":"Mirjalili","year":"2012","journal-title":"Appl. Math. Comput."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1109\/34.107014","article-title":"On the problem of local minima in back-propagation","volume":"14","author":"Gori","year":"1992","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1026","DOI":"10.1016\/j.amc.2006.07.025","article-title":"A hybrid particle swarm optimization\u2013back-propagation algorithm for feedforward neural network training","volume":"185","author":"Zhang","year":"2007","journal-title":"Appl. Math. Comput."},{"key":"ref_16","unstructured":"Goldberg, E. (1989). Genetic Algorithms in Search, Optimization and Machine Learning, Addison Wesley."},{"key":"ref_17","unstructured":"Kennedy, J., and Eberhart, R.C. (December, January 27). Particle swarm optimization. Proceedings of the 1995 IEEE International Conference on Neural Networks, Perth, Australia."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1109\/3477.484436","article-title":"Ant system: Optimization by a colony of cooperating agents","volume":"26","author":"Dorigo","year":"1996","journal-title":"IEEE Trans. Syst. Man Cybernet."},{"key":"ref_19","unstructured":"Cells, M., and Rylander, B. (2002). Advances in Information Science and Soft Computing, WSEAS Press."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Yang, X.S., and Deb, S. (2009, January 9\u201311). Cuckoo search via L\u00e9vy flights. Proceedings of the IEEE World Congress on Nature and Biologically Inspired Computing (NaBIC 2009), Coimbatore, India.","DOI":"10.1109\/NABIC.2009.5393690"},{"key":"ref_21","first-page":"330","article-title":"Engineering Optimisation by Cuckoo Search","volume":"1","author":"Yang","year":"2010","journal-title":"Int. J. Math. Model. Numer. Optim."},{"key":"ref_22","first-page":"36","article-title":"Improved Cuckoo Search Algorithm for Feedforward Neural Network Training","volume":"2","author":"Valian","year":"2009","journal-title":"Int. J. Artif. Intell. Appl."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1659","DOI":"10.1007\/s00521-013-1402-2","article-title":"Discrete cuckoo search algorithm for the travelling salesman problem","volume":"24","author":"Ouaarab","year":"2014","journal-title":"Neural Comput. Appl."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Zhou, Y., and Zheng, H. (2013). A novel complex valued Cuckoo Search algorithm. Sci. World J.","DOI":"10.1155\/2013\/597803"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2857","DOI":"10.1016\/j.asoc.2012.04.034","article-title":"A new optimization algorithm for single hidden layer feedforward neural networks","volume":"13","author":"Li","year":"2013","journal-title":"Appl. Soft Comput."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1448","DOI":"10.1016\/j.neunet.2009.05.013","article-title":"Evolutionary artificial neural networks by multi-dimensional particle swarm optimization","volume":"22","author":"Kiranyaz","year":"2009","journal-title":"Neural Netw."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Mirjalili, S., and Hashim, S.Z.M. (2010, January 3\u20135). A New Hybrid PSOGSA Algorithm for Function Optimization. Proceedings of the International Conference on Computer and Information Application (ICCIA 2010), Tianjin, China.","DOI":"10.1109\/ICCIA.2010.6141614"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2232","DOI":"10.1016\/j.ins.2009.03.004","article-title":"GSA: A Gravitational Search Algorithm","volume":"179","author":"Rashedi","year":"2009","journal-title":"Inf. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1016\/j.cageo.2011.12.011","article-title":"Transforming Geocentric Cartesian Coordinates to Geodetic Coordinates by Using Differential Search Algorithm","volume":"46","author":"Civicioglu","year":"2012","journal-title":"Comput. Geosci."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1016\/j.ins.2012.11.013","article-title":"Artificial cooperative search algorithm for numerical optimization problems","volume":"229","author":"Civicioglu","year":"2013","journal-title":"Inf. Sci."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1007\/s10462-011-9276-0","article-title":"A conceptual comparison of the cuckoo-search, particle swarm optimization, differential evolution and artificial bee colony algorithms","volume":"39","author":"Civicioglu","year":"2013","journal-title":"Artif. Intell. Rev."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"8121","DOI":"10.1016\/j.amc.2013.02.017","article-title":"Backtracking Search Optimization Algorithm for numerical optimization problems","volume":"219","author":"Civicioglu","year":"2013","journal-title":"Appl. Math. Comput."},{"key":"ref_33","unstructured":"Lai, X., and Zhang, M. (2009, January 8\u201311). An efficient ensemble of GA and PSO for real function optimization. Proceedings of 2nd IEEE International Conference on Computer Science and Information Technology, Beijing, China."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Esmin, A.A.A., Lambert-Torres, G., and Alvarenga, G.B. (2006, January 13\u201315). Hybrid Evolutionary Algorithm Based on PSO and GA mutation. Proceeding of the Sixth International Conference on Hybrid Intelligent Systems (HIS 06), Auckland, New Zealand.","DOI":"10.1109\/HIS.2006.264940"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Li, L., Xue, B., Niu, B., Tan, L., and Wang, J. (2007). A Novel PSO-DE-Based Hybrid Algorithm for Global Optimization. Lect. Notes Comput. Sci., 785\u2013793.","DOI":"10.1007\/978-3-540-72590-9_118"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Holden, N., and Freitas, A.A. (2008). A Hybrid PSO\/ACO Algorithm for Discovering Classification Rules in Data Mining. J. Artif. Evolut. Appl.","DOI":"10.1155\/2008\/316145"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1007\/978-3-642-28493-9_11","article-title":"A Hybrid CS\/PSO Algorithm for Global Optimization, Intelligent Information and Database Systems","volume":"7198","author":"Ghodrati","year":"2012","journal-title":"Lect. Notes Comput. Sci. Vol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1007\/s00521-013-1367-1","article-title":"Cuckoo Search: Recent Advances and Applications","volume":"24","author":"Yang","year":"2014","journal-title":"Neural Comput. Appl."},{"key":"ref_39","first-page":"402","article-title":"Overfitting in neural networks: Backpropagation, conjugate gradient, and early stopping","volume":"Volume 13","author":"Leen","year":"2000","journal-title":"Advances Neural Information Processing Systems"}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/8\/2\/292\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:47:48Z","timestamp":1760215668000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/8\/2\/292"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,6,11]]},"references-count":39,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2015,6]]}},"alternative-id":["a8020292"],"URL":"https:\/\/doi.org\/10.3390\/a8020292","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,6,11]]}}}