{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,8]],"date-time":"2026-03-08T06:34:14Z","timestamp":1772951654903,"version":"3.50.1"},"reference-count":29,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2021,4,20]],"date-time":"2021-04-20T00:00:00Z","timestamp":1618876800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Optimization seeks to find inputs for an objective function that result in a maximum or minimum. Optimization methods are divided into exact and approximate (algorithms). Several optimization algorithms imitate natural phenomena, laws of physics, and behavior of living organisms. Optimization based on algorithms is the challenge that underlies machine learning, from logistic regression to training neural networks for artificial intelligence. In this paper, a new algorithm called two-stage optimization (TSO) is proposed. The TSO algorithm updates population members in two steps at each iteration. For this purpose, a group of good population members is selected and then two members of this group are randomly used to update the position of each of them. This update is based on the first selected good member at the first stage, and on the second selected good member at the second stage. We describe the stages of the TSO algorithm and model them mathematically. Performance of the TSO algorithm is evaluated for twenty-three standard objective functions. In order to compare the optimization results of the TSO algorithm, eight other competing algorithms are considered, including genetic, gravitational search, grey wolf, marine predators, particle swarm, teaching-learning-based, tunicate swarm, and whale approaches. The numerical results show that the new algorithm is superior and more competitive in solving optimization problems when compared with other algorithms.<\/jats:p>","DOI":"10.3390\/e23040491","type":"journal-article","created":{"date-parts":[[2021,4,20]],"date-time":"2021-04-20T13:58:04Z","timestamp":1618927084000},"page":"491","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["A New Two-Stage Algorithm for Solving Optimization Problems"],"prefix":"10.3390","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3193-2444","authenticated-orcid":false,"given":"Sajjad Amiri","family":"Doumari","sequence":"first","affiliation":[{"name":"Department of Mathematics and Computer Science, Sirjan University of Technology, Sirjan, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6386-1455","authenticated-orcid":false,"given":"Hadi","family":"Givi","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Shahreza Campus, University of Isfahan, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8051-5976","authenticated-orcid":false,"given":"Mohammad","family":"Dehghani","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronics Engineering, Shiraz University of Technology, Shiraz, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zeinab","family":"Montazeri","sequence":"additional","affiliation":[{"name":"Department of Electrical and Electronics Engineering, Shiraz University of Technology, Shiraz, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4755-3270","authenticated-orcid":false,"given":"Victor","family":"Leiva","sequence":"additional","affiliation":[{"name":"School of Industrial Engineering, Pontificia Universidad Cat\u00f3lica de Valpara\u00edso, Valpara\u00edso 2362807, Chile"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5236-4592","authenticated-orcid":false,"given":"Josep M.","family":"Guerrero","sequence":"additional","affiliation":[{"name":"CROM Center for Research on Microgrids, Department of Energy Technology, Aalborg University, 9220 Aalborg, Denmark"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,4,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zelinka, I., Snasael, V., and Abraham, A. (2012). Handbook of Optimization: From Classical to Modern Approach, Springer.","DOI":"10.1007\/978-3-642-30504-7"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1770","DOI":"10.1109\/TSP.2007.909342","article-title":"Exact and approximate solutions of source localization problems","volume":"56","author":"Beck","year":"2008","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_3","first-page":"1","article-title":"A review of population-based meta-heuristic algorithms","volume":"5","author":"Beheshti","year":"2013","journal-title":"Int. J. Adv. Soft Comput. Appl."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Palacios, C.A., Reyes-Suarez, J.A., Bearzotti, L.A., Leiva, V., and Marchant, C. (2021). Knowledge discovery for higher education student retention based on data mining: Machine learning algorithms and case study in Chile. Entropy, 23.","DOI":"10.3390\/e23040485"},{"key":"ref_5","first-page":"101","article-title":"Random scanning algorithm for tracking curves in binary image sequences","volume":"2","author":"Kawamoto","year":"2008","journal-title":"Int. J. Intell. Comput. Med. Sci. Image Process."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"106926","DOI":"10.1016\/j.knosys.2021.106926","article-title":"SSC: A hybrid nature-inspired meta-heuristic optimization algorithm for engineering applications","volume":"222","author":"Dhiman","year":"2021","journal-title":"Knowl.-Based Syst."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Dehghani, M., Mardaneh, M., Malik, O.P., Guerrero, J.M., Sotelo, C., Sotelo, D., Nazari-Heris, M., Al-Haddad, K., and Ramirez-Mendoza, R.A. (2020). Genetic algorithm for energy commitment in a power system supplied by multiple energy carriers. Sustainability, 12.","DOI":"10.3390\/su122310053"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/TEVC.2010.2059031","article-title":"Differential evolution: A survey of the state-of-the-art","volume":"15","author":"Das","year":"2011","journal-title":"IEEE Trans. Evol. Comput."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1038\/scientificamerican0792-66","article-title":"Genetic algorithms","volume":"267","author":"Holland","year":"1992","journal-title":"Sci. Am."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1162\/106365600568257","article-title":"Architecture for an artificial immune system","volume":"8","author":"Hofmeyr","year":"2000","journal-title":"Evol. Comput."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"105723","DOI":"10.1016\/j.asoc.2019.105723","article-title":"Ludo game-based metaheuristics for global and engineering optimization","volume":"84","author":"Singh","year":"2019","journal-title":"Appl. Soft Comput."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"8313","DOI":"10.1007\/s00500-020-04820-z","article-title":"Improving decision-making efficiency of image game based on deep Q-learning","volume":"24","author":"Ji","year":"2020","journal-title":"Soft Comput."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.swevo.2011.02.002","article-title":"A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms","volume":"1","author":"Derrac","year":"2011","journal-title":"Swarm Evol. Comput."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ramirez-Figueroa, J.A., Martin-Barreiro, C., Nieto, A.B., Leiva, V., and Galindo, M.P. (2021). A new principal component analysis by particle swarm optimization with an environmental application for data science. Stoch. Environ. Res. Risk Assess.","DOI":"10.1007\/s00477-020-01961-3"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"106937","DOI":"10.1016\/j.knosys.2021.106937","article-title":"Hybrid firefly algorithm with grouping attraction for constrained optimization problem","volume":"220","author":"Cheng","year":"2021","journal-title":"Knowl. Based Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1016\/j.cad.2010.12.015","article-title":"Teaching\u2013learning-based optimization: A novel method for constrained mechanical design optimization problems","volume":"43","author":"Rao","year":"2011","journal-title":"Comput. Aided Des."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1016\/j.advengsoft.2013.12.007","article-title":"Grey wolf optimizer","volume":"69","author":"Mirjalili","year":"2014","journal-title":"Adv. Eng. Softw."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"113377","DOI":"10.1016\/j.eswa.2020.113377","article-title":"Marine predators algorithm: A nature-inspired metaheuristic","volume":"152","author":"Faramarzi","year":"2020","journal-title":"Expert Syst. Appl."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"103541","DOI":"10.1016\/j.engappai.2020.103541","article-title":"Tunicate swarm algorithm: A new bio-inspired based metaheuristic paradigm for global optimization","volume":"90","author":"Kaur","year":"2020","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.advengsoft.2016.01.008","article-title":"The whale optimization algorithm","volume":"95","author":"Mirjalili","year":"2016","journal-title":"Adv. Eng. Softw."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2232","DOI":"10.1016\/j.ins.2009.03.004","article-title":"GSA: A gravitational search algorithm","volume":"179","author":"Rashedi","year":"2009","journal-title":"Inf. Sci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"70","DOI":"10.20998\/2074-272X.2018.4.12","article-title":"Optimal utilization of electrical energy from power plants based on final energy consumption using gravitational search algorithm","volume":"4","author":"Montazeri","year":"2018","journal-title":"Electr. Eng. Electromech."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Dehghani, M., Montazeri, Z., Dehghani, A., Malik, O.P., Morales-Menendez, R., Dhiman, G., Nouri, N., Ehsanifar, A., Guerrero, J.M., and Ramirez-Mendoza, R.A. (2021). Binary spring search algorithm for solving various optimization problems. Appl. Sci., 11.","DOI":"10.3390\/app11031286"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"646","DOI":"10.1016\/j.future.2019.07.015","article-title":"Henry gas solubility optimization: A novel physics-based algorithm","volume":"101","author":"Hashim","year":"2019","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_25","unstructured":"Daniel, W.W. (1990). Applied Nonparametric Statistics, PWS-Kent Publisher."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Korosec, P., and Eftimov, T. (2020). Insights into exploration and exploitation power of optimization algorithm using DSCTool. Mathematics, 8.","DOI":"10.3390\/math8091474"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Givi, H., Dehghani, M., Montazeri, Z., Morales-Menendez, R., Ramirez-Mendoza, R.A., and Nouri, N. (2021). GBUO: \u201cThe good, the bad, and the ugly\u201d optimizer. Appl. Sci., 11.","DOI":"10.3390\/app11052042"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Kang, H., Bei, F., Shen, Y., Sun, X., and Chen, Q. (2021). A diversity model based on dimension entropy and its application to swarm intelligence algorithm. Entropy, 23.","DOI":"10.3390\/e23040397"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"113609","DOI":"10.1016\/j.cma.2020.113609","article-title":"The arithmetic optimization algorithm","volume":"376","author":"Abualigah","year":"2021","journal-title":"Comput. Methods Appl. Mech. Eng."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/4\/491\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:50:12Z","timestamp":1760161812000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/23\/4\/491"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,20]]},"references-count":29,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2021,4]]}},"alternative-id":["e23040491"],"URL":"https:\/\/doi.org\/10.3390\/e23040491","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,20]]}}}