{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T16:37:07Z","timestamp":1771519027243,"version":"3.50.1"},"reference-count":84,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2024,12,30]],"date-time":"2024-12-30T00:00:00Z","timestamp":1735516800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Ningxia Natural Science Foundation","award":["2022AAC02043"],"award-info":[{"award-number":["2022AAC02043"]}]},{"name":"Ningxia Natural Science Foundation","award":["NXYLXK2017B09"],"award-info":[{"award-number":["NXYLXK2017B09"]}]},{"name":"Ningxia Natural Science Foundation","award":["YCX24077"],"award-info":[{"award-number":["YCX24077"]}]},{"name":"Ningxia Natural Science Foundation","award":["NJZQJCXK202201"],"award-info":[{"award-number":["NJZQJCXK202201"]}]},{"name":"Ningxia Higher Education","award":["2022AAC02043"],"award-info":[{"award-number":["2022AAC02043"]}]},{"name":"Ningxia Higher Education","award":["NXYLXK2017B09"],"award-info":[{"award-number":["NXYLXK2017B09"]}]},{"name":"Ningxia Higher Education","award":["YCX24077"],"award-info":[{"award-number":["YCX24077"]}]},{"name":"Ningxia Higher Education","award":["NJZQJCXK202201"],"award-info":[{"award-number":["NJZQJCXK202201"]}]},{"name":"North Minzu University","award":["2022AAC02043"],"award-info":[{"award-number":["2022AAC02043"]}]},{"name":"North Minzu University","award":["NXYLXK2017B09"],"award-info":[{"award-number":["NXYLXK2017B09"]}]},{"name":"North Minzu University","award":["YCX24077"],"award-info":[{"award-number":["YCX24077"]}]},{"name":"North Minzu University","award":["NJZQJCXK202201"],"award-info":[{"award-number":["NJZQJCXK202201"]}]},{"name":"Nanjing Securities","award":["2022AAC02043"],"award-info":[{"award-number":["2022AAC02043"]}]},{"name":"Nanjing Securities","award":["NXYLXK2017B09"],"award-info":[{"award-number":["NXYLXK2017B09"]}]},{"name":"Nanjing Securities","award":["YCX24077"],"award-info":[{"award-number":["YCX24077"]}]},{"name":"Nanjing Securities","award":["NJZQJCXK202201"],"award-info":[{"award-number":["NJZQJCXK202201"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>The grey wolf optimization (GWO) algorithm is a simple and effective meta-heuristic algorithm that mimics the leadership of grey wolves and the social behavior of wolves in nature. However, the updating of GWO population positions only relies on the guidance of \u03b1-wolf, \u03b2-wolf, and \u03b4-wolf, and individuals are updated with equal weights. This results in the GWO search process being unable to utilize the knowledge of superior wolves better. Therefore, in this study, we propose for the first time an attention mechanism-based GWO (AtGWO). Firstly, when each position is updated, the attention strategy can adaptively assign the weight of the corresponding leader wolf to improve the global exploration ability. Second, with the introduction of omega-wolves, each position update is not only guided by the three leader wolves but also learns from their current optimal values. Finally, a hyperbolic tangent nonlinear function is used to control the convergence factor to better balance exploration and exploitation. To validate its effectiveness, AtGWO is compared with the latest GWO variant with other popular algorithms on the CEC-2014 (dim 30, 50) and CEC-2017 (dim 30, 50, 100) benchmark function sets. The experimental results indicate that AtGWO outperforms the GWO-related variants almost all the time in terms of mean, variance, and best value, which indicates its superior ability and robustness to find optimal solutions. And it is also competitive when compared to other algorithms in multimodal functions. AtGWO outperforms the comparison algorithms in terms of the mean and best value in six real-world engineering optimization problems.<\/jats:p>","DOI":"10.3390\/sym17010050","type":"journal-article","created":{"date-parts":[[2024,12,31]],"date-time":"2024-12-31T14:21:12Z","timestamp":1735654872000},"page":"50","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["An Improved Grey Wolf Optimizer Based on Attention Mechanism for Solving Engineering Design Problems"],"prefix":"10.3390","volume":"17","author":[{"given":"Yuming","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Mathematics and Information Science, North Minzu University, Yinchuan 750021, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2021-2097","authenticated-orcid":false,"given":"Yuelin","family":"Gao","sequence":"additional","affiliation":[{"name":"School of Mathematics and Information Science, North Minzu University, Yinchuan 750021, China"},{"name":"Ningxia Scientific Computing and Intelligent Information Processing Co-Innovation Center, North Minzu University, Yinchuan 750021, China"},{"name":"Ningxia Key Laboratory of Intelligent Information and Big Data Processing, North Minzu University, Yinchuan 750021, China"}]},{"given":"Liming","family":"Huang","sequence":"additional","affiliation":[{"name":"Business School, North Minzu University, Yinchuan 750021, China"}]},{"given":"Xiaofeng","family":"Xie","sequence":"additional","affiliation":[{"name":"School of Mathematics and Information Science, North Minzu University, Yinchuan 750021, China"}]}],"member":"1968","published-online":{"date-parts":[[2024,12,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Fan, Q., Huang, H., Li, Y., Han, Z., Hu, Y., and Huang, D. (2021). Beetle antenna strategy based grey wolf optimization. Expert Syst. Appl., 165.","DOI":"10.1016\/j.eswa.2020.113882"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ma, C., Huang, H., Fan, Q., Wei, J., Du, Y., and Gao, W. (2022). Grey wolf optimizer based on Aquila exploration method. Expert Syst. Appl., 205.","DOI":"10.1016\/j.eswa.2022.117629"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Sulaiman, M.H., Mustaffa, Z., Saari, M.M., and Daniyal, H. (2020). Barnacles mating optimizer: A new bio-inspired algorithm for solving engineering optimization problems. Eng. Appl. Artif. Intell., 87.","DOI":"10.1016\/j.engappai.2019.103330"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.future.2018.03.020","article-title":"A hybrid whale optimization algorithm based on local search strategy for the permutation flow shop scheduling problem","volume":"85","author":"Manogaran","year":"2018","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1004","DOI":"10.1007\/s40565-017-0369-x","article-title":"Economic optimization on two time scales for a hybrid energy system based on virtual storage","volume":"6","author":"Yang","year":"2018","journal-title":"J. Mod. Power Syst. Clean Energy"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1016\/j.neucom.2015.06.083","article-title":"Binary grey wolf optimization approaches for feature selection","volume":"172","author":"Emary","year":"2016","journal-title":"Neurocomputing"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.eswa.2017.04.019","article-title":"A novel bacterial foraging optimization algorithm for feature selection","volume":"83","author":"Chen","year":"2017","journal-title":"Expert Syst. Appl."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1016\/j.neucom.2018.05.002","article-title":"A novel optimized SVM classification algorithm with multi-domain feature and its application to fault diagnosis of rolling bearing","volume":"313","author":"Yan","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_9","first-page":"2100","article-title":"Design of gray wolf optimizer algorithm-based fractional order PI controller for power factor correction in SMPS applications","volume":"35","author":"Komathi","year":"2019","journal-title":"IEEE Trans. Power Electron."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1042","DOI":"10.2991\/ijcis.d.210309.001","article-title":"Slime mould algorithm-based tuning of cost-effective fuzzy controllers for servo systems","volume":"14","author":"Precup","year":"2021","journal-title":"Int. J. Comput. Intell. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1177\/1063293X15600894","article-title":"Interaction balance optimization in multidisciplinary design optimization problems","volume":"24","author":"Meng","year":"2016","journal-title":"Concurr. Eng."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"3545","DOI":"10.3233\/JIFS-191873","article-title":"Generalized type-2 fuzzy logic in galactic swarm optimization: Design of an optimal ball and beam fuzzy controller","volume":"39","author":"Bernal","year":"2020","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3229","DOI":"10.3233\/JIFS-191198","article-title":"Comparison of particle swarm optimization variants with fuzzy dynamic parameter adaptation for modular granular neural networks for human recognition","volume":"38","author":"Melin","year":"2020","journal-title":"J. Intell. Fuzzy Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/j.ins.2012.02.011","article-title":"Niching particle swarm optimization with local search for multi-modal optimization","volume":"197","author":"Qu","year":"2012","journal-title":"Inf. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Ahmed, R., Mahadzir, S., Rozali, N.E.M., Biswas, K., Matovu, F., and Ahmed, K. (2021). Artificial intelligence techniques in refrigeration system modelling and optimization: A multi-disciplinary review. Sust. Energy Technol. Assess., 47.","DOI":"10.1016\/j.seta.2021.101488"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Matovu, F., Mahadzir, S., Ahmed, R., and Rozali, N.E.M. (2022). Synthesis and optimization of multilevel refrigeration systems using generalized disjunctive programming. Comput. Chem. Eng., 163.","DOI":"10.1016\/j.compchemeng.2022.107856"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1016\/j.asoc.2014.12.026","article-title":"Dynamic multi-swarm particle swarm optimizer with cooperative learning strategy","volume":"29","author":"Xu","year":"2015","journal-title":"Appl. Soft Comput."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"330","DOI":"10.1016\/j.asoc.2018.09.027","article-title":"Repository and mutation based particle swarm optimization (RMPSO): A new PSO variant applied to reconstruction of gene regulatory network","volume":"74","author":"Jana","year":"2019","journal-title":"Appl. Soft Comput."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1038\/scientificamerican0792-66","article-title":"Genetic algorithms","volume":"267","author":"Holland","year":"1992","journal-title":"Sci. Am."},{"key":"ref_20","unstructured":"Storn, R., and Price, K. (1996, January 20\u201322). Minimizing the real functions of the ICEC\u201996 contest by differential evolution. Proceedings of the IEEE International Conference on Evolutionary Computation, Nagoya, Japan."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1109\/MCI.2006.329691","article-title":"Ant colony optimization","volume":"1","author":"Dorigo","year":"2006","journal-title":"IEEE Comput. Intell. Mag."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1942","DOI":"10.1109\/ICNN.1995.488968","article-title":"Particle swarm optimization","volume":"4","author":"Kennedy","year":"1995","journal-title":"Proc. IEEE Int. Conf. Neural Netw."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"671","DOI":"10.1126\/science.220.4598.671","article-title":"Optimization by simulated annealing","volume":"220","author":"Kirkpatrick","year":"1983","journal-title":"Science"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Ahmed, R., Rangaiah, G.P., Mahadzir, S., Mirjalili, S., Hassan, M.H., and Kamel, S. (2023). Memory, evolutionary operator, and local search based improved Grey Wolf Optimizer with linear population size reduction technique. Knowl.-Based Syst., 264.","DOI":"10.1016\/j.knosys.2023.110297"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1109\/4235.771163","article-title":"Evolutionary programming made faster","volume":"3","author":"Yao","year":"1999","journal-title":"IEEE Trans. Evol. Comput."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Dhargupta, S., Ghosh, M., Mirjalili, S., and Sarkar, R. (2020). Selective opposition based grey wolf optimization. Expert Syst. Appl., 151.","DOI":"10.1016\/j.eswa.2020.113389"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1016\/j.knosys.2015.12.022","article-title":"SCA: A sine cosine algorithm for solving optimization problems","volume":"96","author":"Mirjalili","year":"2016","journal-title":"Knowl.-Based Syst."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2232","DOI":"10.1016\/j.ins.2009.03.004","article-title":"GSA: A gravitational search algorithm","volume":"179","author":"Rashedi","year":"2009","journal-title":"Inf. Sci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1016\/j.compstruc.2012.09.003","article-title":"A new meta-heuristic method: Ray optimization","volume":"112","author":"Kaveh","year":"2012","journal-title":"Comput. Struct."},{"key":"ref_30","first-page":"108","article-title":"A comparative study of artificial bee colony algorithm","volume":"214","author":"Karaboga","year":"2009","journal-title":"Appl. Math. Comput."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1016\/j.advengsoft.2013.12.007","article-title":"Grey wolf optimizer","volume":"69","author":"Mirjalili","year":"2014","journal-title":"Adv. Eng. Softw."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Mirrashid, M., and Naderpour, H. (2022). Transit search: An optimization algorithm based on exoplanet exploration. Results Control Optim., 7.","DOI":"10.1016\/j.rico.2022.100127"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Bai, J., Li, Y., Zheng, M., Khatir, S., Benaissa, B., Abualigah, L., and Wahab, M.A. (2023). A sinh cosh optimizer. Knowl.-Based Syst., 282.","DOI":"10.1016\/j.knosys.2023.111081"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Zhong, C., Li, G., and Meng, Z. (2022). Beluga whale optimization: A novel nature-inspired metaheuristic algorithm. Knowl.-Based Syst., 251.","DOI":"10.1016\/j.knosys.2022.109215"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Nadimi-Shahraki, M.H., Zamani, H., and Mirjalili, S. (2022). Enhanced whale optimization algorithm for medical feature selection: A COVID-19 case study. Comput. Biol. Med., 148.","DOI":"10.1016\/j.compbiomed.2022.105858"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"945","DOI":"10.1109\/TEVC.2009.2014613","article-title":"JADE: Adaptive differential evolution with optional external archive","volume":"13","author":"Zhang","year":"2009","journal-title":"IEEE Trans. Evol. Comput."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1880","DOI":"10.1007\/s10489-018-1370-4","article-title":"An improved genetic algorithm for numerical function optimization","volume":"49","author":"Song","year":"2019","journal-title":"Appl. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Abdel-Basset, M., Abdel-Fatah, L., and Sangaiah, A.K. (2018). Metaheuristic algorithms: A comprehensive review. Comput. Intell. Multimed. Big Data Cloud Eng. Appl., 185\u2013231.","DOI":"10.1016\/B978-0-12-813314-9.00010-4"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1016\/j.knosys.2019.01.018","article-title":"The defect of the Grey Wolf optimization algorithm and its verification method","volume":"171","author":"Niu","year":"2019","journal-title":"Knowl.-Based Syst."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Be\u015fkirli, A., and Da\u011f, \u0130. (2023). I-CPA: An Improved Carnivorous Plant Algorithm for Solar Photovoltaic Parameter Identification Problem. Biomimetics, 8.","DOI":"10.3390\/biomimetics8080569"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Be\u015fkirli, A., Da\u011f, \u0130., and Kiran, M.S. (2024). A tree seed algorithm with multi-strategy for parameter estimation of solar photovoltaic models. Appl. Soft Comput., 167.","DOI":"10.1016\/j.asoc.2024.112220"},{"key":"ref_42","first-page":"323","article-title":"A comprehensive survey on grey wolf optimization","volume":"15","author":"Sharma","year":"2022","journal-title":"Recent Adv. Comput. Sci. Commun. Former. Recent Patents Comput. Sci."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s13198-020-00995-8","article-title":"GWO: A review and applications","volume":"12","author":"Negi","year":"2021","journal-title":"Int. J. Syst. Assur. Eng. Manag."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"150","DOI":"10.1007\/s10489-014-0645-7","article-title":"How effective is the Grey Wolf optimizer in training multi-layer perceptrons","volume":"43","author":"Mirjalili","year":"2015","journal-title":"Appl. Intell."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"78012","DOI":"10.1109\/ACCESS.2019.2921793","article-title":"Hierarchy strengthened grey wolf optimizer for numerical optimization and feature selection","volume":"7","author":"Tu","year":"2019","journal-title":"IEEE Access"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1016\/j.apenergy.2018.02.070","article-title":"A novel combined model based on advanced optimization algorithm for short-term wind speed forecasting","volume":"215","author":"Song","year":"2018","journal-title":"Appl. Energy"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"630","DOI":"10.1016\/j.energy.2016.05.105","article-title":"Economic dispatch using hybrid grey wolf optimizer","volume":"111","author":"Jayabarathi","year":"2016","journal-title":"Energy"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1257","DOI":"10.1007\/s00521-014-1806-7","article-title":"Evolutionary population dynamics and grey wolf optimizer","volume":"26","author":"Saremi","year":"2015","journal-title":"Neural Comput. Appl."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Malik, M.R.S., Mohideen, E.R., and Ali, L. (2015, January 10\u201312). Weighted distance grey wolf optimizer for global optimization problems. Proceedings of the 2015 IEEE ICCIC, Madurai, India.","DOI":"10.1109\/ICCIC.2015.7435714"},{"key":"ref_50","first-page":"1693","article-title":"Load frequency control of large scale power system using quasi-oppositional grey wolf optimization algorithm","volume":"19","author":"Guha","year":"2016","journal-title":"Eng. Sci. Technol. Int. J."},{"key":"ref_51","first-page":"427","article-title":"A modified GWO technique based cascade PI-PD controller for AGC of power systems in presence of Plug in Electric Vehicles","volume":"20","author":"Padhy","year":"2017","journal-title":"Eng. Sci. Technol. Int. J."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.engappai.2017.10.024","article-title":"An exploration-enhanced grey wolf optimizer to solve high-dimensional numerical optimization","volume":"68","author":"Long","year":"2018","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"113810","DOI":"10.1109\/ACCESS.2019.2934994","article-title":"A random opposition-based learning grey wolf optimizer","volume":"7","author":"Long","year":"2019","journal-title":"IEEE Access"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Wang, J.S., and Li, S.X. (2019). An improved grey wolf optimizer based on differential evolution and elimination mechanism. Sci. Rep., 9.","DOI":"10.1038\/s41598-019-43546-3"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Saxena, A., Kumar, R., and Mirjalili, S. (2020). A harmonic estimator design with evolutionary operators equipped grey wolf optimizer. Expert Syst. Appl., 145.","DOI":"10.1016\/j.eswa.2019.113125"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Ahmed, R., Nazir, A., Mahadzir, S., Shorfuzzaman, M., and Islam, J. (2021). Niching grey wolf optimizer for multimodal optimization problems. Appl. Sci., 11.","DOI":"10.3390\/app11114795"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Yu, X., and Wu, X. (2022). Ensemble grey wolf Optimizer and its application for image segmentation. Expert Syst. Appl., 209.","DOI":"10.1016\/j.eswa.2022.118267"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Nadimi-Shahraki, M.H., Taghian, S., and Mirjalili, S. (2021). An improved grey wolf optimizer for solving engineering problems. Expert Syst. Appl., 166.","DOI":"10.1016\/j.eswa.2020.113917"},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Li, H., Lv, T., Shui, Y., Zhang, J., Zhang, H., Zhao, H., and Ma, S. (2023). An Improved grey wolf optimizer with weighting functions and its application to Unmanned Aerial Vehicles path planning. Comput. Electr. Eng., 111.","DOI":"10.1016\/j.compeleceng.2023.108893"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Yu, X., Duan, Y., Cai, Z., and Luo, W. (2024). An adaptive learning grey wolf optimizer for coverage optimization in WSNs. Expert Syst. Appl., 238.","DOI":"10.1016\/j.eswa.2023.121917"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"1196","DOI":"10.1139\/z99-099","article-title":"Alpha status, dominance, and division of labor in wolf packs","volume":"77","author":"Mech","year":"1999","journal-title":"Can. J. Zool."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Gupta, S., and Deep, K. (2020). A memory-based grey wolf optimizer for global optimization tasks. Appl. Soft Comput., 93.","DOI":"10.1016\/j.asoc.2020.106367"},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1016\/j.asoc.2017.03.048","article-title":"A fuzzy hierarchical operator in the grey wolf optimizer algorithm","volume":"57","author":"Castillo","year":"2017","journal-title":"Appl. Soft Comput."},{"key":"ref_64","first-page":"1","article-title":"Attention is all you need","volume":"30","author":"Vaswani","year":"2017","journal-title":"NeurIPS"},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"331","DOI":"10.1007\/s41095-022-0271-y","article-title":"Attention mechanisms in computer vision: A survey","volume":"8","author":"Guo","year":"2022","journal-title":"Comput. Vis. Media"},{"key":"ref_66","unstructured":"Chorowski, J.K., Bahdanau, D., Serdyuk, D., Cho, K., and Bengio, Y. (2015). Attention-based models for speech recognition. NeurIPS, 28, Available online: https:\/\/proceedings.neurips.cc\/paper\/2015\/hash\/1068c6e4c8051cfd4e9ea8072e3189e2-Abstract.html."},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1109\/TMM.2019.2924576","article-title":"STAT: Spatial-temporal attention mechanism for video captioning","volume":"22","author":"Yan","year":"2019","journal-title":"IEEE Trans. Multimed."},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1016\/j.neucom.2018.01.007","article-title":"Fine-grained attention mechanism for neural machine translation","volume":"284","author":"Choi","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_69","unstructured":"Press, O., and Wolf, L. (2016). Using the output embedding to improve language models. arXiv."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.neucom.2021.03.091","article-title":"A review on the attention mechanism of deep learning","volume":"452","author":"Niu","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"Yang, Z.B., Zhang, J.P., Zhao, Z.B., Zhai, Z., and Chen, X.F. (2020). Interpreting network knowledge with attention mechanism for bearing fault diagnosis. Appl. Soft Comput., 97.","DOI":"10.1016\/j.asoc.2020.106829"},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"7805","DOI":"10.1007\/s00521-018-3602-2","article-title":"Analysing the effects of various switching probability characteristics in flower pollination algorithm for solving unconstrained function minimization problems","volume":"31","author":"Ozsoydan","year":"2019","journal-title":"Neural Comput. Appl."},{"key":"ref_73","doi-asserted-by":"crossref","unstructured":"Ozsoydan, F.B. (2019). Effects of dominant wolves in grey wolf optimization algorithm. Appl. Soft Comput., 83.","DOI":"10.1016\/j.asoc.2019.105658"},{"key":"ref_74","doi-asserted-by":"crossref","unstructured":"Faramarzi, A., Heidarinejad, M., Stephens, B., and Mirjalili, S. (2020). Equilibrium optimizer: A novel optimization algorithm. Knowl.-Based Syst., 191.","DOI":"10.1016\/j.knosys.2019.105190"},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"105586","DOI":"10.1016\/j.knosys.2020.105586","article-title":"Evolutionary and adaptive inheritance enhanced Grey Wolf Optimization algorithm for binary domains","volume":"194","author":"Ozsoydan","year":"2020","journal-title":"Knowl.-Based Syst."},{"key":"ref_76","unstructured":"Awad, N., Ali, M., Liang, J., Qu, B., and Suganthan, P. (2016). Problem Definitions and Evaluation Criteria for the CEC 2017 Special Session and Competition on Single Objective Bound Constrained Real-Parameter Numerical Optimization, Nanyang Technological University. Technical Report."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"849","DOI":"10.1016\/j.future.2019.02.028","article-title":"Harris hawks optimization: Algorithm and applications","volume":"97","author":"Heidari","year":"2019","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"2023","DOI":"10.1109\/CEC.2004.1331145","article-title":"Parallel differential evolution","volume":"Volume 2","author":"Tasoulis","year":"2004","journal-title":"Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753)"},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"1583","DOI":"10.1002\/nme.1620210904","article-title":"A study of mathematical programming methods for structural optimization. Part I: Theory","volume":"21","author":"Belegundu","year":"1985","journal-title":"Int. J. Numer. Methods Eng."},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1115\/1.2919393","article-title":"An Augmented Lagrange Multiplier Based Method for Mixed Integer Discrete Continuous Optimization and Its Applications to Mechanical Design","volume":"116","author":"Kannan","year":"1994","journal-title":"Trans. ASME J. Mech. Des."},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"735","DOI":"10.1080\/03052150108940941","article-title":"Engineering design optimization using a swarm with an intelligent information sharing among individuals","volume":"33","author":"Ray","year":"2001","journal-title":"Eng. Optim."},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"2013","DOI":"10.2514\/3.10834","article-title":"Optimal design of a welded beam via genetic algorithms","volume":"29","author":"Deb","year":"1991","journal-title":"AIAA J."},{"key":"ref_83","doi-asserted-by":"crossref","unstructured":"Mezura-Montes, E., and Coello, C.A.C. (2005). Useful infeasible solutions in engineering optimization with evolutionary algorithms. Mexican International Conference on Artificial Intelligence, Springer.","DOI":"10.1007\/11579427_66"},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1115\/1.2912596","article-title":"Nonlinear Integer and Discrete Programming in Mechanical Design Optimization","volume":"112","author":"Sandgren","year":"1990","journal-title":"J. Mech. Des."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/17\/1\/50\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:57:12Z","timestamp":1760115432000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/17\/1\/50"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,30]]},"references-count":84,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,1]]}},"alternative-id":["sym17010050"],"URL":"https:\/\/doi.org\/10.3390\/sym17010050","relation":{},"ISSN":["2073-8994"],"issn-type":[{"value":"2073-8994","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,30]]}}}