{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,4]],"date-time":"2026-07-04T02:28:26Z","timestamp":1783132106822,"version":"3.54.6"},"reference-count":63,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2023,11,16]],"date-time":"2023-11-16T00:00:00Z","timestamp":1700092800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computation"],"abstract":"<jats:p>Analyzing stochastic algorithms for comprehensive performance and comparison across diverse contexts is essential. By evaluating and adjusting algorithm effectiveness across a wide spectrum of test functions, including both classical benchmarks and CEC-C06 2019 conference functions, distinct patterns of performance emerge. In specific situations, underscoring the importance of choosing algorithms contextually. Additionally, researchers have encountered a critical issue by employing a statistical model randomly to determine significance values without conducting other studies to select a specific model for evaluating performance outcomes. To address this concern, this study employs rigorous statistical testing to underscore substantial performance variations between pairs of algorithms, thereby emphasizing the pivotal role of statistical significance in comparative analysis. It also yields valuable insights into the suitability of algorithms for various optimization challenges, providing professionals with information to make informed decisions. This is achieved by pinpointing algorithm pairs with favorable statistical distributions, facilitating practical algorithm selection. The study encompasses multiple nonparametric statistical hypothesis models, such as the Wilcoxon rank-sum test, single-factor analysis, and two-factor ANOVA tests. This thorough evaluation enhances our grasp of algorithm performance across various evaluation criteria. Notably, the research addresses discrepancies in previous statistical test findings in algorithm comparisons, enhancing result reliability in the later research. The results proved that there are differences in significance results, as seen in examples like Leo versus the FDO, the DA versus the WOA, and so on. It highlights the need to tailor test models to specific scenarios, as p-value outcomes differ among various tests within the same algorithm pair.<\/jats:p>","DOI":"10.3390\/computation11110231","type":"journal-article","created":{"date-parts":[[2023,11,16]],"date-time":"2023-11-16T07:11:27Z","timestamp":1700118687000},"page":"231","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":24,"title":["Enhancing Algorithm Selection through Comprehensive Performance Evaluation: Statistical Analysis of Stochastic Algorithms"],"prefix":"10.3390","volume":"11","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7240-6013","authenticated-orcid":false,"given":"Azad Arif Hama","family":"Amin","sequence":"first","affiliation":[{"name":"Department of Financial Accounting and Auditing, College of Commerce, University of Sulaimani, Sulaymaniyah 46001, Iraq"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8734-0811","authenticated-orcid":false,"given":"Aso M.","family":"Aladdin","sequence":"additional","affiliation":[{"name":"Computer Science Department, College of Science, Charmo University, Kurdistan Region, Chamchamal 46023, Iraq"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9457-9655","authenticated-orcid":false,"given":"Dler O.","family":"Hasan","sequence":"additional","affiliation":[{"name":"Computer Science Department, College of Science, Charmo University, Kurdistan Region, Chamchamal 46023, Iraq"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Soran R.","family":"Mohammed-Taha","sequence":"additional","affiliation":[{"name":"Computer Science Department, College of Science, Charmo University, Kurdistan Region, Chamchamal 46023, Iraq"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8661-258X","authenticated-orcid":false,"given":"Tarik A.","family":"Rashid","sequence":"additional","affiliation":[{"name":"Computer Science and Engineering Department, University of Kurdistan Hewler, Erbil 44001, Iraq"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,11,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1017\/S0140525X12000477","article-title":"Whatever next? Predictive Brains, Situated Agents, and the Future of Cognitive Science","volume":"36","author":"Clark","year":"2013","journal-title":"Behav. Brain Sci."},{"key":"ref_2","unstructured":"Kapur, R. (2018). Research Methodology: Methods and Strategies, Department of Adult Education and Continuing Extension, University of Delhi."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Horn, R.V. (1993). Statistical Indicators: For the Economic and Social Sciences, Cambridge University Press.","DOI":"10.1017\/CBO9780511518164"},{"key":"ref_4","unstructured":"Li, B., Su, P., Chabbi, M., Jiao, S., and Liu, X. (March, January 25). DJXPerf: Identifying Memory Inefficiencies via Object-Centric Profiling for Java. Proceedings of the 21st ACM\/IEEE International Symposium on Code Generation and Optimization, Montr\u00e9al, QC, Canada."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Li, B., Xu, H., Zhao, Q., Su, P., Chabbi, M., Jiao, S., and Liu, X. (2022, January 21\u201329). OJXPerf: Featherlight Object Replica Detection for Java Programs. Proceedings of the 44th International Conference on Software Engineering, Pittsburgh, PA, USA.","DOI":"10.1145\/3510003.3510083"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1016\/j.ins.2017.07.015","article-title":"A Novel Approach to Statistical Comparison of Meta-Heuristic Stochastic Optimization Algorithms Using Deep Statistics","volume":"417","author":"Eftimov","year":"2017","journal-title":"Inf. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"230539","DOI":"10.1098\/rsos.230539","article-title":"General Intelligence Requires Rethinking Exploration","volume":"10","author":"Jiang","year":"2023","journal-title":"R. Soc. Open Sci."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Vikhar, P.A. (2016, January 22\u201324). Evolutionary Algorithms: A Critical Review and Its Future Prospects. Proceedings of the 2016 International Conference on Global Trends in Signal Processing, Information Computing and Communication (ICGTSPICC), Jalgaon, India.","DOI":"10.1109\/ICGTSPICC.2016.7955308"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"43473","DOI":"10.1109\/ACCESS.2019.2907012","article-title":"Fitness Dependent Optimizer: Inspired by the Bee Swarming Reproductive Process","volume":"7","author":"Abdullah","year":"2019","journal-title":"IEEE Access"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1053","DOI":"10.1007\/s00521-015-1920-1","article-title":"Dragonfly Algorithm: A New Meta-Heuristic Optimization Technique for Solving Single-Objective, Discrete, and Multi-Objective Problems","volume":"27","author":"Mirjalili","year":"2016","journal-title":"Neural Comput. Appl."},{"key":"ref_11","unstructured":"Aladdin, A.M., and Rashid, T.A. (2023). Leo: Lagrange Elementary Optimization. arXiv."},{"key":"ref_12","unstructured":"Tan, J., Jiao, S., Chabbi, M., and Liu, X. (July, January 29). What Every Scientific Programmer Should Know about Compiler Optimizations?. Proceedings of the 34th ACM International Conference on Supercomputing, Barcelona, Spain."},{"key":"ref_13","first-page":"218","article-title":"Common Benchmark Functions for Metaheuristic Evaluation: A Review","volume":"1","author":"Hussain","year":"2017","journal-title":"JOIV Int. J. Inform. Vis."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Bujok, P., and Zamuda, A. (2019, January 10\u201313). Cooperative Model of Evolutionary Algorithms Applied to CEC 2019 Single Objective Numerical Optimization. Proceedings of the 2019 IEEE Congress on Evolutionary Computation (CEC), Wellington, New Zealand.","DOI":"10.1109\/CEC.2019.8790317"},{"key":"ref_15","unstructured":"Swain, M. (2005). Handbook of Research in Second Language Teaching and Learning, Routledge."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.swevo.2011.02.002","article-title":"A Practical Tutorial on the Use of Nonparametric Statistical Tests as a Methodology for Comparing Evolutionary and Swarm Intelligence Algorithms","volume":"1","author":"Derrac","year":"2011","journal-title":"Swarm Evol. Comput."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1007\/s10732-008-9080-4","article-title":"A Study on the Use of Non-Parametric Tests for Analyzing the Evolutionary Algorithms\u2019 Behaviour: A Case Study on the CEC\u20192005 Special Session on Real Parameter Optimization","volume":"15","author":"Molina","year":"2009","journal-title":"J. Heuristics"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2915","DOI":"10.1049\/iet-gtd.2015.1334","article-title":"Comparative Study on the Performance of Many-objective and Single-objective Optimisation Algorithms in Tuning Load Frequency Controllers of Multi-area Power Systems","volume":"10","author":"Yousefi","year":"2016","journal-title":"IET Gener. Transm. Distrib."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Good, P.I., and Hardin, J.W. (2012). Common Errors in Statistics (and How to Avoid Them), John Wiley & Sons.","DOI":"10.1002\/9781118360125"},{"key":"ref_20","first-page":"73","article-title":"Benchmarking Procedures for Continuous Optimization Algorithms","volume":"4","author":"Opara","year":"2011","journal-title":"J. Telecommun. Inf. Technol."},{"key":"ref_21","unstructured":"Sivanandam, S.N., Deepa, S.N., Sivanandam, S.N., and Deepa, S.N. (2008). Genetic Algorithms, Springer."},{"key":"ref_22","unstructured":"Kennedy, J., and Eberhart, R. (December, January 27). Particle Swarm Optimization. Proceedings of the ICNN\u201995\u2014International Conference on Neural Networks, Perth, Australia."},{"key":"ref_23","unstructured":"Wong, K.P., and Dong, Z.Y. (2005, January 6\u201310). Differential Evolution, an Alternative Approach to Evolutionary Algorithm. Proceedings of the 13th International Conference on Intelligent Systems Application to Power Systems, Arlington, VA, USA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.advengsoft.2016.01.008","article-title":"The Whale Optimization Algorithm","volume":"95","author":"Mirjalili","year":"2016","journal-title":"Adv. Eng. Softw."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/j.future.2020.03.055","article-title":"Slime Mould Algorithm: A New Method for Stochastic Optimization","volume":"111","author":"Li","year":"2020","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"5973","DOI":"10.1002\/ece3.2332","article-title":"A Comparison of Absolute Performance of Different Correlative and Mechanistic Species Distribution Models in an Independent Area","volume":"6","author":"Shabani","year":"2016","journal-title":"Ecol. Evol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"11969","DOI":"10.1007\/s00521-023-08332-3","article-title":"Multi-Objective Fitness-Dependent Optimizer Algorithm","volume":"35","author":"Abdullah","year":"2023","journal-title":"Neural Comput. Appl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"106688","DOI":"10.1109\/ACCESS.2023.3318867","article-title":"An Adaptive DeepLabv3+ for Semantic Segmentation of Aerial Images Using Improved Golden Eagle Optimization Algorithm","volume":"11","author":"Venugopal","year":"2023","journal-title":"IEEE Access"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"107050","DOI":"10.1016\/j.cie.2020.107050","article-title":"Golden Eagle Optimizer: A Nature-Inspired Metaheuristic Algorithm","volume":"152","author":"Nayeri","year":"2021","journal-title":"Comput. Ind. Eng."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"228","DOI":"10.1016\/j.knosys.2015.07.006","article-title":"Moth-Flame Optimization Algorithm: A Novel Nature-Inspired Heuristic Paradigm","volume":"89","author":"Mirjalili","year":"2015","journal-title":"Knowl. Based Syst."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"104935","DOI":"10.1016\/j.micpro.2023.104935","article-title":"Moth Flame Optimization Based Ensemble Classification for Intrusion Detection in Intelligent Transport System for Smart Cities","volume":"103","author":"Gadekallu","year":"2023","journal-title":"Microprocess. Microsyst."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1016\/j.eij.2020.08.003","article-title":"A New Evolutionary Algorithm: Learner Performance Based Behavior Algorithm","volume":"22","author":"Rahman","year":"2021","journal-title":"Egypt. Inform. J."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1030","DOI":"10.1007\/s10489-022-03533-0","article-title":"FOX: A FOX-Inspired Optimization Algorithm","volume":"53","author":"Mohammed","year":"2023","journal-title":"Appl. Intell."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/j.advengsoft.2017.07.002","article-title":"Salp Swarm Algorithm: A Bio-Inspired Optimizer for Engineering Design Problems","volume":"114","author":"Mirjalili","year":"2017","journal-title":"Adv. Eng. Softw."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1584","DOI":"10.1007\/s12613-022-2574-5","article-title":"Single-Factor Analysis and Interaction Terms on the Mechanical and Microscopic Properties of Cemented Aeolian Sand Backfill","volume":"30","author":"Wang","year":"2023","journal-title":"Int. J. Miner. Metall. Mater."},{"key":"ref_36","unstructured":"Woolson, R.F. (2007). Wiley Encyclopedia of Clinical Trials, Wiley."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"777","DOI":"10.1109\/TEVC.2019.2955110","article-title":"Paradoxes in Numerical Comparison of Optimization Algorithms","volume":"24","author":"Liu","year":"2019","journal-title":"IEEE Trans. Evol. Comput."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"100973","DOI":"10.1016\/j.swevo.2021.100973","article-title":"A Prescription of Methodological Guidelines for Comparing Bio-Inspired Optimization Algorithms","volume":"67","author":"LaTorre","year":"2021","journal-title":"Swarm Evol. Comput."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"100888","DOI":"10.1016\/j.swevo.2021.100888","article-title":"A Tutorial on the Design, Experimentation and Application of Metaheuristic Algorithms to Real-World Optimization Problems","volume":"64","author":"Osaba","year":"2021","journal-title":"Swarm Evol. Comput."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1007\/s12559-018-9554-0","article-title":"An Insight into Bio-Inspired and Evolutionary Algorithms for Global Optimization: Review, Analysis, and Lessons Learnt over a Decade of Competitions","volume":"10","author":"Molina","year":"2018","journal-title":"Cogn. Comput."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Emambocus, B.A.S., Jasser, M.B., Amphawan, A., and Mohamed, A.W. (2022). An Optimized Discrete Dragonfly Algorithm Tackling the Low Exploitation Problem for Solving TSP. Mathematics, 10.","DOI":"10.3390\/math10193647"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"696","DOI":"10.1016\/j.epsr.2017.09.001","article-title":"Whale Optimization Algorithm Based Optimal Reactive Power Dispatch: A Case Study of the Algerian Power System","volume":"163","author":"Sayah","year":"2018","journal-title":"Electr. Power Syst. Res."},{"key":"ref_43","unstructured":"Aladdin, A.M., Abdullah, J.M., Salih, K.O.M., Rashid, T.A., Sagban, R., Alsaddon, A., Bacanin, N., Chhabra, A., Vimal, S., and Banerjee, I. (2023). Practical Artificial Intelligence for Internet of Medical Things, CRC Press."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"225","DOI":"10.14445\/22315381\/IJETT-V69I8P228","article-title":"Evolutionary Based Optimal Power Flow Solution For Load Congestion Using PRNG","volume":"69","author":"Ramesh","year":"2021","journal-title":"Int. J. Eng. Trends Technol."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"561","DOI":"10.1002\/1099-1239(200006)10:7<561::AID-RNC493>3.0.CO;2-C","article-title":"A New Lagrangian Dual Global Optimization Algorithm for Solving Bilinear Matrix Inequalities","volume":"10","author":"Tuan","year":"2000","journal-title":"Int. J. Robust Nonlinear Control IFAC-Affil. J."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1515\/sagmb-2015-0085","article-title":"LandScape: A Simple Method to Aggregate p-Values and Other Stochastic Variables without a Priori Grouping","volume":"15","author":"Wiuf","year":"2016","journal-title":"Stat. Appl. Genet. Mol. Biol."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Aladdin, A.M., and Rashid, T.A. (2023). A New Lagrangian Problem Crossover\u2014A Systematic Review and Meta-Analysis of Crossover Standards. Systems, 11.","DOI":"10.3390\/systems11030144"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"347","DOI":"10.3758\/BF03207805","article-title":"Statistical Power for the Two-Factor Repeated Measures ANOVA","volume":"32","author":"Potvin","year":"2000","journal-title":"Behav. Res. Methods Instrum. Comput."},{"key":"ref_49","first-page":"1","article-title":"Sample Size and Its Role in Central Limit Theorem (CLT)","volume":"4","author":"Islam","year":"2018","journal-title":"Comput. Appl. Math. J."},{"key":"ref_50","first-page":"1","article-title":"Comparing Two Samples from an Individual Likert Question","volume":"18","author":"Derrick","year":"2017","journal-title":"Int. J. Math. Stat."},{"key":"ref_51","first-page":"1","article-title":"Statistical Comparisons of Classifiers over Multiple Data Sets","volume":"7","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"ref_52","first-page":"1","article-title":"The Two-Sample Rank-Sum Test: Early Development","volume":"8","author":"Berry","year":"2012","journal-title":"Electron. J. Hist. Probab. Stat."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Hasan, D.O., Aladdin, A.M., Amin, A.A.H., Rashid, T.A., Ali, Y.H., Al-Bahri, M., Majidpour, J., Batrancea, I., and Masca, E.S. (2023). Perspectives on the Impact of E-Learning Pre- and Post-COVID-19 Pandemic\u2014The Case of the Kurdistan Region of Iraq. Sustainability, 15.","DOI":"10.3390\/su15054400"},{"key":"ref_54","first-page":"sjms-102","article-title":"Statistical Analysis of Paired Sample Data by Ranks","volume":"2012","author":"Oyeka","year":"2012","journal-title":"Sci. J. Math. Stat."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Task, C., and Clifton, C. (2016, January 5\u20137). Differentially Private Significance Testing on Paired-Sample Data. Proceedings of the 2016 SIAM International Conference on Data Mining, Miami, FL, USA.","DOI":"10.1137\/1.9781611974348.18"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"130","DOI":"10.1186\/cc2836","article-title":"Statistics Review 9: One-Way Analysis of Variance","volume":"8","author":"Bewick","year":"2004","journal-title":"Crit. Care"},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Olive, D.J., and Olive, D.J. (2017). Linear Regression, Springer.","DOI":"10.1007\/978-3-319-55252-1"},{"key":"ref_58","unstructured":"Protassov, R.S. (2002). An Application of Missing Data Methods: Testing for the Presence of a Spectral Line in Astronomy and Parameter Estimation of the Generalized Hyperbolic Distributions, Harvard University."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1109\/TEVC.2019.2921598","article-title":"A Survey of Automatic Parameter Tuning Methods for Metaheuristics","volume":"24","author":"Huang","year":"2019","journal-title":"IEEE Trans. Evol. Comput."},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Vafaee, F., Tur\u00e1n, G., Nelson, P.C., and Berger-Wolf, T.Y. (2014, January 22). Balancing the Exploration and Exploitation in an Adaptive Diversity Guided Genetic Algorithm. Proceedings of the 2014 IEEE Congress on Evolutionary Computation (CEC), Beijing, China.","DOI":"10.1109\/CEC.2014.6900257"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1007\/s10107-005-0597-0","article-title":"Computational Complexity of Stochastic Programming Problems","volume":"106","author":"Dyer","year":"2006","journal-title":"Math. Program."},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1145\/3588433","article-title":"V Representation Bias in Data: A Survey on Identification and Resolution Techniques","volume":"55","author":"Shahbazi","year":"2023","journal-title":"ACM Comput. Surv."},{"key":"ref_63","first-page":"255","article-title":"Keel Data-Mining Software Tool: Data Set Repository, Integration of Algorithms and Experimental Analysis Framework","volume":"17","author":"Derrac","year":"2015","journal-title":"J. Mult.-Valued Log. Soft Comput."}],"container-title":["Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-3197\/11\/11\/231\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:24:09Z","timestamp":1760131449000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-3197\/11\/11\/231"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,16]]},"references-count":63,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2023,11]]}},"alternative-id":["computation11110231"],"URL":"https:\/\/doi.org\/10.3390\/computation11110231","relation":{},"ISSN":["2079-3197"],"issn-type":[{"value":"2079-3197","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,16]]}}}