{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T20:18:15Z","timestamp":1777407495554,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":38,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,7,14]],"date-time":"2024-07-14T00:00:00Z","timestamp":1720915200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"CNRS Sciences informatiques","award":["AAP project IOHprofiler"],"award-info":[{"award-number":["AAP project IOHprofiler"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,7,14]]},"DOI":"10.1145\/3638529.3654122","type":"proceedings-article","created":{"date-parts":[[2024,7,8]],"date-time":"2024-07-08T16:33:04Z","timestamp":1720456384000},"page":"41-49","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["Large-Scale Benchmarking of Metaphor-Based Optimization Heuristics"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3040-7162","authenticated-orcid":false,"given":"Diederick","family":"Vermetten","sequence":"first","affiliation":[{"name":"Leiden University, Leiden, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4981-3227","authenticated-orcid":false,"given":"Carola","family":"Doerr","sequence":"additional","affiliation":[{"name":"Sorbonne University, Paris, France"},{"name":"CNRS, Paris, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4933-5181","authenticated-orcid":false,"given":"Hao","family":"Wang","sequence":"additional","affiliation":[{"name":"Leiden University, Leiden, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4138-7024","authenticated-orcid":false,"given":"Anna V.","family":"Kononova","sequence":"additional","affiliation":[{"name":"Leiden University, Leiden, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6768-1478","authenticated-orcid":false,"given":"Thomas","family":"B\u00e4ck","sequence":"additional","affiliation":[{"name":"Leiden University, Leiden, Netherlands"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2024,7,14]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/S11721-021-00202-9"},{"key":"e_1_3_2_1_2_1","first-page":"B1","article-title":"Handbook of evolutionary computation","volume":"97","author":"B\u00e4ck Thomas","year":"1997","unstructured":"Thomas B\u00e4ck, David B Fogel, and Zbigniew Michalewicz. 1997. Handbook of evolutionary computation. Release 97, 1 (1997), B1.","journal-title":"Release"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/S11721-019-00165-Y"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2021.3102863"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cor.2022.105747"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-60376-2_10"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1162\/artl_a_00402"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449726.3463167"},{"key":"e_1_3_2_1_9_1","volume-title":"Iohexperimenter: Benchmarking platform for iterative optimization heuristics. Evolutionary Computation","author":"de Nobel Jacob","year":"2023","unstructured":"Jacob de Nobel, Furong Ye, Diederick Vermetten, Hao Wang, Carola Doerr, and Thomas B\u00e4ck. 2023. Iohexperimenter: Benchmarking platform for iterative optimization heuristics. Evolutionary Computation (2023), 1--6."},{"key":"e_1_3_2_1_10_1","volume-title":"Opytimizer: A nature-inspired python optimizer. arXiv preprint arXiv:1912.13002","author":"de Rosa Gustavo H","year":"2019","unstructured":"Gustavo H de Rosa, Douglas Rodrigues, and Jo\u00e3o P Papa. 2019. Opytimizer: A nature-inspired python optimizer. arXiv preprint arXiv:1912.13002 (2019)."},{"key":"e_1_3_2_1_11_1","volume-title":"2021 IEEE Symposium Series on Computational Intelligence (SSCI). IEEE, 1--7.","author":"Ser Javier Del","year":"2021","unstructured":"Javier Del Ser, Eneko Osaba, Aritz D Martinez, Miren Nekane Bilbao, Javier Poyatos, Daniel Molina, and Francisco Herrera. 2021. More is not always better: insights from a massive comparison of meta-heuristic algorithms over real-parameter optimization problems. In 2021 IEEE Symposium Series on Computational Intelligence (SSCI). IEEE, 1--7."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/3205455.3205621"},{"key":"e_1_3_2_1_14_1","first-page":"171","article-title":"EvoloPy: An open-source nature-inspired optimization framework in python","volume":"1","author":"Faris Hossam","year":"2016","unstructured":"Hossam Faris, Ibrahim Aljarah, Seyedali Mirjalili, Pedro A Castillo, and Juan Juli\u00e1n Merelo Guerv\u00f3s. 2016. EvoloPy: An open-source nature-inspired optimization framework in python. IJCCI (ECTA) 1 (2016), 171--177.","journal-title":"IJCCI (ECTA)"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1080\/10556788.2020.1808977"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICNN.1995.488968"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1162\/evco_a_00242"},{"key":"e_1_3_2_1_19_1","volume-title":"The importance of being constrained: Dealing with in-feasible solutions in differential evolution and beyond. Evolutionary Computation","author":"Kononova Anna V","year":"2023","unstructured":"Anna V Kononova, Diederick Vermetten, Fabio Caraffini, Madalina-A Mitran, and Daniela Zaharie. 2023. The importance of being constrained: Dealing with in-feasible solutions in differential evolution and beyond. Evolutionary Computation (2023), 1--46."},{"key":"e_1_3_2_1_20_1","volume-title":"The Evolutionary Computation Methods No One Should Use. arXiv preprint arXiv:2301.01984","author":"Kudela Jakub","year":"2023","unstructured":"Jakub Kudela. 2023. The Evolutionary Computation Methods No One Should Use. arXiv preprint arXiv:2301.01984 (2023)."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3466624"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"crossref","unstructured":"Manuel L\u00f3pez-Ib\u00e1\u00f1ez Diederick Vermetten Johann Dreo and Carola Doerr. 2024. Using the Empirical Attainment Function for Analyzing Single-objective Black-box Optimization Algorithms. arXiv:2404.02031","DOI":"10.1109\/TEVC.2024.3462758"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.swevo.2023.101248"},{"key":"e_1_3_2_1_24_1","volume-title":"Umap: Uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426","author":"McInnes Leland","year":"2018","unstructured":"Leland McInnes, John Healy, and James Melville. 2018. Umap: Uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426 (2018)."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2001576.2001690"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2021.3108185"},{"key":"e_1_3_2_1_27_1","unstructured":"J\u00e9r\u00e9my Rapin and Olivier Teytaud. 2018. Nevergrad - A gradient-free optimization platform. https:\/\/GitHub.com\/FacebookResearch\/Nevergrad."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1111\/itor.12001"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-07124-4_4"},{"key":"e_1_3_2_1_30_1","volume-title":"Improving the search performance of SHADE using linear population size reduction. In 2014 IEEE congress on evolutionary computation (CEC)","author":"Tanabe Ryoji","unstructured":"Ryoji Tanabe and Alex S Fukunaga. 2014. Improving the search performance of SHADE using linear population size reduction. In 2014 IEEE congress on evolutionary computation (CEC). IEEE, 1658--1665."},{"key":"e_1_3_2_1_31_1","unstructured":"Niki van Stein Diederick Vermetten Anna V. Kononova and Thomas B\u00e4ck. 2024. Explainable Benchmarking for Iterative Optimization Heuristics. arXiv:2401.17842 [cs.NE]"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2023.102871"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11831-023-09975-0"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3583131.3590417"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","unstructured":"Diederick Vermetten Carola Doerr Hao Wang Anna V Kononova and Thomas B\u00e4ck. 2024. Reproducibility files and additional figures. (2024). Code and data repository (Zenodo) Figure repository (Figshare): doi.org\/10.6084\/m9.figshare.25060151. 10.5281\/zenodo.10561215","DOI":"10.6084\/m9.figshare.25060151"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3321707.3321803"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3377930.3390189"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.21105\/joss.00613"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/3510426"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1613\/jair.2490"}],"event":{"name":"GECCO '24: Genetic and Evolutionary Computation Conference","location":"Melbourne VIC Australia","acronym":"GECCO '24","sponsor":["SIGEVO ACM Special Interest Group on Genetic and Evolutionary Computation"]},"container-title":["Proceedings of the Genetic and Evolutionary Computation Conference"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3638529.3654122","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3638529.3654122","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T23:56:51Z","timestamp":1750291011000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3638529.3654122"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,14]]},"references-count":38,"alternative-id":["10.1145\/3638529.3654122","10.1145\/3638529"],"URL":"https:\/\/doi.org\/10.1145\/3638529.3654122","relation":{},"subject":[],"published":{"date-parts":[[2024,7,14]]},"assertion":[{"value":"2024-07-14","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}