{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,8]],"date-time":"2025-11-08T13:43:48Z","timestamp":1762609428208,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":30,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,7,12]],"date-time":"2023-07-12T00:00:00Z","timestamp":1689120000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100004329","name":"Javna Agencija za Raziskovalno Dejavnost RS","doi-asserted-by":"publisher","award":["P2-0098","P2-0103","N2-0239","J2-4460","PR-12040"],"award-info":[{"award-number":["P2-0098","P2-0103","N2-0239","J2-4460","PR-12040"]}],"id":[{"id":"10.13039\/501100004329","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100010667","name":"H2020 Industrial Leadership","doi-asserted-by":"publisher","award":["952215"],"award-info":[{"award-number":["952215"]}],"id":[{"id":"10.13039\/100010667","id-type":"DOI","asserted-by":"publisher"}]},{"name":"French National Research Agency","award":["ANR-22-ERCS-0003-01"],"award-info":[{"award-number":["ANR-22-ERCS-0003-01"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,7,15]]},"DOI":"10.1145\/3583131.3590424","type":"proceedings-article","created":{"date-parts":[[2023,7,12]],"date-time":"2023-07-12T19:40:19Z","timestamp":1689190819000},"page":"529-537","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Algorithm Instance Footprint: Separating Easily Solvable and Challenging Problem Instances"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6983-9627","authenticated-orcid":false,"given":"Ana","family":"Nikolikj","sequence":"first","affiliation":[{"name":"Jo\u017eef Stefan Institute, Ljubljana, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2363-712X","authenticated-orcid":false,"given":"Sa\u0161o","family":"D\u017eeroski","sequence":"additional","affiliation":[{"name":"Jo\u017eef Stefan Institute, Ljubljana, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7254-2808","authenticated-orcid":false,"given":"Mario Andr\u00e9s","family":"Mu\u00f1oz","sequence":"additional","affiliation":[{"name":"The University of Melbourne, Melbourne, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5983-7169","authenticated-orcid":false,"given":"Carola","family":"Doerr","sequence":"additional","affiliation":[{"name":"Sorbonne University, Paris, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4492-4603","authenticated-orcid":false,"given":"Peter","family":"Koro\u0161ec","sequence":"additional","affiliation":[{"name":"Jo\u017eef Stefan Institute, Ljubljana, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7330-1902","authenticated-orcid":false,"given":"Tome","family":"Eftimov","sequence":"additional","affiliation":[{"name":"Jo\u017eef Stefan Institute, Ljubljana, Slovenia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2023,7,12]]},"reference":[{"volume-title":"Per instance algorithm configuration of CMA-ES with limited budget","author":"Belkhir Nacim","key":"e_1_3_2_1_1_1","unstructured":"Nacim Belkhir , Johann Dr\u00e9o , Pierre Sav\u00e9ant , and Marc Schoenauer . 2017. Per instance algorithm configuration of CMA-ES with limited budget . In GECCO. Association for Computing Machinery , New York, NY, USA , 681--688. Nacim Belkhir, Johann Dr\u00e9o, Pierre Sav\u00e9ant, and Marc Schoenauer. 2017. Per instance algorithm configuration of CMA-ES with limited budget. In GECCO. Association for Computing Machinery, New York, NY, USA, 681--688."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11749-016-0481-7"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3512290.3528750"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.swevo.2011.02.002"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2017.07.015"},{"volume-title":"Hyperparameter Optimization","author":"Feurer Matthias","key":"e_1_3_2_1_6_1","unstructured":"Matthias Feurer , Frank Hutter , Lars Kotthoff , and Joaquin Vanschoren . 2019. Hyperparameter Optimization . Springer International Publishing , Cham , 3--33. Matthias Feurer, Frank Hutter, Lars Kotthoff, and Joaquin Vanschoren. 2019. Hyperparameter Optimization. Springer International Publishing, Cham, 3--33."},{"volume-title":"Experimental methods for the analysis of optimization algorithms","author":"Hall Nicholas G","key":"e_1_3_2_1_8_1","unstructured":"Nicholas G Hall and Marc E Posner . 2010. The generation of experimental data for computational testing in optimization . In Experimental methods for the analysis of optimization algorithms . Springer , Berlin, Heidelberg , 73--101. Nicholas G Hall and Marc E Posner. 2010. The generation of experimental data for computational testing in optimization. In Experimental methods for the analysis of optimization algorithms. Springer, Berlin, Heidelberg, 73--101."},{"key":"e_1_3_2_1_9_1","unstructured":"Nikolaus Hansen Anne Auger Steffen Finck and Raymond Ros. 2010. Real-parameter black-box optimization benchmarking 2010: Experimental setup. Ph. D. Dissertation. INRIA.  Nikolaus Hansen Anne Auger Steffen Finck and Raymond Ros. 2010. Real-parameter black-box optimization benchmarking 2010: Experimental setup. Ph. D. Dissertation. INRIA."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1080\/10556788.2020.1808977"},{"volume-title":"EvoApplications","author":"Jankovic Anja","key":"e_1_3_2_1_11_1","unstructured":"Anja Jankovic , Tome Eftimov , and Carola Doerr . 2021. Towards feature-based performance regression using trajectory data . In EvoApplications . Springer International Publishing , Cham , 601--617. Anja Jankovic, Tome Eftimov, and Carola Doerr. 2021. Towards feature-based performance regression using trajectory data. In EvoApplications. Springer International Publishing, Cham, 601--617."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2739480.2754642"},{"key":"e_1_3_2_1_13_1","volume-title":"Automated algorithm selection on continuous black-box problems by combining exploratory landscape analysis and machine learning. Evolutionary computation 27, 1","author":"Kerschke Pascal","year":"2019","unstructured":"Pascal Kerschke and Heike Trautmann . 2019. Automated algorithm selection on continuous black-box problems by combining exploratory landscape analysis and machine learning. Evolutionary computation 27, 1 ( 2019 ), 99--127. Pascal Kerschke and Heike Trautmann. 2019. Automated algorithm selection on continuous black-box problems by combining exploratory landscape analysis and machine learning. Evolutionary computation 27, 1 (2019), 99--127."},{"volume-title":"Applications in Statistical Computing","author":"Kerschke Pascal","key":"e_1_3_2_1_14_1","unstructured":"Pascal Kerschke and Heike Trautmann . 2019. Comprehensive feature-based landscape analysis of continuous and constrained optimization problems using the R-package flacco . In Applications in Statistical Computing . Springer International Publishing , Cham , 93--123. Pascal Kerschke and Heike Trautmann. 2019. Comprehensive feature-based landscape analysis of continuous and constrained optimization problems using the R-package flacco. In Applications in Statistical Computing. Springer International Publishing, Cham, 93--123."},{"key":"e_1_3_2_1_15_1","volume-title":"PPSN 2022, Dortmund, Germany, September 10--14, 2022, Proceedings, Part I. Springer International Publishing, Cham, 46--60","author":"Kostovska Ana","year":"2022","unstructured":"Ana Kostovska , Anja Jankovic , Diederick Vermetten , Jacob de Nobel , Hao Wang , Tome Eftimov , and Carola Doerr . 2022 . Per-run algorithm selection with warm-starting using trajectory-based features. In Parallel Problem Solving from Nature-PPSN XVII: 17th International Conference , PPSN 2022, Dortmund, Germany, September 10--14, 2022, Proceedings, Part I. Springer International Publishing, Cham, 46--60 . Ana Kostovska, Anja Jankovic, Diederick Vermetten, Jacob de Nobel, Hao Wang, Tome Eftimov, and Carola Doerr. 2022. Per-run algorithm selection with warm-starting using trajectory-based features. In Parallel Problem Solving from Nature-PPSN XVII: 17th International Conference, PPSN 2022, Dortmund, Germany, September 10--14, 2022, Proceedings, Part I. Springer International Publishing, Cham, 46--60."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.3390\/a14030078"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1143997.1144085"},{"key":"e_1_3_2_1_18_1","volume-title":"Umap: Uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426","author":"McInnes Leland","year":"2018","unstructured":"Leland McInnes , John Healy , and James Melville . 2018 . Umap: Uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426 (2018). Leland McInnes, John Healy, and James Melville. 2018. Umap: Uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426 (2018)."},{"volume-title":"Exploratory landscape analysis","author":"Mersmann Olaf","key":"e_1_3_2_1_19_1","unstructured":"Olaf Mersmann , Bernd Bischl , Heike Trautmann , Mike Preuss , Claus Weihs , and G\u00fcnter Rudolph . 2011. Exploratory landscape analysis . In GECCO. Association for Computing Machinery , New York, NY, USA , 829--836. Olaf Mersmann, Bernd Bischl, Heike Trautmann, Mike Preuss, Claus Weihs, and G\u00fcnter Rudolph. 2011. Exploratory landscape analysis. In GECCO. Association for Computing Machinery, New York, NY, USA, 829--836."},{"key":"e_1_3_2_1_20_1","volume-title":"Exploratory landscape analysis of continuous space optimization problems using information content","author":"Mu\u00f1oz Mario A","year":"2014","unstructured":"Mario A Mu\u00f1oz , Michael Kirley , and Saman K Halgamuge . 2014. Exploratory landscape analysis of continuous space optimization problems using information content . IEEE transactions on evolutionary computation 19, 1 ( 2014 ), 74--87. Mario A Mu\u00f1oz, Michael Kirley, and Saman K Halgamuge. 2014. Exploratory landscape analysis of continuous space optimization problems using information content. IEEE transactions on evolutionary computation 19, 1 (2014), 74--87."},{"key":"e_1_3_2_1_21_1","volume-title":"Performance analysis of continuous black-box optimization algorithms via footprints in instance space. Evolutionary computation 25, 4","author":"Mu\u00f1oz Mario A","year":"2017","unstructured":"Mario A Mu\u00f1oz and Kate A Smith-Miles . 2017. Performance analysis of continuous black-box optimization algorithms via footprints in instance space. Evolutionary computation 25, 4 ( 2017 ), 529--554. Mario A Mu\u00f1oz and Kate A Smith-Miles. 2017. Performance analysis of continuous black-box optimization algorithms via footprints in instance space. Evolutionary computation 25, 4 (2017), 529--554."},{"key":"e_1_3_2_1_22_1","unstructured":"Ana Nikolikj. 2023. Algorithm Footprints. https:\/\/github.com\/anikolik\/algorithm-footprints  Ana Nikolikj. 2023. Algorithm Footprints. https:\/\/github.com\/anikolik\/algorithm-footprints"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-21094-5_8"},{"key":"e_1_3_2_1_24_1","volume-title":"What is a support vector machine? Nature biotechnology 24, 12","author":"Noble William S","year":"2006","unstructured":"William S Noble . 2006. What is a support vector machine? Nature biotechnology 24, 12 ( 2006 ), 1565--1567. William S Noble. 2006. What is a support vector machine? Nature biotechnology 24, 12 (2006), 1565--1567."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.4249\/scholarpedia.1883"},{"key":"e_1_3_2_1_26_1","volume-title":"The shapley value in machine learning. arXiv preprint arXiv:2202.05594","author":"Rozemberczki Benedek","year":"2022","unstructured":"Benedek Rozemberczki , Lauren Watson , P\u00e9ter Bayer , Hao-Tsung Yang , Oliv\u00e9r Kiss , Sebastian Nilsson , and Rik Sarkar . 2022. The shapley value in machine learning. arXiv preprint arXiv:2202.05594 ( 2022 ). Benedek Rozemberczki, Lauren Watson, P\u00e9ter Bayer, Hao-Tsung Yang, Oliv\u00e9r Kiss, Sebastian Nilsson, and Rik Sarkar. 2022. The shapley value in machine learning. arXiv preprint arXiv:2202.05594 (2022)."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3572895"},{"key":"e_1_3_2_1_28_1","volume-title":"A new taxonomy of global optimization algorithms. Natural Computing","author":"Stork J\u00f6rg","year":"2020","unstructured":"J\u00f6rg Stork , Agoston E Eiben , and Thomas Bartz-Beielstein . 2020. A new taxonomy of global optimization algorithms. Natural Computing ( 2020 ), 1--24. J\u00f6rg Stork, Agoston E Eiben, and Thomas Bartz-Beielstein. 2020. A new taxonomy of global optimization algorithms. Natural Computing (2020), 1--24."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/SSCI50451.2021.9660124"},{"key":"e_1_3_2_1_30_1","volume-title":"Explainable Landscape Analysis in Automated Algorithm Performance Prediction. In International Conference on the Applications of Evolutionary Computation (Part of EvoStar). Springer, Cham, 207--222","author":"Trajanov Risto","year":"2022","unstructured":"Risto Trajanov , Stefan Dimeski , Martin Popovski , Peter Koro\u0161ec , and Tome Eftimov . 2022 . Explainable Landscape Analysis in Automated Algorithm Performance Prediction. In International Conference on the Applications of Evolutionary Computation (Part of EvoStar). Springer, Cham, 207--222 . Risto Trajanov, Stefan Dimeski, Martin Popovski, Peter Koro\u0161ec, and Tome Eftimov. 2022. Explainable Landscape Analysis in Automated Algorithm Performance Prediction. In International Conference on the Applications of Evolutionary Computation (Part of EvoStar). Springer, Cham, 207--222."},{"key":"e_1_3_2_1_31_1","volume-title":"Automated machine learning: methods, systems, challenges","author":"Vanschoren Joaquin","year":"2019","unstructured":"Joaquin Vanschoren . 2019. Meta-learning. Automated machine learning: methods, systems, challenges ( 2019 ), 35--61. Joaquin Vanschoren. 2019. Meta-learning. Automated machine learning: methods, systems, challenges (2019), 35--61."}],"event":{"name":"GECCO '23: Genetic and Evolutionary Computation Conference","sponsor":["SIGEVO ACM Special Interest Group on Genetic and Evolutionary Computation"],"location":"Lisbon Portugal","acronym":"GECCO '23"},"container-title":["Proceedings of the Genetic and Evolutionary Computation Conference"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3583131.3590424","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3583131.3590424","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:47:02Z","timestamp":1750178822000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3583131.3590424"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,12]]},"references-count":30,"alternative-id":["10.1145\/3583131.3590424","10.1145\/3583131"],"URL":"https:\/\/doi.org\/10.1145\/3583131.3590424","relation":{},"subject":[],"published":{"date-parts":[[2023,7,12]]},"assertion":[{"value":"2023-07-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}