{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,6]],"date-time":"2025-12-06T17:08:07Z","timestamp":1765040887527},"reference-count":42,"publisher":"MIT Press","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Evolutionary Computation"],"published-print":{"date-parts":[[2019,3]]},"abstract":"<jats:p>Exploratory Landscape Analysis provides sample-based methods to calculate features of black-box optimization problems in a quantitative and measurable way. Many problem features have been proposed in the literature in an attempt to provide insights into the structure of problem landscapes and to use in selecting an effective algorithm for a given optimization problem. While there has been some success, evaluating the utility of problem features in practice presents some significant challenges. Machine learning models have been employed as part of the evaluation process, but they may require additional information about the problems as well as having their own hyper-parameters, biases and experimental variability. As a result, extra layers of uncertainty and complexity are added into the experimental evaluation process, making it difficult to clearly assess the effect of the problem features. In this article, we propose a novel method for the evaluation of problem features which can be applied directly to individual or groups of features and does not require additional machine learning techniques or confounding experimental factors. The method is based on the feature's ability to detect a prior ranking of similarity in a set of problems. Analysis of Variance (ANOVA) significance tests are used to determine if the feature has successfully distinguished the successive problems in the set. Based on ANOVA test results, a percentage score is assigned to each feature for different landscape characteristics. Experimental results for twelve different features on four problem transformations demonstrate the method and provide quantitative evidence about the ability of different problem features to detect specific properties of problem landscapes.<\/jats:p>","DOI":"10.1162\/evco_a_00247","type":"journal-article","created":{"date-parts":[[2018,12,28]],"date-time":"2018-12-28T17:52:56Z","timestamp":1546019576000},"page":"75-98","source":"Crossref","is-referenced-by-count":12,"title":["Direct Feature Evaluation in Black-Box Optimization Using Problem Transformations"],"prefix":"10.1162","volume":"27","author":[{"given":"Sobia","family":"Saleem","sequence":"first","affiliation":[{"name":"School of Information Technology and Electrical Engineering, University of Queensland, Q. 4072, Australia"}]},{"given":"Marcus","family":"Gallagher","sequence":"additional","affiliation":[{"name":"School of Information Technology and Electrical Engineering, University of Queensland, Q. 4072, Australia"}]},{"given":"Ian","family":"Wood","sequence":"additional","affiliation":[{"name":"School of Mathematics and Physics, University of Queensland, Q. 4072, Australia"}]}],"member":"281","reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-44973-4_4"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jspi.2003.09.010"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-45823-6_15"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-50349-3_2"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1145\/3071178.3071343"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1002\/0471667196.ess1369"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1145\/2330163.2330209"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2015.7257044"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2014.6900240"},{"key":"B11","volume-title":"Engineering statistics","author":"Hogg R. V.","year":"1987"},{"key":"B12","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/978-3-319-07494-8_9","author":"Kerschke P.","year":"2014","journal-title":"EVOLVE\u2014A bridge between probability, set oriented numerics, and evolutionary computation V"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1145\/2739480.2754642"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1145\/2908812.2908845"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2016.7748359"},{"key":"B16","author":"Liang J.","year":"2013","journal-title":"Problem definitions and evaluation criteria for the CEC 2014 special session and competition on single objective real-parameter numerical optimization"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1145\/1143997.1144085"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2013.6557671"},{"key":"B19","first-page":"241:148","author":"Malan K. M.","year":"2013","journal-title":"Information Sciences"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-41888-4_4"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1109\/SIS.2014.7011789"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1007\/s00500-011-0781-5"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1109\/EMS.2010.27"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1145\/2001576.2001690"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-15844-5_8"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1162\/EVCO_a_00134"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-32937-1_41"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2013.2281521"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-20525-5_30"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-32937-1_23"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-32378-2_6"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2015.7257043"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1162\/evco_a_00194"},{"key":"B34","first-page":"317:224","author":"Mu\u00f1oz M. A.","year":"2015","journal-title":"Information Sciences"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23229-9_8"},{"key":"B36","first-page":"15:65","author":"Rice J. R.","year":"1976","journal-title":"Advances in Computers"},{"key":"B37","volume-title":"The analysis of variance","author":"Scheffe H","year":"1959"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-45823-6_89"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2008.4634391"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.2307\/3001913"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1162\/106365600568095"},{"key":"B42","first-page":"1","author":"Weise T.","year":"2009","journal-title":"Nature-inspired algorithms for optimisation"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1109\/4235.585893"}],"container-title":["Evolutionary Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/evco_a_00247","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,12]],"date-time":"2023-09-12T14:25:43Z","timestamp":1694528743000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/evco\/article\/27\/1\/75-98\/1085"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,3]]},"references-count":42,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,3]]}},"alternative-id":["10.1162\/evco_a_00247"],"URL":"https:\/\/doi.org\/10.1162\/evco_a_00247","relation":{},"ISSN":["1063-6560","1530-9304"],"issn-type":[{"value":"1063-6560","type":"print"},{"value":"1530-9304","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3]]}}}