{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,9]],"date-time":"2026-05-09T22:24:21Z","timestamp":1778365461308,"version":"3.51.4"},"reference-count":63,"publisher":"MIT Press - Journals","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Evolutionary Computation"],"published-print":{"date-parts":[[2012,9]]},"abstract":"<jats:p> The growing popularity of multiobjective evolutionary algorithms (MOEAs) for solving many-objective problems warrants the careful investigation of their search controls and failure modes. This study contributes a new diagnostic assessment framework for rigorously evaluating the effectiveness, reliability, efficiency, and controllability of MOEAs as well as identifying their search controls and failure modes. The framework is demonstrated using the recently introduced Borg MOEA, [Formula: see text]-NSGA-II, [Formula: see text]-MOEA, IBEA, OMOPSO, GDE3, MOEA\/D, SPEA2, and NSGA-II on 33 instances of 18 test problems from the DTLZ, WFG, and CEC 2009 test suites. The diagnostic framework exploits Sobol's variance decomposition to provide guidance on the algorithms\u2019 non-separable, multi-parameter controls when performing a many-objective search. This study represents one of the most comprehensive empirical assessments of MOEAs ever completed. <\/jats:p>","DOI":"10.1162\/evco_a_00053","type":"journal-article","created":{"date-parts":[[2011,10,5]],"date-time":"2011-10-05T00:46:37Z","timestamp":1317775597000},"page":"423-452","source":"Crossref","is-referenced-by-count":190,"title":["Diagnostic Assessment of Search Controls and Failure Modes in Many-Objective Evolutionary Optimization"],"prefix":"10.1162","volume":"20","author":[{"given":"David","family":"Hadka","sequence":"first","affiliation":[{"name":"Department of Computer Science and Engineering, The Pennsylvania State University, University Park, 16802"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Patrick","family":"Reed","sequence":"additional","affiliation":[{"name":"Department of Civil and Environmental Engineering, The Pennsylvania State University, University Park, 16802"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-01020-0_11"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1080\/00949659708811825"},{"key":"B3","volume-title":"Chaotic dynamics: An introduction","author":"Baker G. L.","year":"1990"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2003.810761"},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1145\/1276958.1277114"},{"key":"B6","volume-title":"Evolutionary algorithms for solving multi-objective problems","author":"Coello Coello C. A.","year":"2007"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-45356-3_82"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1145\/1276958.1277115"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1109\/4235.996017"},{"key":"B12","first-page":"3353","author":"Deb K.","year":"2006","journal-title":"The 2006 IEEE Congress on Evolutionary Computation"},{"key":"B14","first-page":"825","author":"Deb K.","year":"2002","journal-title":"Congress on Evolutionary Computation (CEC 2002)"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2006.876362"},{"key":"B17","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-44719-9_11"},{"key":"B18","author":"Edwards A. L.","year":"1993","journal-title":"An introduction to linear regression and correlation"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCA.2004.824873"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2009.4982967"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-31880-4_2"},{"key":"B22","first-page":"416","author":"Fonseca C. M.","year":"1993","journal-title":"Genetic Algorithms: Proceedings of the Fifth International Conference"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1109\/3468.650319"},{"key":"B24","volume-title":"Evolutionary multi-objective optimization in uncertain environments","author":"Goh C.-K.","year":"2009"},{"key":"B25","volume-title":"Genetic algorithms in search, optimization and machine learning","author":"Goldberg D. E.","year":"1989"},{"key":"B26","first-page":"70","author":"Goldberg D. E.","year":"1989","journal-title":"Proceedings of the 3rd International Conference on Genetic Algorithms"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1016\/0167-2789(83)90298-1"},{"key":"B28","author":"Hadka D.","journal-title":"Evolutionary Computation"},{"key":"B30","volume-title":"Adaptation in natural and artificial systems","author":"Holland J. H.","year":"1975"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2005.861417"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2005.1554688"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-89694-4_14"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1145\/1389095.1389225"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1109\/UKSIM.2008.13"},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.1145\/1830483.1830578"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1029\/2009WR008121"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-36970-8_27"},{"key":"B41","first-page":"711","volume":"1","author":"Knowles J.","year":"2002","journal-title":"Congress on Evolutionary Computation (CEC 2002)"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-70928-2_57"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1162\/106365600568167"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1029\/2010WR009194"},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.1016\/j.advwatres.2005.07.010"},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.1016\/j.advwatres.2006.05.009"},{"key":"B47","doi-asserted-by":"publisher","DOI":"10.1007\/11844297_56"},{"key":"B48","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2005.1554717"},{"key":"B49","doi-asserted-by":"publisher","DOI":"10.1162\/106365602760234108"},{"key":"B50","doi-asserted-by":"publisher","DOI":"10.1002\/9783527617548"},{"key":"B51","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2007.4424987"},{"key":"B52","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2003.1299927"},{"key":"B53","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2007.910138"},{"key":"B54","volume-title":"Global sensitivity analysis: The primer","author":"Saltelli A.","year":"2008"},{"key":"B56","doi-asserted-by":"publisher","DOI":"10.4324\/9780203489536"},{"key":"B57","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-31880-4_35"},{"key":"B58","doi-asserted-by":"publisher","DOI":"10.1162\/evco.1994.2.3.221"},{"key":"B60","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-70928-2_54"},{"key":"B61","doi-asserted-by":"publisher","DOI":"10.5194\/hess-11-793-2007"},{"key":"B62","author":"Teytaud O.","year":"2006","journal-title":"PPSN BTP Workshop"},{"key":"B63","doi-asserted-by":"publisher","DOI":"10.1162\/evco.2007.15.4.475"},{"key":"B64","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0610471104"},{"key":"B65","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2008.924428"},{"key":"B66","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-70928-2_56"},{"key":"B67","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2009.4982949"},{"key":"B68","author":"Zhang Q.","year":"2009","journal-title":"Congress on Evolutionary Computation (CEC 2009)"},{"key":"B70","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30217-9_84"},{"key":"B72","first-page":"666","author":"Zitzler E.","year":"2002","journal-title":"Genetic and Evolutionary Computation Conference (GECCO 2002)"},{"key":"B73","doi-asserted-by":"publisher","DOI":"10.1109\/4235.797969"},{"key":"B74","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2003.810758"}],"container-title":["Evolutionary Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/EVCO_a_00053","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T21:58:05Z","timestamp":1615586285000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/evco\/article\/20\/3\/423-452\/928"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,9]]},"references-count":63,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2012,9]]}},"alternative-id":["10.1162\/EVCO_a_00053"],"URL":"https:\/\/doi.org\/10.1162\/evco_a_00053","relation":{},"ISSN":["1063-6560","1530-9304"],"issn-type":[{"value":"1063-6560","type":"print"},{"value":"1530-9304","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,9]]}}}