{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,11]],"date-time":"2026-04-11T13:15:28Z","timestamp":1775913328487,"version":"3.50.1"},"reference-count":214,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2019,3,18]],"date-time":"2019-03-18T00:00:00Z","timestamp":1552867200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Key R8D Program of China","award":["2017YFC0804003"],"award-info":[{"award-number":["2017YFC0804003"]}]},{"DOI":"10.13039\/501100012234","name":"Shenzhen Peacock Plan","doi-asserted-by":"crossref","award":["KQTD2016112514355531"],"award-info":[{"award-number":["KQTD2016112514355531"]}],"id":[{"id":"10.13039\/501100012234","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100016094","name":"Program for University Key Laboratory of Guangdong Province","doi-asserted-by":"crossref","award":["2017KSYS008"],"award-info":[{"award-number":["2017KSYS008"]}],"id":[{"id":"10.13039\/100016094","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Program for Guangdong Introducing Innovative and Entrepreneurial Teams","award":["2017ZT07X386"],"award-info":[{"award-number":["2017ZT07X386"]}]},{"name":"Science and Technology Innovation Committee Foundation of Shenzhen","award":["ZDSYS201703031748284"],"award-info":[{"award-number":["ZDSYS201703031748284"]}]},{"DOI":"10.13039\/501100000266","name":"EPSRC","doi-asserted-by":"crossref","award":["EP\/J017515\/1 and EP\/P005578\/1"],"award-info":[{"award-number":["EP\/J017515\/1 and EP\/P005578\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2020,3,31]]},"abstract":"<jats:p>Complexity and variety of modern multiobjective optimisation problems result in the emergence of numerous search techniques, from traditional mathematical programming to various randomised heuristics. A key issue raised consequently is how to evaluate and compare solution sets generated by these multiobjective search techniques. In this article, we provide a comprehensive review of solution set quality evaluation. Starting with an introduction of basic principles and concepts of set quality evaluation, this article summarises and categorises 100 state-of-the-art quality indicators, with the focus on what quality aspects these indicators reflect. This is accompanied in each category by detailed descriptions of several representative indicators and in-depth analyses of their strengths and weaknesses. Furthermore, issues regarding attributes that indicators possess and properties that indicators are desirable to have are discussed, in the hope of motivating researchers to look into these important issues when designing quality indicators and of encouraging practitioners to bear these issues in mind when selecting\/using quality indicators. Finally, future trends and potential research directions in the area are suggested, together with some guidelines on these directions.<\/jats:p>","DOI":"10.1145\/3300148","type":"journal-article","created":{"date-parts":[[2019,3,18]],"date-time":"2019-03-18T12:09:30Z","timestamp":1552910970000},"page":"1-38","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":279,"title":["Quality Evaluation of Solution Sets in Multiobjective Optimisation"],"prefix":"10.1145","volume":"52","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8607-9607","authenticated-orcid":false,"given":"Miqing","family":"Li","sequence":"first","affiliation":[{"name":"The University of Birmingham, Birmingham, U.K."}]},{"given":"Xin","family":"Yao","sequence":"additional","affiliation":[{"name":"Southern University of Science and Technology and The University of Birmingham, Birmingham, U.K."}]}],"member":"320","published-online":{"date-parts":[[2019,3,18]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2010.2058117"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICTAI.2007.52"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2739480.2754701"},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201910)","author":"Auger A.","unstructured":"A. Auger , J. Bader , and D. Brockhoff . 2010. Theoretically investigating optimal -distributions for the hypervolume indicator: First results for three objectives . In Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201910) . 586--596. A. Auger, J. Bader, and D. Brockhoff. 2010. Theoretically investigating optimal -distributions for the hypervolume indicator: First results for three objectives. In Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201910). 586--596."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1569901.1569980"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1527125.1527138"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1162\/EVCO_a_00009"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCB.2004.834438"},{"key":"e_1_2_1_9_1","volume-title":"Proceedings of the IEEE Congress on Evolutionary Computation. 3100--3107","author":"Basseur M.","unstructured":"M. Basseur and E. K. Burke . 2007. Indicator-based multi-objective local search . In Proceedings of the IEEE Congress on Evolutionary Computation. 3100--3107 . M. Basseur and E. K. Burke. 2007. Indicator-based multi-objective local search. In Proceedings of the IEEE Congress on Evolutionary Computation. 3100--3107."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-31880-4_6"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1162\/evco.2009.17.4.17402"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2009.2015575"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2006.08.008"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2003.810761"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-31880-4_30"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1287\/opre.1090.0766"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-40313-2_20"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the 33rd International Symposium on Computational Geometry (SoCG\u201917)","volume":"77","author":"Bringmann K.","unstructured":"K. Bringmann , S. Cabello , and M. Emmerich . 2017. Maximum volume subset selection for anchored boxes . In Proceedings of the 33rd International Symposium on Computational Geometry (SoCG\u201917) , Vol. 77 . 22:1--22:15. K. Bringmann, S. Cabello, and M. Emmerich. 2017. Maximum volume subset selection for anchored boxes. In Proceedings of the 33rd International Symposium on Computational Geometry (SoCG\u201917), Vol. 77. 22:1--22:15."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comgeo.2010.03.004"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.5555\/1943267.1943271"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/1830483.1830576"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tcs.2010.09.026"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2012.09.005"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2013.08.001"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2576768.2598276"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/2330163.2330230"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1162\/EVCO_a_00135"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2699445"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the IEEE Congress on Evolutionary Computation. IEEE, 749--756","author":"Bui L. T.","unstructured":"L. T. Bui , S. Wesolkowski , A. Bender , H. A. Abbass , and M. Barlow . 2009. A dominance-based stability measure for multi-objective evolutionary algorithms . In Proceedings of the IEEE Congress on Evolutionary Computation. IEEE, 749--756 . L. T. Bui, S. Wesolkowski, A. Bender, H. A. Abbass, and M. Barlow. 2009. A dominance-based stability measure for multi-objective evolutionary algorithms. In Proceedings of the IEEE Congress on Evolutionary Computation. IEEE, 749--756."},{"key":"e_1_2_1_30_1","first-page":"467","article-title":"A diversity indicator based on reference vectors for many-objective optimization. Info","volume":"430","author":"Cai X.","year":"2018","unstructured":"X. Cai , H. Sun , and Z. Fan . 2018 . A diversity indicator based on reference vectors for many-objective optimization. Info . Sci. 430 (2018), 467 -- 486 . X. Cai, H. Sun, and Z. Fan. 2018. A diversity indicator based on reference vectors for many-objective optimization. Info. Sci. 430 (2018), 467--486.","journal-title":"Sci."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jspi.2014.12.004"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1111\/1540-5915.02254"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/FOCS.2013.51"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/358923.358929"},{"key":"e_1_2_1_35_1","volume-title":"Evolutionary Algorithms for Solving Multi-objective Problems","author":"Coello C. A. C.","unstructured":"C. A. C. Coello , G. B. Lamont , and D. A. Van Veldhuizen . 2007. Evolutionary Algorithms for Solving Multi-objective Problems . Vol. 5 . Springer , New York . C. A. C. Coello, G. B. Lamont, and D. A. Van Veldhuizen. 2007. Evolutionary Algorithms for Solving Multi-objective Problems. Vol. 5. Springer, New York."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2004.826067"},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the Mexican International Conference on Artificial Intelligence (MICAI\u201904)","author":"Coello C. A. C.","unstructured":"C. A. C. Coello and M. R. Sierra . 2004. A study of the parallelization of a coevolutionary multi-objective evolutionary algorithm . In Proceedings of the Mexican International Conference on Artificial Intelligence (MICAI\u201904) . 688--697. C. A. C. Coello and M. R. Sierra. 2004. A study of the parallelization of a coevolutionary multi-objective evolutionary algorithm. In Proceedings of the Mexican International Conference on Artificial Intelligence (MICAI\u201904). 688--697."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cor.2003.08.017"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-1360(199801)7:1<34::AID-MCDA161>3.0.CO;2-6"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cor.2011.10.013"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1540-5915.1992.tb00407.x"},{"key":"e_1_2_1_42_1","volume-title":"Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201900)","author":"Deb K.","unstructured":"K. Deb , S. Agrawal , A. Pratap , and T. Meyarivan . 2000. A fast elitist non-dominated sorting genetic algorithm for multi-objective optimization: NSGA-II . In Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201900) . Springer Berlin \/ Heidelberg, 849--858. K. Deb, S. Agrawal, A. Pratap, and T. Meyarivan. 2000. A fast elitist non-dominated sorting genetic algorithm for multi-objective optimization: NSGA-II. In Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201900). Springer Berlin \/ Heidelberg, 849--858."},{"key":"e_1_2_1_43_1","volume-title":"Technical Report 2002004. KanGAL","author":"Deb K.","year":"2002","unstructured":"K. Deb and S. Jain . 2002 . Running Performance Metrics for Evolutionary Multi-objective Optimization . Technical Report 2002004. KanGAL , Indian Institute of Technology . K. Deb and S. Jain. 2002. Running Performance Metrics for Evolutionary Multi-objective Optimization. Technical Report 2002004. KanGAL, Indian Institute of Technology."},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1162\/106365605774666895"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/4235.996017"},{"key":"e_1_2_1_46_1","volume-title":"Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201913)","author":"Diaz-Manriquez A.","unstructured":"A. Diaz-Manriquez , G. Toscano-Pulido , C. A. C. Coello , and R. Landa-Becerra . 2013. A ranking method based on the R2 indicator for many-objective optimization . In Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201913) . IEEE, 1523--1530. A. Diaz-Manriquez, G. Toscano-Pulido, C. A. C. Coello, and R. Landa-Becerra. 2013. A ranking method based on the R2 indicator for many-objective optimization. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201913). IEEE, 1523--1530."},{"key":"e_1_2_1_47_1","first-page":"25","article-title":"A weakly Pareto compliant quality indicator","volume":"22","author":"Dilettoso E.","year":"2017","unstructured":"E. Dilettoso , S. A. Rizzo , and N. Salerno . 2017 . A weakly Pareto compliant quality indicator . Math. Comput. Appl. 22 , 1 (2017), 25 . E. Dilettoso, S. A. Rizzo, and N. Salerno. 2017. A weakly Pareto compliant quality indicator. Math. Comput. Appl. 22, 1 (2017), 25.","journal-title":"Math. Comput. Appl."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.5555\/1121732"},{"key":"e_1_2_1_49_1","doi-asserted-by":"crossref","unstructured":"A. E. Eiben and J. Smith. 2015. From evolutionary computation to the evolution of things. Nature 521 7553 (2015) 476--482.  A. E. Eiben and J. Smith. 2015. From evolutionary computation to the evolution of things. Nature 521 7553 (2015) 476--482.","DOI":"10.1038\/nature14544"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-31880-4_5"},{"key":"e_1_2_1_51_1","doi-asserted-by":"crossref","unstructured":"M. Emmerich and A. Deutz. 2014. Time complexity and zeros of the hypervolume indicator gradient field. In EVOLVE\u2014A Bridge Between Probability Set Oriented Numerics and Evolutionary Computation III. Springer International Publishing 169--193.  M. Emmerich and A. Deutz. 2014. Time complexity and zeros of the hypervolume indicator gradient field. In EVOLVE\u2014A Bridge Between Probability Set Oriented Numerics and Evolutionary Computation III. Springer International Publishing 169--193.","DOI":"10.1007\/978-3-319-01460-9_8"},{"key":"e_1_2_1_52_1","doi-asserted-by":"crossref","unstructured":"M. Emmerich A. Deutz and N. Beume. 2007. Gradient-based\/evolutionary relay hybrid for computing Pareto front approximations maximizing the S-metric. In Hybrid Metaheuristics T. Bartz-Beielstein (Ed.). Springer 140--156.   M. Emmerich A. Deutz and N. Beume. 2007. Gradient-based\/evolutionary relay hybrid for computing Pareto front approximations maximizing the S-metric. In Hybrid Metaheuristics T. Bartz-Beielstein (Ed.). Springer 140--156.","DOI":"10.1007\/978-3-540-75514-2_11"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2015.08.618"},{"key":"e_1_2_1_54_1","volume-title":"Proceedings of the Conference on Evolutionary Multi-Criterion Optimization (EMO\u201911)","author":"Emmerich M.","unstructured":"M. Emmerich and C. M. Fonseca . 2011. Computing hypervolume contributions in low dimensions: Asymptotically optimal algorithm and complexity results . In Proceedings of the Conference on Evolutionary Multi-Criterion Optimization (EMO\u201911) . 121--135. M. Emmerich and C. M. Fonseca. 2011. Computing hypervolume contributions in low dimensions: Asymptotically optimal algorithm and complexity results. In Proceedings of the Conference on Evolutionary Multi-Criterion Optimization (EMO\u201911). 121--135."},{"key":"e_1_2_1_55_1","volume-title":"Proceedings of the International Conference on Evolutionary Multi-Criterion Optimization. Springer, 141--155","author":"Eskandari H.","unstructured":"H. Eskandari , C. D. Geiger , and G. B. Lamont . 2007. FastPGA: A dynamic population sizing approach for solving expensive multiobjective optimization problems . In Proceedings of the International Conference on Evolutionary Multi-Criterion Optimization. Springer, 141--155 . H. Eskandari, C. D. Geiger, and G. B. Lamont. 2007. FastPGA: A dynamic population sizing approach for solving expensive multiobjective optimization problems. In Proceedings of the International Conference on Evolutionary Multi-Criterion Optimization. Springer, 141--155."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1115\/1.1623186"},{"key":"e_1_2_1_57_1","volume-title":"Proceedings of the 2nd International Conference on Evolutionary Multi-Criterion Optimization (EMO\u201903)","author":"Farhang-Mehr A.","unstructured":"A. Farhang-Mehr and S. Azarm . 2003. Minimal sets of quality metrics . In Proceedings of the 2nd International Conference on Evolutionary Multi-Criterion Optimization (EMO\u201903) . 405--417. A. Farhang-Mehr and S. Azarm. 2003. Minimal sets of quality metrics. In Proceedings of the 2nd International Conference on Evolutionary Multi-Criterion Optimization (EMO\u201903). 405--417."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11081-009-9099-x"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2003.810733"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.5555\/1760102.1760146"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1162\/evco.1995.3.1.1"},{"key":"e_1_2_1_62_1","volume-title":"Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201996)","volume":"1141","author":"Fonseca C. M.","unstructured":"C. M. Fonseca and P. J. Fleming . 1996. On the performance assessment and comparison of stochastic multiobjective optimizers . In Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201996) . Vol. 1141 . 584--593. C. M. Fonseca and P. J. Fleming. 1996. On the performance assessment and comparison of stochastic multiobjective optimizers. In Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201996). Vol. 1141. 584--593."},{"key":"e_1_2_1_63_1","volume-title":"Proceedings of the IEEE Congress Evolutionary Computation (CEC\u201906)","author":"Fonseca C. M.","unstructured":"C. M. Fonseca , L. Paquete , and M. Lopez-Ibanez . 2006. An improved dimension-sweep algorithm for the hypervolume indicator . In Proceedings of the IEEE Congress Evolutionary Computation (CEC\u201906) . 1157--1163. C. M. Fonseca, L. Paquete, and M. Lopez-Ibanez. 2006. An improved dimension-sweep algorithm for the hypervolume indicator. In Proceedings of the IEEE Congress Evolutionary Computation (CEC\u201906). 1157--1163."},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10951-005-5316-4"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/1569901.1569981"},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2006.882428"},{"key":"e_1_2_1_67_1","first-page":"5","article-title":"Evolutionary multi-objective optimization in uncertain environments","volume":"186","author":"Goh C. K.","year":"2009","unstructured":"C. K. Goh and K. C. Tan . 2009 . Evolutionary multi-objective optimization in uncertain environments . Issues Algor., Studies Comput. Intell. 186 (2009), 5 -- 18 . C. K. Goh and K. C. Tan. 2009. Evolutionary multi-objective optimization in uncertain environments. Issues Algor., Studies Comput. Intell. 186 (2009), 5--18.","journal-title":"Issues Algor., Studies Comput. Intell."},{"key":"e_1_2_1_68_1","volume-title":"Genetic Algorithms in Search, Optimization, and Machine Learning","author":"Goldberg D. E.","unstructured":"D. E. Goldberg . 1989. Genetic Algorithms in Search, Optimization, and Machine Learning . Addison-Wesley . D. E. Goldberg. 1989. Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2017.2729550"},{"key":"e_1_2_1_70_1","volume-title":"Proceedings of the Canadian Conference on Computational Geometry (CCCG\u201912)","author":"Guerreiro A. P.","unstructured":"A. P. Guerreiro , C. M. Fonseca , and M. Emmerich . 2012. A fast dimension-sweep algorithm for the hypervolume indicator in four dimensions . In Proceedings of the Canadian Conference on Computational Geometry (CCCG\u201912) . 77--82. A. P. Guerreiro, C. M. Fonseca, and M. Emmerich. 2012. A fast dimension-sweep algorithm for the hypervolume indicator in four dimensions. In Proceedings of the Canadian Conference on Computational Geometry (CCCG\u201912). 77--82."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1162\/EVCO_a_00053"},{"key":"e_1_2_1_72_1","volume-title":"Proceedings of the 13th International Conference on Multiple Criteria Decision Making. 574--586","author":"Hansen M. P.","year":"1997","unstructured":"M. P. Hansen . 1997 . Tabu search for multiobjective optimization: MOTS . In Proceedings of the 13th International Conference on Multiple Criteria Decision Making. 574--586 . M. P. Hansen. 1997. Tabu search for multiobjective optimization: MOTS. In Proceedings of the 13th International Conference on Multiple Criteria Decision Making. 574--586."},{"key":"e_1_2_1_73_1","unstructured":"M. P. Hansen and A. Jaszkiewicz. 1998. Evaluating the Quality of Approximations to the Nondominated Set. IMM-REP-1998-7. Institute of Mathematical Modeling Technical University of Denmark.  M. P. Hansen and A. Jaszkiewicz. 1998. Evaluating the Quality of Approximations to the Nondominated Set. IMM-REP-1998-7. Institute of Mathematical Modeling Technical University of Denmark."},{"key":"e_1_2_1_74_1","first-page":"1186","article-title":"Discretizing manifolds via minimum energy points","volume":"51","author":"Hardin D. P.","year":"2004","unstructured":"D. P. Hardin and E. B. Saff . 2004 . Discretizing manifolds via minimum energy points . Notices AMS 51 , 10 (2004), 1186 -- 1194 . D. P. Hardin and E. B. Saff. 2004. Discretizing manifolds via minimum energy points. Notices AMS 51, 10 (2004), 1186--1194.","journal-title":"Notices AMS"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2015.2472283"},{"key":"e_1_2_1_76_1","doi-asserted-by":"publisher","DOI":"10.1145\/2517649"},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01720705"},{"key":"e_1_2_1_78_1","volume-title":"Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201913)","author":"Hern\u00e1ndez G. R.","year":"2013","unstructured":"G. R. Hern\u00e1ndez and C. C. A. Coello . 2013 . MOMBI: A new metaheuristic for many-objective optimization based on the R2 indicator . In Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201913) . IEEE, 2488--2495. G. R. Hern\u00e1ndez and C. C. A. Coello. 2013. MOMBI: A new metaheuristic for many-objective optimization based on the R2 indicator. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201913). IEEE, 2488--2495."},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/2739480.2754776"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/2897760"},{"key":"e_1_2_1_81_1","volume-title":"Proceedings of the Congress on Evolutionary Computation","volume":"1","author":"Hiroyasu T.","unstructured":"T. Hiroyasu , M. Miki , and S. Watanabe . 2000. The new model of parallel genetic algorithm in multi-objective optimization problems-divided range multi-objective genetic algorithm . In Proceedings of the Congress on Evolutionary Computation , Vol. 1 . IEEE, 333--340. T. Hiroyasu, M. Miki, and S. Watanabe. 2000. The new model of parallel genetic algorithm in multi-objective optimization problems-divided range multi-objective genetic algorithm. In Proceedings of the Congress on Evolutionary Computation, Vol. 1. IEEE, 333--340."},{"key":"e_1_2_1_82_1","doi-asserted-by":"crossref","unstructured":"I. Hupkens and M. Emmerich. 2013. Logarithmic-time updates in SMS-EMOA and hypervolume-based archiving. In EVOLVE\u2014A Bridge Between Probability Set Oriented Numerics and Evolutionary Computation IV. Springer International Publishing 155--169.  I. Hupkens and M. Emmerich. 2013. Logarithmic-time updates in SMS-EMOA and hypervolume-based archiving. In EVOLVE\u2014A Bridge Between Probability Set Oriented Numerics and Evolutionary Computation IV. Springer International Publishing 155--169.","DOI":"10.1007\/978-3-319-01128-8_11"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.swevo.2017.09.011"},{"key":"e_1_2_1_84_1","doi-asserted-by":"publisher","DOI":"10.1162\/evco.2007.15.1.1"},{"key":"e_1_2_1_85_1","volume-title":"Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201901)","volume":"2","author":"Ikeda K.","unstructured":"K. Ikeda , H. Kita , and S. Kobayashi . 2001. Failure of Pareto-based MOEAs: Does non-dominated really mean near to optimal? In Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201901) , Vol. 2 . 957--962. K. Ikeda, H. Kita, and S. Kobayashi. 2001. Failure of Pareto-based MOEAs: Does non-dominated really mean near to optimal? In Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201901), Vol. 2. 957--962."},{"key":"e_1_2_1_86_1","doi-asserted-by":"crossref","unstructured":"A. Inselberg and B. Dimsdale. 1991. Parallel coordinates. In Human-Machine Interactive Systems. Springer 199--233.  A. Inselberg and B. Dimsdale. 1991. Parallel coordinates. In Human-Machine Interactive Systems. Springer 199--233.","DOI":"10.1007\/978-1-4684-5883-1_9"},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1145\/3071178.3071264"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1162\/evco_a_00226"},{"key":"e_1_2_1_89_1","doi-asserted-by":"crossref","unstructured":"H. Ishibuchi R. Imada Y. Setoguchi and Y. Nojima. 2018. Reference point specification in inverted generational distance for triangular linear Pareto front. IEEE Trans. Evolution. Comput. (2018).  H. Ishibuchi R. Imada Y. Setoguchi and Y. Nojima. 2018. Reference point specification in inverted generational distance for triangular linear Pareto front. IEEE Trans. Evolution. Comput. (2018).","DOI":"10.1109\/TEVC.2017.2776226"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1145\/2739480.2754792"},{"key":"e_1_2_1_91_1","volume-title":"Proceedings of the IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making (MCDM\u201914)","author":"Ishibuchi H.","unstructured":"H. Ishibuchi , H. Masuda , Y. Tanigaki , and Y. Nojima . 2014. Difficulties in specifying reference points to calculate the inverted generational distance for many-objective optimization problems . In Proceedings of the IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making (MCDM\u201914) . 170--177. H. Ishibuchi, H. Masuda, Y. Tanigaki, and Y. Nojima. 2014. Difficulties in specifying reference points to calculate the inverted generational distance for many-objective optimization problems. In Proceedings of the IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making (MCDM\u201914). 170--177."},{"key":"e_1_2_1_92_1","volume-title":"Proceedings of the International Conference on Evolutionary Multi-Criterion Optimization (EMO\u201915)","author":"Ishibuchi H.","unstructured":"H. Ishibuchi , H. Masuda , Y. Tanigaki , and Y. Nojima . 2015. Modified distance calculation in generational distance and inverted generational distance . In Proceedings of the International Conference on Evolutionary Multi-Criterion Optimization (EMO\u201915) . 110--125. H. Ishibuchi, H. Masuda, Y. Tanigaki, and Y. Nojima. 2015. Modified distance calculation in generational distance and inverted generational distance. In Proceedings of the International Conference on Evolutionary Multi-Criterion Optimization (EMO\u201915). 110--125."},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1109\/5326.704576"},{"key":"e_1_2_1_94_1","volume-title":"Proceedings of the Genetic and Evolutionary Computation Conference (GECCO\u201904)","author":"Ishibuchi H.","unstructured":"H. Ishibuchi and Y. Shibata . 2004. Mating scheme for controlling the diversity-convergence balance for multiobjective optimization . In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO\u201904) . 1259--1271. H. Ishibuchi and Y. Shibata. 2004. Mating scheme for controlling the diversity-convergence balance for multiobjective optimization. In Proceedings of the Genetic and Evolutionary Computation Conference (GECCO\u201904). 1259--1271."},{"key":"e_1_2_1_95_1","volume-title":"Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201908)","author":"Ishibuchi H.","unstructured":"H. Ishibuchi , N. Tsukamoto , and Y. Nojima . 2008. Evolutionary many-objective optimization: A short review . In Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201908) . 2419--2426. H. Ishibuchi, N. Tsukamoto, and Y. Nojima. 2008. Evolutionary many-objective optimization: A short review. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201908). 2419--2426."},{"key":"e_1_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1145\/1830483.1830578"},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2003.810752"},{"key":"e_1_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1145\/1569901.1569986"},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cor.2017.09.016"},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2014.2307319"},{"key":"e_1_2_1_101_1","unstructured":"S. Jiang S. Yang and M. Li. 2016. On the use of hypervolume for diversity measurement of Pareto front approximations. In Proceedings of the IEEE Symposium Series on Computational Intelligence (SSCI\u201916). 1--8.  S. Jiang S. Yang and M. Li. 2016. On the use of hypervolume for diversity measurement of Pareto front approximations. In Proceedings of the IEEE Symposium Series on Computational Intelligence (SSCI\u201916). 1--8."},{"key":"e_1_2_1_102_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2014.2367526"},{"key":"e_1_2_1_103_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0377-2217(01)00123-0"},{"key":"e_1_2_1_104_1","doi-asserted-by":"crossref","unstructured":"H. Kaji and H. Kita. 2007. Individual evaluation scheduling for experiment-based evolutionary multi-objective optimization. In Evolutionary Multi-Criterion Optimization. Springer 645--659.   H. Kaji and H. Kita. 2007. Individual evaluation scheduling for experiment-based evolutionary multi-objective optimization. In Evolutionary Multi-Criterion Optimization. Springer 645--659.","DOI":"10.1007\/978-3-540-70928-2_49"},{"key":"e_1_2_1_105_1","doi-asserted-by":"publisher","DOI":"10.1016\/0305-0548(91)90093-7"},{"key":"e_1_2_1_106_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2005.01.029"},{"key":"e_1_2_1_108_1","volume-title":"Proceedings of the Congress Evolutionary Computation (CEC\u201999)","volume":"1","author":"Knowles J. D.","unstructured":"J. D. Knowles and D. W. Corne . 1999. The Pareto archived evolution strategy: A new baseline algorithm for Pareto multiobjective optimisation . In Proceedings of the Congress Evolutionary Computation (CEC\u201999) , Vol. 1 . J. D. Knowles and D. W. Corne. 1999. The Pareto archived evolution strategy: A new baseline algorithm for Pareto multiobjective optimisation. In Proceedings of the Congress Evolutionary Computation (CEC\u201999), Vol. 1."},{"key":"e_1_2_1_109_1","volume-title":"Proceedings of the Congress Evolutionary Computation (CEC\u201902)","volume":"1","author":"Knowles J. D.","unstructured":"J. D. Knowles and D. W. Corne . 2002. On metrics for comparing nondominated sets . In Proceedings of the Congress Evolutionary Computation (CEC\u201902) , Vol. 1 . 711--716. J. D. Knowles and D. W. Corne. 2002. On metrics for comparing nondominated sets. In Proceedings of the Congress Evolutionary Computation (CEC\u201902), Vol. 1. 711--716."},{"key":"e_1_2_1_110_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2003.810755"},{"key":"e_1_2_1_111_1","volume-title":"Proceedings of the Congress on Evolutionary Computation (CEC\u201903)","author":"Knowles J. D.","unstructured":"J. D. Knowles , D. W. Corne , and M. Fleischer . 2003. Bounded archiving using the Lebesgue measure . In Proceedings of the Congress on Evolutionary Computation (CEC\u201903) . 2490--2497. J. D. Knowles, D. W. Corne, and M. Fleischer. 2003. Bounded archiving using the Lebesgue measure. In Proceedings of the Congress on Evolutionary Computation (CEC\u201903). 2490--2497."},{"key":"e_1_2_1_112_1","unstructured":"J. D. Knowles L. Thiele and E. Zitzler. 2006. A Tutorial on the Performance Assessment of Stochastic Multiobjective Optimizers. Technical Report No. 214. Computer Engineering and Networks Laboratory (TIK) ETH Zurich Switzerland.  J. D. Knowles L. Thiele and E. Zitzler. 2006. A Tutorial on the Performance Assessment of Stochastic Multiobjective Optimizers. Technical Report No. 214. Computer Engineering and Networks Laboratory (TIK) ETH Zurich Switzerland."},{"key":"e_1_2_1_113_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-31880-4_27"},{"key":"e_1_2_1_114_1","doi-asserted-by":"publisher","DOI":"10.1162\/EVCO_a_00157"},{"key":"e_1_2_1_115_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cor.2016.06.021"},{"key":"e_1_2_1_116_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2011.03.039"},{"key":"e_1_2_1_117_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCA.2003.817059"},{"key":"e_1_2_1_118_1","doi-asserted-by":"publisher","DOI":"10.1145\/2792984"},{"key":"e_1_2_1_119_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2016.2549267"},{"key":"e_1_2_1_120_1","first-page":"1","article-title":"Performance assessment for preference-based evolutionary multi-objective optimization using reference points","volume":"1","author":"Li K.","year":"2016","unstructured":"K. Li and K. Deb . 2016 . Performance assessment for preference-based evolutionary multi-objective optimization using reference points . COIN Report 1 , 1 (2016), 1 -- 23 . K. Li and K. Deb. 2016. Performance assessment for preference-based evolutionary multi-objective optimization using reference points. COIN Report 1, 1 (2016), 1--23.","journal-title":"COIN Report"},{"key":"e_1_2_1_121_1","doi-asserted-by":"publisher","DOI":"10.1145\/3183399.3183405"},{"key":"e_1_2_1_122_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2017.2655451"},{"key":"e_1_2_1_123_1","unstructured":"M. Li L. Hu and X. Yao. 2019. On comparing two sets of multi-objective solution vectors. arXiv preprint arXiv:1702.00477 (2019).  M. Li L. Hu and X. Yao. 2019. On comparing two sets of multi-objective solution vectors. arXiv preprint arXiv:1702.00477 (2019)."},{"key":"e_1_2_1_124_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2014.2310651"},{"key":"e_1_2_1_125_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2013.2262178"},{"key":"e_1_2_1_126_1","doi-asserted-by":"publisher","DOI":"10.1145\/2739480.2754687"},{"key":"e_1_2_1_127_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2015.06.007"},{"key":"e_1_2_1_128_1","doi-asserted-by":"publisher","DOI":"10.1162\/EVCO_a_00106"},{"key":"e_1_2_1_129_1","volume-title":"Proceedings of the Evolutionary Multi-Criterion Optimization (EMO\u201919)","author":"Li M.","unstructured":"M. Li and X. Yao . 2019. An empirical investigation of the optimality and monotonicity properties of multiobjective archiving methods . In Proceedings of the Evolutionary Multi-Criterion Optimization (EMO\u201919) , in press. M. Li and X. Yao. 2019. An empirical investigation of the optimality and monotonicity properties of multiobjective archiving methods. In Proceedings of the Evolutionary Multi-Criterion Optimization (EMO\u201919), in press."},{"key":"e_1_2_1_130_1","doi-asserted-by":"publisher","DOI":"10.1109\/MCI.2017.2742869"},{"key":"e_1_2_1_131_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-01020-0_20"},{"key":"e_1_2_1_132_1","volume-title":"Proceedings of the IEEE Congress Evolutionary Computation (CEC\u201908)","author":"Li M.","unstructured":"M. Li , J. Zheng , and G. Xiao . 2008. Uniformity assessment for evolutionary multi-objective optimization . In Proceedings of the IEEE Congress Evolutionary Computation (CEC\u201908) . 625--632. M. Li, J. Zheng, and G. Xiao. 2008. Uniformity assessment for evolutionary multi-objective optimization. In Proceedings of the IEEE Congress Evolutionary Computation (CEC\u201908). 625--632."},{"key":"e_1_2_1_133_1","doi-asserted-by":"publisher","DOI":"10.1007\/11539902_8"},{"key":"e_1_2_1_134_1","doi-asserted-by":"publisher","DOI":"10.1145\/2908812.2908906"},{"key":"e_1_2_1_135_1","doi-asserted-by":"publisher","DOI":"10.1145\/1389095.1389227"},{"key":"e_1_2_1_136_1","doi-asserted-by":"publisher","DOI":"10.1145\/1389095.1389242"},{"key":"e_1_2_1_137_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88636-5_42"},{"key":"e_1_2_1_138_1","doi-asserted-by":"publisher","DOI":"10.1109\/CEC.2016.7743898"},{"key":"e_1_2_1_139_1","unstructured":"A. V. Lotov V. A. Bushenkov and G. K. Kamenev. 2013. Interactive Decision Maps: Approximation and Visualization of Pareto Frontier. Vol. 89. Springer Science 8 Business Media.  A. V. Lotov V. A. Bushenkov and G. K. Kamenev. 2013. Interactive Decision Maps: Approximation and Visualization of Pareto Frontier. Vol. 89. Springer Science 8 Business Media."},{"key":"e_1_2_1_140_1","volume-title":"Doklady Mathematics","volume":"66","author":"Lotov A. V.","unstructured":"A. V. Lotov , G. K. Kamenev , and V. E. Berezkin . 2002. Approximation and visualization of the Pareto frontier for nonconvex multicriteria problems . In Doklady Mathematics , Vol. 66 . MAIK Nauka\/Interperiodica, 260--262. A. V. Lotov, G. K. Kamenev, and V. E. Berezkin. 2002. Approximation and visualization of the Pareto frontier for nonconvex multicriteria problems. In Doklady Mathematics, Vol. 66. MAIK Nauka\/Interperiodica, 260--262."},{"key":"e_1_2_1_141_1","doi-asserted-by":"publisher","DOI":"10.1145\/1754399.1754400"},{"key":"e_1_2_1_142_1","doi-asserted-by":"publisher","DOI":"10.1007\/11539117_143"},{"key":"e_1_2_1_143_1","doi-asserted-by":"publisher","DOI":"10.2514\/1.8977"},{"key":"e_1_2_1_144_1","volume-title":"Proceedings of the Congress on Evolutionary Computation (CEC\u201900)","volume":"1","author":"Meunier H.","unstructured":"H. Meunier , E. G. Talbi , and P. Reininger . 2000. A multiobjective genetic algorithm for radio network optimization . In Proceedings of the Congress on Evolutionary Computation (CEC\u201900) , Vol. 1 . 317--324. H. Meunier, E. G. Talbi, and P. Reininger. 2000. A multiobjective genetic algorithm for radio network optimization. In Proceedings of the Congress on Evolutionary Computation (CEC\u201900), Vol. 1. 317--324."},{"key":"e_1_2_1_145_1","volume-title":"Nonlinear Multiobjective Optimization","author":"Miettinen K.","unstructured":"K. Miettinen . 1999. Nonlinear Multiobjective Optimization . Kluwer Academic Publishers , Boston . K. Miettinen. 1999. Nonlinear Multiobjective Optimization. Kluwer Academic Publishers, Boston."},{"key":"e_1_2_1_146_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00291-012-0297-0"},{"key":"e_1_2_1_147_1","volume-title":"Proceedings of the IEEE Congress on Evolutionary Computation. IEEE, 2825--2832","author":"Mohammadi A.","unstructured":"A. Mohammadi , M. N. Omidvar , and X. Li . 2013. A new performance metric for user-preference based multi-objective evolutionary algorithms . In Proceedings of the IEEE Congress on Evolutionary Computation. IEEE, 2825--2832 . A. Mohammadi, M. N. Omidvar, and X. Li. 2013. A new performance metric for user-preference based multi-objective evolutionary algorithms. In Proceedings of the IEEE Congress on Evolutionary Computation. IEEE, 2825--2832."},{"key":"e_1_2_1_148_1","unstructured":"S. Mostaghim and J. Teich. 2005. A new approach on many objective diversity measurement. In Practical Approaches to Multi-Objective Optimization. Springer.  S. Mostaghim and J. Teich. 2005. A new approach on many objective diversity measurement. In Practical Approaches to Multi-Objective Optimization. Springer."},{"key":"e_1_2_1_149_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2013.2290086"},{"key":"e_1_2_1_150_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2013.2292181"},{"key":"e_1_2_1_151_1","doi-asserted-by":"publisher","DOI":"10.1142\/9789812702838_0105"},{"key":"e_1_2_1_152_1","volume-title":"Proceedings of the Congress Evolutionary Computation (CEC\u201903)","volume":"2","author":"Okabe T.","unstructured":"T. Okabe , Y. Jin , and B. Sendhoff . 2003. A critical survey of performance indices for multi-objective optimisation . In Proceedings of the Congress Evolutionary Computation (CEC\u201903) , Vol. 2 . 878--885. T. Okabe, Y. Jin, and B. Sendhoff. 2003. A critical survey of performance indices for multi-objective optimisation. In Proceedings of the Congress Evolutionary Computation (CEC\u201903), Vol. 2. 878--885."},{"key":"e_1_2_1_153_1","unstructured":"T. Pamulapati R. Mallipeddi and P. N. Suganthan. 2018. I<sup>+<\/sup><sub>SDE<\/sub>\u2014An indicator for multi and many-objective optimization. IEEE Trans. Evolution. Comput. in press (2018).  T. Pamulapati R. Mallipeddi and P. N. Suganthan. 2018. I<sup>+<\/sup><sub>SDE<\/sub>\u2014An indicator for multi and many-objective optimization. IEEE Trans. Evolution. Comput. in press (2018)."},{"key":"e_1_2_1_154_1","doi-asserted-by":"publisher","DOI":"10.5555\/795666.796569"},{"key":"e_1_2_1_155_1","volume-title":"Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201913)","author":"Phan D. H.","year":"1836","unstructured":"D. H. Phan and J. Suzuki . 2013. R2-IBEA: R2 indicator based evolutionary algorithm for multiobjective optimization . In Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201913) . IEEE, 1836 --1845. D. H. Phan and J. Suzuki. 2013. R2-IBEA: R2 indicator based evolutionary algorithm for multiobjective optimization. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201913). IEEE, 1836--1845."},{"key":"e_1_2_1_156_1","doi-asserted-by":"publisher","DOI":"10.1145\/2330163.2330234"},{"key":"e_1_2_1_157_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2012.2196800"},{"key":"e_1_2_1_158_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2007.910138"},{"key":"e_1_2_1_159_1","volume-title":"Proceedings of the International Joint Conference on Artificial Intelligence. 1492--1498","author":"Qian C.","unstructured":"C. Qian , G. Li , C. Feng , and K. Tang . 2018. Distributed Pareto optimization for subset selection . In Proceedings of the International Joint Conference on Artificial Intelligence. 1492--1498 . C. Qian, G. Li, C. Feng, and K. Tang. 2018. Distributed Pareto optimization for subset selection. In Proceedings of the International Joint Conference on Artificial Intelligence. 1492--1498."},{"key":"e_1_2_1_160_1","volume-title":"Proceedings of the International Joint Conference on Artificial Intelligence. 1939--1945","author":"Qian C.","unstructured":"C. Qian , J. Shi , Y. Yu , K. Tang , and Z. Zhou . 2016. Parallel Pareto optimization for subset selection . In Proceedings of the International Joint Conference on Artificial Intelligence. 1939--1945 . C. Qian, J. Shi, Y. Yu, K. Tang, and Z. Zhou. 2016. Parallel Pareto optimization for subset selection. In Proceedings of the International Joint Conference on Artificial Intelligence. 1939--1945."},{"key":"e_1_2_1_161_1","unstructured":"C. Qian Y. Yu and Z. Zhou. 2015. Subset selection by Pareto optimization. In Advances in Neural Information Processing Systems. MIT Press 1774--1782.   C. Qian Y. Yu and Z. Zhou. 2015. Subset selection by Pareto optimization. In Advances in Neural Information Processing Systems. MIT Press 1774--1782."},{"key":"e_1_2_1_162_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2017.01.038"},{"key":"e_1_2_1_163_1","volume-title":"Proceedings of the Latin American Computing Conference (CLEI\u201915)","author":"Riquelme N.","unstructured":"N. Riquelme , C. Von L\u00fccken , and B. Baran . 2015. Performance metrics in multi-objective optimization . In Proceedings of the Latin American Computing Conference (CLEI\u201915) . 1--11. N. Riquelme, C. Von L\u00fccken, and B. Baran. 2015. Performance metrics in multi-objective optimization. In Proceedings of the Latin American Computing Conference (CLEI\u201915). 1--11."},{"key":"e_1_2_1_164_1","volume-title":"Proceedings of the 19th Japan Conference on Discrete and Computational Geometry, Graphs, and Games. 58--60","author":"Rote G.","unstructured":"G. Rote , K. Buchin , K. Bringmann , S. Cabello , and M. Emmerich . 2016. Selecting points that maximize the convex hull volume . In Proceedings of the 19th Japan Conference on Discrete and Computational Geometry, Graphs, and Games. 58--60 . G. Rote, K. Buchin, K. Bringmann, S. Cabello, and M. Emmerich. 2016. Selecting points that maximize the convex hull volume. In Proceedings of the 19th Japan Conference on Discrete and Computational Geometry, Graphs, and Games. 58--60."},{"key":"e_1_2_1_165_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10589-015-9815-8"},{"key":"e_1_2_1_166_1","volume-title":"Proceedings of the International Conference on Learning and Intelligent Optimization. 153--156","author":"Rudolph G.","unstructured":"G. Rudolph , O. Sch\u00fctze , C. Grimme , and H. Trautmann . 2014. An aspiration set EMOA based on averaged Hausdorff distances . In Proceedings of the International Conference on Learning and Intelligent Optimization. 153--156 . G. Rudolph, O. Sch\u00fctze, C. Grimme, and H. Trautmann. 2014. An aspiration set EMOA based on averaged Hausdorff distances. In Proceedings of the International Conference on Learning and Intelligent Optimization. 153--156."},{"key":"e_1_2_1_167_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2013.2281525"},{"key":"e_1_2_1_168_1","doi-asserted-by":"publisher","DOI":"10.1007\/s101070050128"},{"key":"e_1_2_1_169_1","volume-title":"Fault Tolerant Design Using Single and Multicriteria Genetic Algorithm Optimization. Master\u2019s thesis. Department of Aeronautics and Astronautics","author":"Schott J. R.","unstructured":"J. R. Schott . 1995. Fault Tolerant Design Using Single and Multicriteria Genetic Algorithm Optimization. Master\u2019s thesis. Department of Aeronautics and Astronautics , Massachusetts Institute of Technology . J. R. Schott. 1995. Fault Tolerant Design Using Single and Multicriteria Genetic Algorithm Optimization. Master\u2019s thesis. Department of Aeronautics and Astronautics, Massachusetts Institute of Technology."},{"key":"e_1_2_1_170_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2011.2161872"},{"key":"e_1_2_1_171_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-31880-4_35"},{"key":"e_1_2_1_172_1","doi-asserted-by":"publisher","DOI":"10.1162\/evco.1994.2.3.221"},{"key":"e_1_2_1_173_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2018.2882166"},{"key":"e_1_2_1_174_1","doi-asserted-by":"publisher","DOI":"10.5555\/604289.604344"},{"key":"e_1_2_1_175_1","volume-title":"Indicator-based selection","author":"Thiele L.","unstructured":"L. Thiele . 2015. Indicator-based selection . In Springer Handbook of Computational Intelligence. Springer , 983--994. L. Thiele. 2015. Indicator-based selection. In Springer Handbook of Computational Intelligence. Springer, 983--994."},{"key":"e_1_2_1_176_1","doi-asserted-by":"publisher","DOI":"10.1162\/evco.2009.17.3.411"},{"key":"e_1_2_1_177_1","unstructured":"Y. Tian R. Cheng X. Zhang F. Cheng and Y. Jin. 2017. An indicator based multi-objective evolutionary algorithm with reference point adaptation for better versatility. IEEE Trans. Evolution. Comput. published online (2017).  Y. Tian R. Cheng X. Zhang F. Cheng and Y. Jin. 2017. An indicator based multi-objective evolutionary algorithm with reference point adaptation for better versatility. IEEE Trans. Evolution. Comput. published online (2017)."},{"key":"e_1_2_1_178_1","doi-asserted-by":"crossref","unstructured":"Y. Tian R. Cheng X. Zhang M. Li and Y. Jin. 2019. Diversity assessment of multi-objective evolutionary algorithms: Performance metric and benchmark problems. IEEE Comput. Intell. Mag. submitted (2019).  Y. Tian R. Cheng X. Zhang M. Li and Y. Jin. 2019. Diversity assessment of multi-objective evolutionary algorithms: Performance metric and benchmark problems. IEEE Comput. Intell. Mag. submitted (2019).","DOI":"10.1109\/MCI.2019.2919398"},{"key":"e_1_2_1_179_1","volume-title":"Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201916)","author":"Tian Y.","unstructured":"Y. Tian , X. Zhang , R. Cheng , and Y. Jin . 2016. A multi-objective evolutionary algorithm based on an enhanced inverted generational distance metric . In Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201916) . 5222--5229. Y. Tian, X. Zhang, R. Cheng, and Y. Jin. 2016. A multi-objective evolutionary algorithm based on an enhanced inverted generational distance metric. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC\u201916). 5222--5229."},{"key":"e_1_2_1_180_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-44973-4_8"},{"key":"e_1_2_1_181_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2016.2608507"},{"key":"e_1_2_1_182_1","unstructured":"P. A. Tukey and J. W. Tukey. 1981. Preparation; Prechosen Sequences of Views. Wiley Chapter Interpreting multivariate data 189--213.  P. A. Tukey and J. W. Tukey. 1981. Preparation; Prechosen Sequences of Views. Wiley Chapter Interpreting multivariate data 189--213."},{"key":"e_1_2_1_183_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2014.2313407"},{"key":"e_1_2_1_184_1","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-1360(199907)8:4<221::AID-MCDA247>3.0.CO;2-O"},{"key":"e_1_2_1_186_1","volume-title":"Proceedings of the Genetic Programming Conference\u2014Late-breaking Papers. 221--228","author":"Van Veldhuizen D. A.","unstructured":"D. A. Van Veldhuizen and G. B. Lamont . 1998. Evolutionary computation and convergence to a Pareto front . In Proceedings of the Genetic Programming Conference\u2014Late-breaking Papers. 221--228 . D. A. Van Veldhuizen and G. B. Lamont. 1998. Evolutionary computation and convergence to a Pareto front. In Proceedings of the Genetic Programming Conference\u2014Late-breaking Papers. 221--228."},{"key":"e_1_2_1_187_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cor.2015.05.003"},{"key":"e_1_2_1_188_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tcs.2013.05.013"},{"key":"e_1_2_1_189_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0377-2217(99)00163-0"},{"key":"e_1_2_1_190_1","doi-asserted-by":"publisher","DOI":"10.1145\/2330163.2330235"},{"key":"e_1_2_1_191_1","doi-asserted-by":"crossref","unstructured":"T. Wagner H. Trautmann and D. Brockhoff. 2013. Preference Articulation by Means of the R2 Indicator. Springer 81--95.  T. Wagner H. Trautmann and D. Brockhoff. 2013. Preference Articulation by Means of the R2 Indicator. Springer 81--95.","DOI":"10.1007\/978-3-642-37140-0_10"},{"key":"e_1_2_1_192_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2012.2225064"},{"key":"e_1_2_1_193_1","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.1070.0838"},{"key":"e_1_2_1_194_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2016.2550502"},{"key":"e_1_2_1_195_1","volume-title":"Proceedings of the International Conference on Swarm Intelligence. 530--539","author":"Wang R.","unstructured":"R. Wang , S. Chen , L. Ma , S. Cheng , and Y. Shi . 2018. Multi-indicator bacterial foraging algorithm with Kriging model for many-objective optimization . In Proceedings of the International Conference on Swarm Intelligence. 530--539 . R. Wang, S. Chen, L. Ma, S. Cheng, and Y. Shi. 2018. Multi-indicator bacterial foraging algorithm with Kriging model for many-objective optimization. In Proceedings of the International Conference on Swarm Intelligence. 530--539."},{"key":"e_1_2_1_196_1","doi-asserted-by":"publisher","DOI":"10.1145\/2884781.2884880"},{"key":"e_1_2_1_197_1","volume-title":"Proceedings of the IEEE Congress on Evolutionary Computation. 1--8.","author":"Wessing S.","unstructured":"S. Wessing and B. Naujoks . 2010. Sequential parameter optimization for multi-objective problems . In Proceedings of the IEEE Congress on Evolutionary Computation. 1--8. S. Wessing and B. Naujoks. 2010. Sequential parameter optimization for multi-objective problems. In Proceedings of the IEEE Congress on Evolutionary Computation. 1--8."},{"key":"e_1_2_1_198_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2010.2077298"},{"key":"e_1_2_1_199_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2005.851275"},{"key":"e_1_2_1_200_1","doi-asserted-by":"publisher","DOI":"10.1115\/1.1329875"},{"key":"e_1_2_1_201_1","doi-asserted-by":"publisher","DOI":"10.1145\/3176644"},{"key":"e_1_2_1_202_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2012.2227145"},{"key":"e_1_2_1_203_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2013.2240687"},{"key":"e_1_2_1_204_1","volume-title":"Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201914)","author":"Yevseyeva I.","unstructured":"I. Yevseyeva , A. P. Guerreiro , M. Emmerich , and C. M. Fonseca . 2014. A portfolio optimization approach to selection in multiobjective evolutionary algorithms . In Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201914) . 672--681. I. Yevseyeva, A. P. Guerreiro, M. Emmerich, and C. M. Fonseca. 2014. A portfolio optimization approach to selection in multiobjective evolutionary algorithms. In Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201914). 672--681."},{"key":"e_1_2_1_205_1","doi-asserted-by":"publisher","DOI":"10.1145\/2261250.2261267"},{"key":"e_1_2_1_206_1","volume-title":"Proceedings of the IEEE Congress on Evolutionary Computation. 908--915","author":"Yu G.","unstructured":"G. Yu , J. Zheng , and X. Li . 2015. An improved performance metric for multiobjective evolutionary algorithms with user preferences . In Proceedings of the IEEE Congress on Evolutionary Computation. 908--915 . G. Yu, J. Zheng, and X. Li. 2015. An improved performance metric for multiobjective evolutionary algorithms with user preferences. In Proceedings of the IEEE Congress on Evolutionary Computation. 908--915."},{"key":"e_1_2_1_207_1","volume-title":"Compromise programming","author":"Zeleny M.","unstructured":"M. Zeleny . 1973. Compromise programming . In Multi Criteria Decision Making, J. L. Cochrane and M. Zeleny (Eds.). University of South Carolina Press , 262--301. M. Zeleny. 1973. Compromise programming. In Multi Criteria Decision Making, J. L. Cochrane and M. Zeleny (Eds.). University of South Carolina Press, 262--301."},{"key":"e_1_2_1_208_1","volume-title":"Proceedings of the IEEE Congress on Evolutionary Computation. 892--899","author":"Zhou A.","unstructured":"A. Zhou , Y. Jin , Q. Zhang , B. Sendhoff , and E. Tsang . 2006. Combining model-based and genetics-based offspring generation for multi-objective optimization using a convergence criterion . In Proceedings of the IEEE Congress on Evolutionary Computation. 892--899 . A. Zhou, Y. Jin, Q. Zhang, B. Sendhoff, and E. Tsang. 2006. Combining model-based and genetics-based offspring generation for multi-objective optimization using a convergence criterion. In Proceedings of the IEEE Congress on Evolutionary Computation. 892--899."},{"key":"e_1_2_1_209_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.swevo.2011.03.001"},{"key":"e_1_2_1_211_1","volume-title":"Proceedings of the International Conference on Evolutionary Multi-Criterion Optimization. Springer, 862--876","author":"Zitzler E.","unstructured":"E. Zitzler , D. Brockhoff , and L. Thiele . 2007. The hypervolume indicator revisited: On the design of Pareto-compliant indicators via weighted integration . In Proceedings of the International Conference on Evolutionary Multi-Criterion Optimization. Springer, 862--876 . E. Zitzler, D. Brockhoff, and L. Thiele. 2007. The hypervolume indicator revisited: On the design of Pareto-compliant indicators via weighted integration. In Proceedings of the International Conference on Evolutionary Multi-Criterion Optimization. Springer, 862--876."},{"key":"e_1_2_1_212_1","doi-asserted-by":"publisher","DOI":"10.1162\/106365600568202"},{"key":"e_1_2_1_213_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-88908-3_14"},{"key":"e_1_2_1_214_1","volume-title":"Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201904)","author":"Zitzler E.","unstructured":"E. Zitzler and S. K\u00fcnzli . 2004. Indicator-based selection in multiobjective search . In Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201904) . 832--842. E. Zitzler and S. K\u00fcnzli. 2004. Indicator-based selection in multiobjective search. In Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201904). 832--842."},{"key":"e_1_2_1_215_1","volume-title":"Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201998)","author":"Zitzler E.","unstructured":"E. Zitzler and L. Thiele . 1998. Multiobjective optimization using evolutionary algorithms\u2014A comparative case study . In Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201998) . 292--301. E. Zitzler and L. Thiele. 1998. Multiobjective optimization using evolutionary algorithms\u2014A comparative case study. In Proceedings of the International Conference on Parallel Problem Solving from Nature (PPSN\u201998). 292--301."},{"key":"e_1_2_1_216_1","doi-asserted-by":"publisher","DOI":"10.1109\/4235.797969"},{"key":"e_1_2_1_217_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEVC.2003.810758"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3300148","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3300148","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:25:22Z","timestamp":1750206322000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3300148"}},"subtitle":["A Survey"],"short-title":[],"issued":{"date-parts":[[2019,3,18]]},"references-count":214,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2020,3,31]]}},"alternative-id":["10.1145\/3300148"],"URL":"https:\/\/doi.org\/10.1145\/3300148","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,3,18]]},"assertion":[{"value":"2018-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-03-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}