{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,31]],"date-time":"2026-01-31T08:31:02Z","timestamp":1769848262899,"version":"3.49.0"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2021,12,4]],"date-time":"2021-12-04T00:00:00Z","timestamp":1638576000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,12,4]],"date-time":"2021-12-04T00:00:00Z","timestamp":1638576000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002341","name":"Academy of Finland","doi-asserted-by":"publisher","award":["322221"],"award-info":[{"award-number":["322221"]}],"id":[{"id":"10.13039\/501100002341","id-type":"DOI","asserted-by":"publisher"}]},{"name":"academy of finland","award":["311877"],"award-info":[{"award-number":["311877"]}]},{"DOI":"10.13039\/100014440","name":"Ministerio de Ciencia, Innovaci\u00f3n y Universidades","doi-asserted-by":"publisher","award":["PID2020-115429GB-I00"],"award-info":[{"award-number":["PID2020-115429GB-I00"]}],"id":[{"id":"10.13039\/100014440","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002878","name":"Consejer\u00eda de Econom\u00eda, Innovaci\u00f3n, Ciencia y Empleo, Junta de Andaluc\u00eda","doi-asserted-by":"publisher","award":["UMA18-FEDERJA-024"],"award-info":[{"award-number":["UMA18-FEDERJA-024"]}],"id":[{"id":"10.13039\/501100002878","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Universidad de Malaga","award":["B1-202018"],"award-info":[{"award-number":["B1-202018"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2023,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Solving multiobjective optimization problems with interactive methods enables a decision maker with domain expertise to direct the search for the most preferred trade-offs with preference information and learn about the problem. There are different interactive methods, and it is important to compare them and find the best-suited one for solving the problem in question. Comparisons with real decision makers are expensive, and artificial decision makers (ADMs) have been proposed to simulate humans in basic testing before involving real decision makers. Existing ADMs only consider one type of preference information. In this paper, we propose ADM-II, which is tailored to assess several interactive evolutionary methods and is able to handle different types of preference information. We consider two phases of interactive solution processes, i.e., learning and decision phases separately, so that the proposed ADM-II generates preference information in different ways in each of them to reflect the nature of the phases. We demonstrate how ADM-II can be applied with different methods and problems. We also propose an indicator to assess and compare the performance of interactive evolutionary methods.<\/jats:p>","DOI":"10.1007\/s40747-021-00586-5","type":"journal-article","created":{"date-parts":[[2021,12,4]],"date-time":"2021-12-04T03:07:01Z","timestamp":1638587221000},"page":"1165-1181","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Comparing interactive evolutionary multiobjective optimization methods with an artificial decision maker"],"prefix":"10.1007","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3643-2342","authenticated-orcid":false,"given":"Bekir","family":"Afsar","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0543-8055","authenticated-orcid":false,"given":"Ana B.","family":"Ruiz","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1013-4689","authenticated-orcid":false,"given":"Kaisa","family":"Miettinen","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2021,12,4]]},"reference":[{"key":"586_CR1","doi-asserted-by":"crossref","unstructured":"Afsar B, Miettinen K, Ruiz AB (2021) An artificial decision maker for comparing reference point based interactive evolutionary multiobjective optimization methods. In: Ishibuchi H, Zhang Q, Cheng R, Li K, Li H, Wang H, Zhou A (eds) Evolutionary multi-criterion optimization, 11th international conference, EMO 2021, Proceedings. Springer, pp 619\u2013631","DOI":"10.1007\/978-3-030-72062-9_49"},{"issue":"4","key":"586_CR2","first-page":"85","volume":"54","author":"B Afsar","year":"2021","unstructured":"Afsar B, Miettinen K, Ruiz F (2021) Assessing the performance of interactive multiobjective optimization methods: a survey. ACM Comput Surv 54(4):85","journal-title":"ACM Comput Surv"},{"key":"586_CR3","doi-asserted-by":"crossref","unstructured":"Barba-Gonz\u00e1lez C, Ojalehto V, Garc\u00eda-Nieto J.M, Nebro AJ, Miettinen K, Aldana-Montes JF (2018) Artificial decision maker driven by PSO: an approach for testing reference point based interactive methods. In: Auger A, Fonseca CM, Louren\u00e7o N, Machado P, Paquete L, Whitley D (eds) Parallel problem solving from nature\u2014PPSN XV, 15th international conference, Proceedings, Part I. Springer, pp 274\u2013285","DOI":"10.1007\/978-3-319-99253-2_22"},{"key":"586_CR4","doi-asserted-by":"crossref","unstructured":"Branke J, Deb K, Miettinen K, Slowinski R (eds) (2008) Multiobjective optimization. Interactive and evolutionary approaches. Springer, Berlin","DOI":"10.1007\/978-3-540-88908-3"},{"issue":"5","key":"586_CR5","doi-asserted-by":"publisher","first-page":"773","DOI":"10.1109\/TEVC.2016.2519378","volume":"20","author":"R Cheng","year":"2016","unstructured":"Cheng R, Jin Y, Olhofer M, Sendhoff B (2016) A reference vector guided evolutionary algorithm for many-objective optimization. IEEE Trans Evol Comput 20(5):773\u2013791","journal-title":"IEEE Trans Evol Comput"},{"issue":"1","key":"586_CR6","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1109\/TEVC.2016.2622301","volume":"22","author":"T Chugh","year":"2018","unstructured":"Chugh T, Jin Y, Miettinen K, Hakanen J, Sindhya K (2018) A surrogate-assisted reference vector guided evolutionary algorithm for computationally expensive many-objective optimization. IEEE Trans Evol Comput 22(1):129\u2013142","journal-title":"IEEE Trans Evol Comput"},{"key":"586_CR7","doi-asserted-by":"publisher","DOI":"10.1002\/9780470907443","volume-title":"Experiments with mixtures: designs, models, and the analysis of mixture data","author":"JA Cornell","year":"2011","unstructured":"Cornell JA (2011) Experiments with mixtures: designs, models, and the analysis of mixture data. Wiley, New York"},{"issue":"4","key":"586_CR8","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1109\/TEVC.2013.2281535","volume":"18","author":"K Deb","year":"2013","unstructured":"Deb K, Jain H (2013) An evolutionary many-objective optimization algorithm using reference-point-based nondominated sorting approach, part I: solving problems with box constraints. IEEE Trans Evol Comput 18(4):577\u2013601","journal-title":"IEEE Trans Evol Comput"},{"issue":"6","key":"586_CR9","doi-asserted-by":"publisher","first-page":"821","DOI":"10.1109\/TEVC.2010.2041667","volume":"14","author":"K Deb","year":"2010","unstructured":"Deb K, Miettinen K, Chaudhuri S (2010) Towards an estimation of nadir objective vector using a hybrid of evolutionary and local search approaches. IEEE Trans Evol Comput 14(6):821\u2013841","journal-title":"IEEE Trans Evol Comput"},{"key":"586_CR10","doi-asserted-by":"crossref","unstructured":"Deb K, Thiele L, Laumanns M, Zitzler E (2002) Scalable multi-objective optimization test problems. In: 2002 congress on evolutionary computation, Proceedings, pp 825\u2013830","DOI":"10.1109\/CEC.2002.1007032"},{"key":"586_CR11","doi-asserted-by":"crossref","unstructured":"Hakanen J, Chugh T, Sindhya K, Jin Y, Miettinen K (2016) Connections of reference vectors and different types of preference information in interactive multiobjective evolutionary algorithms. In: 2016 IEEE symposium series on computational intelligence, Proceedings. IEEE, pp 1\u20138","DOI":"10.1109\/SSCI.2016.7850220"},{"key":"586_CR12","doi-asserted-by":"crossref","unstructured":"Hou Z, Yang S, Zou J, Zheng J, Yu G, Ruan G (2018) A performance indicator for reference-point-based multiobjective evolutionary optimization. In: 2018 IEEE symposium series on computational intelligence, Proceedings. IEEE, pp 1571\u20131578","DOI":"10.1109\/SSCI.2018.8628834"},{"issue":"1\u20132","key":"586_CR13","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1002\/mcda.1534","volume":"22","author":"S Huber","year":"2015","unstructured":"Huber S, Geiger MJ, Sevaux M (2015) Simulation of preference information in an interactive reference point-based method for the bi-objective inventory routing problem. J Multi-Criteria Decis Anal 22(1\u20132):17\u201335","journal-title":"J Multi-Criteria Decis Anal"},{"issue":"6","key":"586_CR14","doi-asserted-by":"publisher","first-page":"821","DOI":"10.1109\/TEVC.2017.2737781","volume":"22","author":"K Li","year":"2018","unstructured":"Li K, Deb K, Yao X (2018) R-metric: evaluating the performance of preference-based evolutionary multiobjective optimization using reference points. IEEE Trans Evol Comput 22(6):821\u2013835","journal-title":"IEEE Trans Evol Comput"},{"issue":"2","key":"586_CR15","first-page":"26","volume":"52","author":"M Li","year":"2019","unstructured":"Li M, Yao X (2019) Quality evaluation of solution sets in multiobjective optimisation: a survey. ACM Comput Surv 52(2):26","journal-title":"ACM Comput Surv"},{"key":"586_CR16","doi-asserted-by":"crossref","unstructured":"L\u00f3pez-Ib\u00e1nez M, Knowles J (2015) Machine decision makers as a laboratory for interactive EMO. In: Gaspar-Cunha A, HenggelerAntunes C, Coello CC (eds) Evolutionary multi-criterion optimization, 8th international conference, Proceedings, Part II. Springer, pp 295\u2013309","DOI":"10.1007\/978-3-319-15892-1_20"},{"issue":"1","key":"586_CR17","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1007\/s00291-008-0154-3","volume":"33","author":"M Luque","year":"2011","unstructured":"Luque M, Ruiz F, Miettinen K (2011) Global formulation for interactive multiobjective optimization. OR Spectrum 33(1):27\u201348","journal-title":"OR Spectrum"},{"key":"586_CR18","doi-asserted-by":"crossref","unstructured":"Meignan D, Knust S, Frayret JM, Pesant G, Gaud N (2015) A review and taxonomy of interactive optimization methods in operations research. ACM Trans Interact Intell Syst 5(3):171\u20131743","DOI":"10.1145\/2808234"},{"key":"586_CR19","volume-title":"Nonlinear multiobjective optimization","author":"K Miettinen","year":"1999","unstructured":"Miettinen K (1999) Nonlinear multiobjective optimization. Kluwer Academic Publishers, Boston"},{"key":"586_CR20","doi-asserted-by":"crossref","unstructured":"Miettinen K, Hakanen J, Podkopaev D (2016) Interactive nonlinear multiobjective optimization methods. In: Greco S, Ehrgott M, Figueira J (eds) Multiple criteria decision analysis: state of the art surveys, 2 edn. Springer, pp 931\u2013980","DOI":"10.1007\/978-1-4939-3094-4_22"},{"key":"586_CR21","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1007\/978-3-540-88908-3_2","volume-title":"Multiobjective optimization: interactive and evolutionary approaches","author":"K Miettinen","year":"2008","unstructured":"Miettinen K, Ruiz F, Wierzbicki AP (2008) Introduction to multiobjective optimization: interactive approaches. In: Branke J, Deb K, Miettinen K, S\u0142owi\u0144ski R (eds) Multiobjective optimization: interactive and evolutionary approaches. Springer, Berlin, pp 27\u201357"},{"key":"586_CR22","doi-asserted-by":"crossref","unstructured":"Misitano G, Saini BS, Afsar B, Shavazipour B, Miettinen K (2021) DESDEO: The modular and open source framework for interactive multiobjective optimization. IEEE Access 9:148277\u2013148295","DOI":"10.1109\/ACCESS.2021.3123825"},{"key":"586_CR23","doi-asserted-by":"crossref","unstructured":"Mohammadi A, Omidvar MN, Li X(2013) A new performance metric for user-preference based multi-objective evolutionary algorithms. In: 2013 IEEE congress on evolutionary computation, Proceedings. IEEE, pp 2825\u20132832","DOI":"10.1109\/CEC.2013.6557912"},{"key":"586_CR24","doi-asserted-by":"crossref","unstructured":"Ojalehto V, Podkopaev D, Miettinen K (2016) Towards automatic testing of reference point based interactive methods. In: Handl J, Hart E, Lewis PR, L\u00f3pez-Ib\u00e1nez M, Ochoa G, Paechter B (eds) Parallel problem solving from nature\u2014PPSN XIV, 14th international conference, Proceedings. Springer, pp 483\u2013492","DOI":"10.1007\/978-3-319-45823-6_45"},{"issue":"1","key":"586_CR25","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1007\/s10479-010-0831-x","volume":"197","author":"F Ruiz","year":"2012","unstructured":"Ruiz F, Luque M, Miettinen K (2012) Improving the computational efficiency in a global formulation (GLIDE) for interactive multiobjective optimization. Ann Oper Res 197(1):47\u201370","journal-title":"Ann Oper Res"},{"key":"586_CR26","volume-title":"Multiple criteria optimization: theory, computation and application","author":"RE Steuer","year":"1986","unstructured":"Steuer RE (1986) Multiple criteria optimization: theory, computation and application. Wiley, New York"},{"issue":"3","key":"586_CR27","first-page":"16","volume":"3","author":"M Szczepanski","year":"2003","unstructured":"Szczepanski M, Wierzbicki AP (2003) Application of multiple criteria evolutionary algorithm to vector optimization, decision support and reference-point approaches. J Telecommun Inf Technol 3(3):16\u201333","journal-title":"J Telecommun Inf Technol"},{"key":"586_CR28","doi-asserted-by":"publisher","first-page":"468","DOI":"10.1007\/978-3-642-48782-8_32","volume-title":"Multiple criteria decision making, theory and applications","author":"AP Wierzbicki","year":"1980","unstructured":"Wierzbicki AP (1980) The use of reference objectives in multiobjective optimization. In: Fandel G, Gal T (eds) Multiple criteria decision making, theory and applications. Springer, Berlin, pp 468\u2013486"},{"key":"586_CR29","doi-asserted-by":"publisher","first-page":"41256","DOI":"10.1109\/ACCESS.2018.2856832","volume":"6","author":"B Xin","year":"2018","unstructured":"Xin B, Chen L, Chen J, Ishibuchi H, Hirota K, Liu B (2018) Interactive multiobjective optimization: a review of the state-of-the-art. IEEE Access 6:41256\u201341279","journal-title":"IEEE Access"},{"key":"586_CR30","doi-asserted-by":"crossref","unstructured":"Yu G, Zheng J, Li X (2015) An improved performance metric for multiobjective evolutionary algorithms with user preferences. In: 2015 IEEE congress on evolutionary computation, Proceedings. IEEE, pp 908\u2013915","DOI":"10.1109\/CEC.2015.7256987"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-021-00586-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-021-00586-5\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-021-00586-5.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,18]],"date-time":"2023-04-18T09:19:27Z","timestamp":1681809567000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-021-00586-5"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,4]]},"references-count":30,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,4]]}},"alternative-id":["586"],"URL":"https:\/\/doi.org\/10.1007\/s40747-021-00586-5","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"value":"2199-4536","type":"print"},{"value":"2198-6053","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,4]]},"assertion":[{"value":"5 July 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 October 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 December 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declaration"}},{"value":"The authors declared that they have no conflicts of interest regarding the publication of this manuscript.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflicts of interest\/competing interests"}},{"value":"The implementation of ADM-II in Python is openly available under the DESDEO framework at","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Code availability"}}]}}