{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,19]],"date-time":"2026-08-19T19:04:17Z","timestamp":1787166257704,"version":"build-2736575974"},"reference-count":67,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2020,12,28]],"date-time":"2020-12-28T00:00:00Z","timestamp":1609113600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,12,28]],"date-time":"2020-12-28T00:00:00Z","timestamp":1609113600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100015963","name":"Scuola IMT Alti Studi Lucca","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100015963","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach Learn"],"published-print":{"date-parts":[[2021,2]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    This paper proposes a method for solving optimization problems in which the decision-maker cannot evaluate the objective function, but rather can only express a\n                    <jats:italic>preference<\/jats:italic>\n                    such as \u201cthis is better than that\u201d between two candidate decision vectors. The algorithm described in this paper aims at reaching the global optimizer by iteratively proposing the decision maker a new comparison to make, based on actively learning a surrogate of the latent (unknown and perhaps unquantifiable) objective function from past sampled decision vectors and pairwise preferences. A radial-basis function surrogate is fit via linear or quadratic programming, satisfying if possible the preferences expressed by the decision maker on existing samples. The surrogate is used to propose a new sample of the decision vector for comparison with the current best candidate based on two possible criteria: minimize a combination of the surrogate and an inverse weighting distance function to balance between exploitation of the surrogate and exploration of the decision space, or maximize a function related to the probability that the new candidate will be preferred. Compared to active preference learning based on Bayesian optimization, we show that our approach is competitive in that, within the same number of comparisons, it usually approaches the global optimum more closely and is computationally lighter. Applications of the proposed algorithm to solve a set of benchmark global optimization problems, for multi-objective optimization, and for optimal tuning of a cost-sensitive neural network classifier for object recognition from images are described in the paper. MATLAB and a Python implementations of the algorithms described in the paper are available at\n                    <jats:ext-link xmlns:xlink=\"http:\/\/www.w3.org\/1999\/xlink\" ext-link-type=\"uri\" xlink:href=\"http:\/\/cse.lab.imtlucca.it\/%7ebemporad\/glis\">http:\/\/cse.lab.imtlucca.it\/~bemporad\/glis<\/jats:ext-link>\n                    .\n                  <\/jats:p>","DOI":"10.1007\/s10994-020-05935-y","type":"journal-article","created":{"date-parts":[[2020,12,28]],"date-time":"2020-12-28T10:03:07Z","timestamp":1609149787000},"page":"417-448","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":53,"title":["Global optimization based on active preference learning with radial basis functions"],"prefix":"10.1007","volume":"110","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6761-0856","authenticated-orcid":false,"given":"Alberto","family":"Bemporad","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dario","family":"Piga","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,12,28]]},"reference":[{"key":"5935_CR1","unstructured":"Abdolshah, M., Shilton, A., Rana, S., Gupta, S., & Venkatesh, S. (2019). Multi-objective Bayesian optimisation with preferences over objectives. arXiv:190204228."},{"key":"5935_CR2","doi-asserted-by":"crossref","unstructured":"Akrour, R., Schoenauer, M., & Sebag, M. (2012). April: Active preference learning-based reinforcement learning. In Joint European conference on machine learning and knowledge discovery in databases (pp. 116\u2013131). Springer","DOI":"10.1007\/978-3-642-33486-3_8"},{"key":"5935_CR3","first-page":"1503","volume":"32","author":"R Akrour","year":"2014","unstructured":"Akrour, R., Schoenauer, M., Sebag, M., & Souplet, J. C. (2014). Programming by feedback. International Conference on Machine Learning, 32, 1503\u20131511.","journal-title":"International Conference on Machine Learning"},{"key":"5935_CR4","unstructured":"Bemporad, A. (2020). Global optimization via inverse distance weighting and radial basis functions. Computational Optimization and Applications (In press). https:\/\/arxiv.org\/pdf\/1906.06498.pdf."},{"key":"5935_CR5","unstructured":"Brochu, E., de Freitas, N., & Ghosh, A. (2008). Active preference learning with discrete choice data. In Advances in neural information processing systems (pp. 409\u2013416)."},{"key":"5935_CR6","unstructured":"Brochu, E., Cora, V., & Freitas, N.D. (2010). A tutorial on Bayesian optimization of expensive cost functions, with application to active user modeling and hierarchical reinforcement learning. arXiv:10122599."},{"key":"5935_CR7","unstructured":"Busa-Fekete, R., H\u00fcllermeier, E., & Mesaoudi-Paul, A.E. (2018). Preference-based online learning with dueling bandits: A survey. arXiv:180711398."},{"issue":"3","key":"5935_CR8","doi-asserted-by":"publisher","first-page":"463","DOI":"10.1038\/nn.3649","volume":"17","author":"B Chau","year":"2014","unstructured":"Chau, B., Kolling, N., Hunt, L., Walton, M., & Rushworth, M. (2014). A neural mechanism underlying failure of optimal choice with multiple alternatives. Nature neuroscience, 17(3), 463.","journal-title":"Nature neuroscience"},{"issue":"2","key":"5935_CR9","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1016\/j.jcps.2014.08.002","volume":"25","author":"A Chernev","year":"2015","unstructured":"Chernev, A., B\u00f6ckenholt, U., & Goodman, J. (2015). Choice overload: A conceptual review and meta-analysis. Journal of Consumer Psychology, 25(2), 333\u2013358.","journal-title":"Journal of Consumer Psychology"},{"issue":"1","key":"5935_CR10","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1007\/s10479-007-0186-0","volume":"154","author":"A Chinchuluun","year":"2007","unstructured":"Chinchuluun, A., & Pardalos, P. (2007). A survey of recent developments in multiobjective optimization. Annals of Operations Research, 154(1), 29\u201350.","journal-title":"Annals of Operations Research"},{"key":"5935_CR11","unstructured":"Christiano, P.F., Leike, J., Brown, T., Martic, M., Legg, S., & Amodei, D. (2017). Deep reinforcement learning from human preferences. In Advances in neural information processing systems (pp. 4299\u20134307)."},{"key":"5935_CR12","unstructured":"Chu, W., & Ghahramani, Z. (2005a). Extensions of Gaussian processes for ranking: semisupervised and active learning. In NIPS workshop on learning to rank."},{"key":"5935_CR13","doi-asserted-by":"crossref","unstructured":"Chu, W., & Ghahramani, Z. (2005b). Preference learning with Gaussian processes. In Proceedings of the 22nd international conference on machine learning (pp. 137\u2013144). ACM","DOI":"10.1145\/1102351.1102369"},{"key":"5935_CR14","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1613\/jair.587","volume":"10","author":"W Cohen","year":"1999","unstructured":"Cohen, W., Schapire, R., & Singer, Y. (1999). Learning to order things. Journal of Artificial Intelligence Research, 10, 243\u2013270.","journal-title":"Journal of Artificial Intelligence Research"},{"key":"5935_CR15","unstructured":"Franc, V., Zien, A., & Sch\u00f6lkopf, B. (2011). Support vector machines as probabilistic models. In Proceedings of the 28th international conference on machine learning, Bellevue, WA, USA (pp. 665\u2013672)."},{"issue":"1\u20132","key":"5935_CR16","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1007\/s10994-012-5313-8","volume":"89","author":"J F\u00fcrnkranz","year":"2012","unstructured":"F\u00fcrnkranz, J., H\u00fcllermeier, E., Cheng, W., & Park, S. H. (2012). Preference-based reinforcement learning: a formal framework and a policy iteration algorithm. Machine Learning, 89(1\u20132), 123\u2013156.","journal-title":"Machine Learning"},{"key":"5935_CR17","doi-asserted-by":"crossref","unstructured":"Gervasio, M.T., Moffitt, M.D., Pollack, M.E., Taylor, J.M., & Uribe, T.E. (2005). Active preference learning for personalized calendar scheduling assistance. In Proceedings of the 10th international conference on Intelligent user interfaces (pp. 90\u201397).","DOI":"10.1145\/1040830.1040857"},{"key":"5935_CR18","unstructured":"Gonz\u00e1lez, J., Dai, Z., Damianou, A., & Lawrence, N.D. (2017). Preferential Bayesian optimization. In Proceedings of the 34th international conference on machine learning (pp. 1282\u20131291)."},{"issue":"3","key":"5935_CR19","doi-asserted-by":"publisher","first-page":"201","DOI":"10.1023\/A:1011255519438","volume":"19","author":"HM Gutmann","year":"2001","unstructured":"Gutmann, H. M. (2001). A radial basis function method for global optimization. Journal of Global Optimization, 19(3), 201\u2013227.","journal-title":"Journal of Global Optimization"},{"issue":"Jul","key":"5935_CR21","first-page":"317","volume":"4","author":"P Haddawy","year":"2003","unstructured":"Haddawy, P., Ha, V., Restificar, A., Geisler, B., & Miyamoto, J. (2003). Preference elicitation via theory refinement. Journal of Machine Learning Research, 4(Jul), 317\u2013337.","journal-title":"Journal of Machine Learning Research"},{"key":"5935_CR22","doi-asserted-by":"crossref","unstructured":"Har-Peled, S., Roth, D., & Zimak, D. (2002). Constraint classification: A new approach to multiclass classification and ranking. Advances in Neural Information Processing Systems 15.","DOI":"10.1007\/3-540-36169-3_29"},{"key":"5935_CR23","unstructured":"Herbrich, R., Graepel, T., Bollmann-Sdorra, P., & Obermayer, K. (1998). Supervised learning of preference relations. Proceedings des Fachgruppentreffens Maschinelles Lernen (FGML-98) (pp. 43\u201347)."},{"issue":"16\u201317","key":"5935_CR24","doi-asserted-by":"publisher","first-page":"1897","DOI":"10.1016\/j.artint.2008.08.002","volume":"172","author":"E H\u00fcllermeier","year":"2008","unstructured":"H\u00fcllermeier, E., F\u00fcrnkranz, J., Cheng, W., & Brinker, K. (2008). Label ranking by learning pairwise preferences. Artificial Intelligence, 172(16\u201317), 1897\u20131916.","journal-title":"Artificial Intelligence"},{"issue":"4","key":"5935_CR25","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1023\/A:1008382309369","volume":"14","author":"W Huyer","year":"1999","unstructured":"Huyer, W., & Neumaier, A. (1999). Global optimization by multilevel coordinate search. Journal of Global Optimization, 14(4), 331\u2013355.","journal-title":"Journal of Global Optimization"},{"issue":"3","key":"5935_CR26","doi-asserted-by":"publisher","first-page":"1730","DOI":"10.1109\/20.767363","volume":"35","author":"T Ishikawa","year":"1999","unstructured":"Ishikawa, T., Tsukui, Y., & Matsunami, M. (1999). A combined method for the global optimization using radial basis function and deterministic approach. IEEE Transactions on Magnetics, 35(3), 1730\u20131733.","journal-title":"IEEE Transactions on Magnetics"},{"issue":"2","key":"5935_CR27","doi-asserted-by":"publisher","first-page":"150","DOI":"10.1504\/IJMMNO.2013.055204","volume":"4","author":"M Jamil","year":"2013","unstructured":"Jamil, M., & Yang, X. S. (2013). A literature survey of benchmark functions for global optimisation problems. International Journal of Mathematical Modelling and Numerical Optimisation, 4(2), 150\u2013194.","journal-title":"International Journal of Mathematical Modelling and Numerical Optimisation"},{"key":"5935_CR28","doi-asserted-by":"crossref","unstructured":"Joachims, T. (2002). Optimizing search engines using clickthrough data. In Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining (pp. 133\u2013142).","DOI":"10.1145\/775047.775067"},{"key":"5935_CR29","unstructured":"Johnson, S. (2020). The NLopt nonlinear-optimization package. http:\/\/github.com\/stevengj\/nlopt."},{"issue":"4","key":"5935_CR30","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1023\/A:1012771025575","volume":"21","author":"D Jones","year":"2001","unstructured":"Jones, D. (2001). A taxonomy of global optimization methods based on response surfaces. Journal of Global Optimization, 21(4), 345\u2013383.","journal-title":"Journal of Global Optimization"},{"key":"5935_CR31","doi-asserted-by":"crossref","unstructured":"Jones, D. (2009). DIRECT global optimization algorithm. In Encyclopedia of optimization (pp. 725\u2013735).","DOI":"10.1007\/978-0-387-74759-0_128"},{"issue":"4","key":"5935_CR32","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1023\/A:1008306431147","volume":"13","author":"D Jones","year":"1998","unstructured":"Jones, D., Schonlau, M., & Matthias, W. (1998). Efficient global optimization of expensive black-box functions. Journal of Global Optimization, 13(4), 455\u2013492.","journal-title":"Journal of Global Optimization"},{"key":"5935_CR33","unstructured":"Kennedy, J. (2010). Particle swarm optimization. In Encyclopedia of machine learning (pp. 760\u2013766)."},{"key":"5935_CR34","unstructured":"Kingma, D.P., & Ba, J.L. (2015). Adam: a method for stochastic optimization. In: Proceedings of the international conference on learning representation, San Diego, CA, USA."},{"key":"5935_CR35","unstructured":"Komiyama, J., Honda, J., Kashima, H., & Nakagawa, H. (2015). Regret lower bound and optimal algorithm in dueling bandit problem. In Conference on learning theory (pp. 1141\u20131154)."},{"key":"5935_CR36","unstructured":"Krizhevsky, A. (2009). Learning multiple layers of features from tiny images. In CIFAR-10 (Canadian Institute for Advanced Research). http:\/\/www.cs.toronto.edu\/~kriz\/cifar.html"},{"issue":"1","key":"5935_CR37","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1115\/1.3653121","volume":"86","author":"H Kushner","year":"1964","unstructured":"Kushner, H. (1964). A new method of locating the maximum point of an arbitrary multipeak curve in the presence of noise. Journal of Basic Engineering, 86(1), 97\u2013106.","journal-title":"Journal of Basic Engineering"},{"issue":"8","key":"5935_CR38","doi-asserted-by":"publisher","first-page":"1246","DOI":"10.2113\/gsecongeo.58.8.1246","volume":"58","author":"G Matheron","year":"1963","unstructured":"Matheron, G. (1963). Principles of geostatistics. Economic Geology, 58(8), 1246\u20131266.","journal-title":"Economic Geology"},{"issue":"10","key":"5935_CR39","doi-asserted-by":"publisher","first-page":"2095","DOI":"10.1016\/j.apm.2006.08.008","volume":"31","author":"D McDonald","year":"2007","unstructured":"McDonald, D., Grantham, W., Tabor, W., & Murphy, M. (2007). Global and local optimization using radial basis function response surface models. Applied Mathematical Modelling, 31(10), 2095\u20132110.","journal-title":"Applied Mathematical Modelling"},{"issue":"2","key":"5935_CR40","first-page":"239","volume":"21","author":"M McKay","year":"1979","unstructured":"McKay, M., Beckman, R., & Conover, W. (1979). Comparison of three methods for selecting values of input variables in the analysis of output from a computer code. Technometrics, 21(2), 239\u2013245.","journal-title":"Technometrics"},{"issue":"3","key":"5935_CR41","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1109\/LCSYS.2019.2913347","volume":"3","author":"D Piga","year":"2019","unstructured":"Piga, D., Forgione, M., Formentin, S., & Bemporad, A. (2019). Performance-oriented model learning for data-driven MPC design. IEEE Control Systems Letters, 3(3), 577\u2013582.","journal-title":"IEEE Control Systems Letters"},{"issue":"6","key":"5935_CR42","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1147\/JRD.2018.2881731","volume":"62","author":"EO Pyzer-Knapp","year":"2018","unstructured":"Pyzer-Knapp, E. O. (2018). Bayesian optimization for accelerated drug discovery. IBM Journal of Research and Development, 62(6), 2\u20131.","journal-title":"IBM Journal of Research and Development"},{"issue":"1","key":"5935_CR43","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1007\/s10898-004-0570-0","volume":"31","author":"RG Regis","year":"2005","unstructured":"Regis, R. G., & Shoemaker, C. A. (2005). Constrained global optimization of expensive black box functions using radial basis functions. Journal of Global Optimization, 31(1), 153\u2013171.","journal-title":"Journal of Global Optimization"},{"issue":"3","key":"5935_CR44","doi-asserted-by":"publisher","first-page":"1247","DOI":"10.1007\/s10898-012-9951-y","volume":"56","author":"L Rios","year":"2013","unstructured":"Rios, L., & Sahinidis, N. (2013). Derivative-free optimization: a review of algorithms and comparison of software implementations. Journal of Global Optimization, 56(3), 1247\u20131293.","journal-title":"Journal of Global Optimization"},{"key":"5935_CR45","unstructured":"Sacks, J., Welch, W., Mitchell, T., & Wynn, H. (1989). Design and analysis of computer experiments. In: Statistical science (pp. 409\u2013423)."},{"key":"5935_CR46","unstructured":"Sadigh, D., Dragan, A.D., Sastry, S., & Seshia, S.A. (2017). Active preference-based learning of reward functions. In Robotics: Science and systems."},{"issue":"3","key":"5935_CR47","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1080\/03052150211751","volume":"34","author":"M Sasena","year":"2002","unstructured":"Sasena, M., Papalambros, P., & Goovaerts, P. (2002). Exploration of metamodeling sampling criteria for constrained global optimization. Engineering Optimization, 34(3), 263\u2013278.","journal-title":"Engineering Optimization"},{"key":"5935_CR48","doi-asserted-by":"crossref","unstructured":"Shepard, D. (1968). A two-dimensional interpolation function for irregularly-spaced data. In Proceedings of the ACM national conference, New York (pp. 517\u2013524).","DOI":"10.1145\/800186.810616"},{"issue":"1","key":"5935_CR49","doi-asserted-by":"publisher","first-page":"99","DOI":"10.2307\/1884852","volume":"69","author":"H Simon","year":"1955","unstructured":"Simon, H. (1955). A behavioral model of rational choice. The Quarterly Journal of Economics, 69(1), 99\u2013118.","journal-title":"The Quarterly Journal of Economics"},{"key":"5935_CR50","volume-title":"A\/B testing: The most powerful way to turn clicks into customers","author":"D Siroker","year":"2013","unstructured":"Siroker, D., & Koomen, P. (2013). A\/B testing: The most powerful way to turn clicks into customers. Hoboken: Wiley."},{"issue":"2","key":"5935_CR51","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1111\/j.2517-6161.1974.tb00994.x","volume":"36","author":"M Stone","year":"1974","unstructured":"Stone, M. (1974). Cross-validatory choice and assessment of statistical predictions. Journal of the Royal Statistical Society: Series B (Methodological), 36(2), 111\u2013133.","journal-title":"Journal of the Royal Statistical Society: Series B (Methodological)"},{"key":"5935_CR52","doi-asserted-by":"crossref","unstructured":"Sui, Y., & Burdick, J. (2014). Clinical online recommendation with subgroup rank feedback. In Proceedings of the 8th ACM conference on recommender systems (pp. 289\u2013292).","DOI":"10.1145\/2645710.2645773"},{"key":"5935_CR53","unstructured":"Sui, Y., Yue, Y., & Burdick, J.W. (2017). Correlational dueling bandits with application to clinical treatment in large decision spaces. arXiv:170702375."},{"key":"5935_CR54","unstructured":"Tesauro, G. (1989). Connectionist learning of expert preferences by comparison training. In Advances in neural information processing systems (pp. 99\u2013106)."},{"issue":"4","key":"5935_CR55","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1037\/h0070288","volume":"34","author":"L Thurstone","year":"1927","unstructured":"Thurstone, L. (1927). A law of comparative judgment. Psychological Review, 34(4), 273.","journal-title":"Psychological Review"},{"key":"5935_CR56","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1016\/j.md.2016.04.001","volume":"4","author":"T Ueno","year":"2016","unstructured":"Ueno, T., Rhone, T. D., Hou, Z., Mizoguchi, T., & Tsuda, K. (2016). COMBO: an efficient Bayesian optimization library for materials science. Materials Discovery, 4, 18\u201321.","journal-title":"Materials Discovery"},{"issue":"2","key":"5935_CR57","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1007\/s10898-007-9133-5","volume":"39","author":"A Vaz","year":"2007","unstructured":"Vaz, A., & Vicente, L. (2007). A particle swarm pattern search method for bound constrained global optimization. Journal of Global Optimization, 39(2), 197\u2013219.","journal-title":"Journal of Global Optimization"},{"key":"5935_CR58","unstructured":"Vaz, A., & Vicente, L. (2009). PSwarm: A hybrid solver for linearly constrained global derivative-free optimization. Optimization Methods and Software 24:669\u2013685; http:\/\/www.norg.uminho.pt\/aivaz\/pswarm\/."},{"issue":"5","key":"5935_CR59","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1016\/0167-9236(94)90016-7","volume":"11","author":"J Wang","year":"1994","unstructured":"Wang, J. (1994). Artificial neural networks versus natural neural networks: A connectionist paradigm for preference assessment. Decision Support Systems, 11(5), 415\u2013429.","journal-title":"Decision Support Systems"},{"issue":"6","key":"5935_CR60","doi-asserted-by":"publisher","first-page":"651","DOI":"10.1177\/0278364920910802","volume":"39","author":"N Wilde","year":"2020","unstructured":"Wilde, N., Blidaru, A., Smith, S. L., & Kuli\u0107, D. (2020a). Improving user specifications for robot behavior through active preference learning: Framework and evaluation. The International Journal of Robotics Research, 39(6), 651\u2013667.","journal-title":"The International Journal of Robotics Research"},{"key":"5935_CR61","doi-asserted-by":"crossref","unstructured":"Wilde, N., Kulic, D., & Smith, S.L. (2020b). Active preference learning using maximum regret.arXiv:200504067.","DOI":"10.1109\/IROS45743.2020.9341530"},{"key":"5935_CR62","unstructured":"Wilson, A., Fern, A., & Tadepalli, P. (2012). A Bayesian approach for policy learning from trajectory preference queries. In Advances in neural information processing systems (pp. 1133\u20131141)."},{"key":"5935_CR63","unstructured":"Wu, H., & Liu, X. (2016). Double thompson sampling for dueling bandits. In Advances in neural information processing systems (pp. 649\u2013657)."},{"key":"5935_CR64","unstructured":"Yue, Y., & Joachims, T. (2011). Beat the mean bandit. In Proceedings of the 28th international conference on machine learning (ICML-11), (pp. 241\u2013248)."},{"issue":"5","key":"5935_CR65","doi-asserted-by":"publisher","first-page":"1538","DOI":"10.1016\/j.jcss.2011.12.028","volume":"78","author":"Y Yue","year":"2012","unstructured":"Yue, Y., Broder, J., Kleinberg, R., & Joachims, T. (2012). The k-armed dueling bandits problem. Journal of Computer and System Sciences, 78(5), 1538\u20131556.","journal-title":"Journal of Computer and System Sciences"},{"key":"5935_CR66","unstructured":"Zhu, M., Bemporad, A., & Piga, D. (2020). Preference-based MPC calibration. arXiv:200311294."},{"key":"5935_CR67","unstructured":"Zoghi, M., Whiteson, S., Munos, R., & Rijke, M. (2014). Relative upper confidence bound for the k-armed dueling bandit problem. In International conference on machine learning (pp. 10\u201318)."},{"key":"5935_CR68","unstructured":"Zoghi, M., Karnin, Z.S., Whiteson, S., & De\u00a0Rijke, M. (2015). Copeland dueling bandits. In Advances in neural information processing systems (pp. 307\u2013315)."}],"container-title":["Machine Learning"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-020-05935-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10994-020-05935-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-020-05935-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,20]],"date-time":"2024-08-20T03:22:08Z","timestamp":1724124128000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10994-020-05935-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,12,28]]},"references-count":67,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,2]]}},"alternative-id":["5935"],"URL":"https:\/\/doi.org\/10.1007\/s10994-020-05935-y","relation":{},"ISSN":["0885-6125","1573-0565"],"issn-type":[{"value":"0885-6125","type":"print"},{"value":"1573-0565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,12,28]]},"assertion":[{"value":"2 June 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 November 2020","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 December 2020","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 December 2020","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}