{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T07:05:37Z","timestamp":1779174337014,"version":"3.51.4"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"23","license":[{"start":{"date-parts":[[2020,10,24]],"date-time":"2020-10-24T00:00:00Z","timestamp":1603497600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,10,24]],"date-time":"2020-10-24T00:00:00Z","timestamp":1603497600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002954","name":"Universit\u00e0 degli Studi di Milano - Bicocca","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100002954","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Soft Comput"],"published-print":{"date-parts":[[2020,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Modelling human function learning has been the subject of intense research in cognitive sciences. The topic is relevant in black-box optimization where information about the objective and\/or constraints is not available and must be learned through function evaluations. In this paper, we focus on the relation between the behaviour of humans searching for the maximum and the probabilistic model used in Bayesian optimization. As surrogate models of the unknown function, both Gaussian processes and random forest have been considered: the Bayesian learning paradigm is central in the development of active learning approaches balancing exploration\/exploitation in uncertain conditions towards effective generalization in large decision spaces. In this paper, we analyse experimentally how Bayesian optimization compares to humans searching for the maximum of an unknown 2D function. A set of controlled experiments with 60 subjects, using both surrogate models, confirm that Bayesian optimization provides a general model to represent individual patterns of active learning in humans.<\/jats:p>","DOI":"10.1007\/s00500-020-05398-2","type":"journal-article","created":{"date-parts":[[2020,10,24]],"date-time":"2020-10-24T07:02:34Z","timestamp":1603522954000},"page":"17771-17785","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Modelling human active search in optimizing black-box functions"],"prefix":"10.1007","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1431-576X","authenticated-orcid":false,"given":"Antonio","family":"Candelieri","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0117-2237","authenticated-orcid":false,"given":"Riccardo","family":"Perego","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6065-0473","authenticated-orcid":false,"given":"Ilaria","family":"Giordani","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrea","family":"Ponti","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1131-3830","authenticated-orcid":false,"given":"Francesco","family":"Archetti","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2020,10,24]]},"reference":[{"key":"5398_CR1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-24494-1","volume-title":"Bayesian optimization and data science","author":"F Archetti","year":"2019","unstructured":"Archetti F, Candelieri A (2019) Bayesian optimization and data science. Springer, New York"},{"issue":"4","key":"5398_CR2","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1007\/s11047-007-9049-5","volume":"6","author":"A Banks","year":"2007","unstructured":"Banks A, Vincent J, Anyakoha C (2007) A review of particle swarm optimization. Part I: background and development. Nat Comput 6(4):467\u2013484","journal-title":"Nat Comput"},{"key":"5398_CR3","unstructured":"Bischl B, Richter J, Bossek J, Horn D, Thomas J, Lang M (2017) mlrMBO: a modular framework for model-based optimization of expensive black-box functions. arXiv preprint arXiv:1703.03373"},{"key":"5398_CR4","unstructured":"Borji A, Itti L (2013) Bayesian optimization explains human active search. In: Advances in neural information processing systems, pp 55\u201363"},{"issue":"1","key":"5398_CR5","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1007\/s10898-018-0641-2","volume":"71","author":"A Candelieri","year":"2018","unstructured":"Candelieri A, Perego R, Archetti F (2018) Bayesian optimization of pump operations in water distribution systems. J Glob Optim 71(1):213\u2013235","journal-title":"J Glob Optim"},{"key":"5398_CR6","doi-asserted-by":"crossref","unstructured":"Candelieri A, Perego R, Giordani I, Archetti F (2019) Are humans Bayesian in the optimization of black-box functions? In: International conference on numerical computations: theory and algorithms. Springer, Cham, pp 32\u201342","DOI":"10.1007\/978-3-030-40616-5_3"},{"key":"5398_CR7","doi-asserted-by":"publisher","first-page":"861","DOI":"10.1613\/jair.1.11420","volume":"64","author":"K Eggensperger","year":"2019","unstructured":"Eggensperger K, Lindauer M, Hutter F (2019) Pitfalls and best practices in algorithm configuration. J Artif Intell Res 64:861\u2013893","journal-title":"J Artif Intell Res"},{"issue":"3","key":"5398_CR8","doi-asserted-by":"publisher","first-page":"277","DOI":"10.1037\/dec0000101","volume":"6","author":"SJ Gershman","year":"2019","unstructured":"Gershman SJ (2019) Uncertainty and exploration. Decision 6(3):277","journal-title":"Decision"},{"issue":"30","key":"5398_CR9","doi-asserted-by":"publisher","first-page":"7892","DOI":"10.1073\/pnas.1700811114","volume":"114","author":"A Gopnik","year":"2017","unstructured":"Gopnik A, O\u2019Grady S, Lucas CG, Griffiths TL, Wente A, Bridgers S, Dahl RE (2017) Changes in cognitive flexibility and hypothesis search across human life history from childhood to adolescence to adulthood. Proc Natl Acad Sci 114(30):7892\u20137899","journal-title":"Proc Natl Acad Sci"},{"key":"5398_CR10","volume-title":"Cambridge handbook of computational cognitive modelling","author":"TL Griffiths","year":"2008","unstructured":"Griffiths TL, Kemp C, Tenenbaum JB (2008) Bayesian models of cognition. In: Sun R (ed) Cambridge handbook of computational cognitive modelling. Cambridge University Press, Cambridge"},{"key":"5398_CR11","unstructured":"Hartford JS, Wright JR, Leyton-Brown K (2016) Deep learning for predicting human strategic behaviour. In: Advances in neural information processing systems, pp 2424\u20132432"},{"key":"5398_CR12","unstructured":"Ho TK (1995) Random decision forests. In: Proceedings of 3rd international conference on document analysis and recognition. IEEE, vol 1, pp 278\u2013282"},{"issue":"1","key":"5398_CR13","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1007\/BF00941892","volume":"79","author":"DR Jones","year":"1993","unstructured":"Jones DR, Perttunen CD, Stuckman BE (1993) Lipschitzian optimization without the Lipschitz constant. J Optim Theory Appl 79(1):157\u2013181","journal-title":"J Optim Theory Appl"},{"issue":"3","key":"5398_CR14","doi-asserted-by":"publisher","first-page":"210","DOI":"10.3758\/LB.36.3.210","volume":"36","author":"JK Kruschke","year":"2008","unstructured":"Kruschke JK (2008) Bayesian approaches to associative learning: From passive to active learning. Learn Behav 36(3):210\u2013226","journal-title":"Learn Behav"},{"key":"5398_CR15","doi-asserted-by":"crossref","unstructured":"Kushner HJ (1964) A new method of locating the maximum point of an arbitrary multipeak curve in the presence of noise","DOI":"10.1115\/1.3653121"},{"key":"5398_CR16","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1007\/978-94-015-7744-1_2","volume-title":"Simulated annealing: theory and applications","author":"PJ Van Laarhoven","year":"1987","unstructured":"Van Laarhoven PJ, Aarts EH (1987) Simulated annealing. In: van Laarhoven PJ, Aarts EH (eds) Simulated annealing: theory and applications. Springer, Dordrecht, pp 7\u201315"},{"key":"5398_CR17","first-page":"390","volume":"94","author":"D Lera","year":"2021","unstructured":"Lera D, Posypkin M, Sergeyev YD (2021) Space-filling curves for numerical approximation and visualization of solutions to systems of nonlinear inequalities with applications in robotics. Appl Math Comput 94:390","journal-title":"Appl Math Comput"},{"issue":"3","key":"5398_CR18","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1037\/dec0000033","volume":"2","author":"K Mehlhorn","year":"2015","unstructured":"Mehlhorn K, Newell BR, Todd PM, Lee MD, Morgan K, Braithwaite VA, Gonzalez C (2015) Unpacking the exploration\u2013exploitation tradeoff: a synthesis of human and animal literatures. Decision 2(3):191","journal-title":"Decision"},{"key":"5398_CR19","doi-asserted-by":"crossref","unstructured":"Mo\u010dkus J (1975) On Bayesian methods for seeking the extremum. In: Optimization techniques IFIP technical conference. Springer, Berlin, pp 400\u2013404","DOI":"10.1007\/978-3-662-38527-2_55"},{"key":"5398_CR20","unstructured":"Plonsky O, Apel R, Ert E, Tennenholtz M, Bourgin D, Peterson JC, Cavanagh JF (2019) Predicting human decisions with behavioral theories and machine learning. arXiv preprint arXiv:1904.06866"},{"issue":"6","key":"5398_CR21","doi-asserted-by":"publisher","first-page":"927","DOI":"10.1037\/xlm0000463","volume":"44","author":"E Schulz","year":"2018","unstructured":"Schulz E, Konstantinidis E, Speekenbrink M (2018a) Putting bandits into context: How function learning supports decision making. J Exp Psychol Learn Mem Cogn 44(6):927","journal-title":"J Exp Psychol Learn Mem Cogn"},{"key":"5398_CR22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.jmp.2018.03.001","volume":"85","author":"E Schulz","year":"2018","unstructured":"Schulz E, Speekenbrink M, Krause A (2018b) A tutorial on Gaussian process regression: modelling, exploring, and exploiting functions. J Math Psychol 85:1\u201316","journal-title":"J Math Psychol"},{"key":"5398_CR23","unstructured":"Schulz E, Tenenbaum JB, Reshef DN, Speekenbrink M, Gershman S (2015) Assessing the perceived predictability of functions. In: CogSci"},{"key":"5398_CR24","unstructured":"Schulz E, Speekenbrink M, Hern\u00e1ndez-Lobato JM, Ghahramani Z, Gershman SJ (2016a) Quantifying mismatch in Bayesian optimization. In: Nips workshop on Bayesian optimization: black-box optimization and beyond"},{"key":"5398_CR25","unstructured":"Schulz E, Tenenbaum J, Duvenaud DK, Speekenbrink M, Gershman SJ (2016b) Probing the compositionality of intuitive functions. In: Advances in neural information processing systems, pp 3729\u20133737"},{"issue":"4","key":"5398_CR26","first-page":"1","volume":"53","author":"L Scrucca","year":"2013","unstructured":"Scrucca L (2013) GA: a package for genetic algorithms in R. J Stat Softw Found Open Access Stat 53(4):1\u201337","journal-title":"J Stat Softw Found Open Access Stat"},{"key":"5398_CR27","doi-asserted-by":"crossref","unstructured":"Scrucca L (2016) On some extensions to GA package: hybrid optimisation, parallelisation and islands evolution. arXiv preprint arXiv:1605.01931","DOI":"10.32614\/RJ-2017-008"},{"key":"5398_CR29","doi-asserted-by":"publisher","first-page":"113134","DOI":"10.1016\/j.cam.2020.113134","volume":"383","author":"YD Sergeyev","year":"2020","unstructured":"Sergeyev YD, Nasso MC, Mukhametzhanov MS, Kvasov DE (2020a) Novel local tuning techniques for speeding up one-dimensional algorithms in expensive global optimization using Lipschitz derivatives. J Comput Appl Math 383:113134","journal-title":"J Comput Appl Math"},{"key":"5398_CR28","first-page":"1","volume":"2020","author":"YD Sergeyev","year":"2020","unstructured":"Sergeyev YD, Candelieri A, Kvasov DE, Perego R (2020b) Safe global optimization of expensive noisy black-box functions in the \u03b4-Lipschitz framework. Soft Comput 2020:1\u201321","journal-title":"Soft Comput"},{"key":"5398_CR30","unstructured":"Srinivas N, Krause A, Kakade SM, Seeger M (2009) Gaussian process optimization in the bandit setting: No regret and experimental design. arXiv preprint arXiv:0912.3995"},{"key":"5398_CR31","first-page":"4","volume-title":"Gaussian processes for machine learning, vol 2, no 3","author":"CK Williams","year":"2006","unstructured":"Williams CK, Rasmussen CE (2006) Gaussian processes for machine learning, vol 2, no 3. MIT Press, Cambridge, p 4"},{"key":"5398_CR32","unstructured":"Wilson AG, Dann C, Lucas C, Xing EP (2015) The human kernel. In: Advances in neural information processing systems, pp 2854\u20132862"},{"issue":"12","key":"5398_CR33","doi-asserted-by":"publisher","first-page":"915","DOI":"10.1038\/s41562-018-0467-4","volume":"2","author":"CM Wu","year":"2018","unstructured":"Wu CM, Schulz E, Speekenbrink M, Nelson JD, Meder B (2018) Generalization guides human exploration in vast decision spaces. Nat Hum Behav 2(12):915\u2013924","journal-title":"Nat Hum Behav"},{"key":"5398_CR34","volume-title":"Stochastic global optimization, vol 9","author":"A Zhigljavsky","year":"2007","unstructured":"Zhigljavsky A, Zilinskas A (2007) Stochastic global optimization, vol 9. Springer, New York"}],"container-title":["Soft Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00500-020-05398-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00500-020-05398-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00500-020-05398-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,10,23]],"date-time":"2021-10-23T19:19:30Z","timestamp":1635016770000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00500-020-05398-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,24]]},"references-count":34,"journal-issue":{"issue":"23","published-print":{"date-parts":[[2020,12]]}},"alternative-id":["5398"],"URL":"https:\/\/doi.org\/10.1007\/s00500-020-05398-2","relation":{},"ISSN":["1432-7643","1433-7479"],"issn-type":[{"value":"1432-7643","type":"print"},{"value":"1433-7479","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,24]]},"assertion":[{"value":"24 October 2020","order":1,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and\/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Informed consent was obtained from all individual participants included in the study.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}]}}