{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,1]],"date-time":"2026-07-01T03:26:23Z","timestamp":1782876383854,"version":"3.54.5"},"reference-count":32,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,12,8]],"date-time":"2022-12-08T00:00:00Z","timestamp":1670457600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/L015358\/1"],"award-info":[{"award-number":["EP\/L015358\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/T020946\/1"],"award-info":[{"award-number":["EP\/T020946\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/T021144\/1"],"award-info":[{"award-number":["EP\/T021144\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Appl. Math. Stat."],"abstract":"<jats:p>Bayesian optimization (BO) provides an effective method to optimize expensive-to-evaluate black box functions. It has been widely applied to problems in many fields, including notably in computer science, e.g., in machine learning to optimize hyperparameters of neural networks, and in engineering, e.g., in fluid dynamics to optimize control strategies that maximize drag reduction. This paper empirically studies and compares the performance and the robustness of common BO algorithms on a range of synthetic test functions to provide general guidance on the design of BO algorithms for specific problems. It investigates the choice of acquisition function, the effect of different numbers of training samples, the exact and Monte Carlo (MC) based calculation of acquisition functions, and both single-point and multi-point optimization. The test functions considered cover a wide selection of challenges and therefore serve as an ideal test bed to understand the performance of BO to specific challenges, and in general. To illustrate how these findings can be used to inform a Bayesian optimization setup tailored to a specific problem, two simulations in the area of computational fluid dynamics (CFD) are optimized, giving evidence that suitable solutions can be found in a small number of evaluations of the objective function for complex, real problems. The results of our investigation can similarly be applied to other areas, such as machine learning and physical experiments, where objective functions are expensive to evaluate and their mathematical expressions are unknown.<\/jats:p>","DOI":"10.3389\/fams.2022.1076296","type":"journal-article","created":{"date-parts":[[2022,12,8]],"date-time":"2022-12-08T16:02:20Z","timestamp":1670515340000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":54,"title":["Investigating Bayesian optimization for expensive-to-evaluate black box functions: Application in fluid dynamics"],"prefix":"10.3389","volume":"8","author":[{"given":"Mike","family":"Diessner","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joseph","family":"O'Connor","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew","family":"Wynn","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sylvain","family":"Laizet","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu","family":"Guan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kevin","family":"Wilson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Richard D.","family":"Whalley","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2022,12,8]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"148","DOI":"10.1109\/JPROC.2015.2494218","article-title":"Taking the human out of the loop: a review of Bayesian optimization","volume":"104","author":"Shahriari","year":"2015","journal-title":"Proc IEEE."},{"key":"B2","doi-asserted-by":"crossref","DOI":"10.1201\/9780367815493","volume-title":"Surrogates: Gaussian Process Modeling, Design, and Optimization for the Applied Sciences.","author":"Gramacy","year":"2020"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1410.8859","article-title":"Parallel optimization for large Eddy simulations","author":"Talnikar","year":"2014","journal-title":"arXiv Preprint"},{"key":"B4","doi-asserted-by":"publisher","first-page":"094601","DOI":"10.1103\/PhysRevFluids.4.094601","article-title":"Reducing the skin-friction drag of a turbulent boundary-layer flow with low-amplitude wall-normal blowing within a Bayesian optimization framework","volume":"4","author":"Mahfoze","year":"2019","journal-title":"Phys Rev Fluids."},{"key":"B5","doi-asserted-by":"publisher","first-page":"110788","DOI":"10.1016\/j.jcp.2021.110788","article-title":"Applying Bayesian optimization with Gaussian process regression to computational fluid dynamics problems","volume":"449","author":"Morita","year":"2022","journal-title":"J Comput Phys."},{"key":"B6","doi-asserted-by":"publisher","first-page":"JFST0024","DOI":"10.1299\/jfst.2021jfst0024","article-title":"Bayesian optimization of traveling wave-like wall deformation for friction drag reduction in turbulent channel flow","volume":"16","author":"Nabae","year":"2021","journal-title":"J Fluid Sci Technol."},{"key":"B7","doi-asserted-by":"publisher","first-page":"26","DOI":"10.11989\/JEST.1674-862X.80904120","article-title":"Hyperparameter optimization for machine learning models based on Bayesian optimization","volume":"17","author":"Wu","year":"2019","journal-title":"J Electr Sci Technol"},{"key":"B8","first-page":"2951","article-title":"Practical Bayesian optimization of machine learning algorithms","volume-title":"Advances in Neural Information Processing Systems 25","author":"Snoek","year":"2012"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.0912.3995","article-title":"Gaussian process optimization in the bandit setting: No regret and experimental design","author":"Srinivas","year":"2009","journal-title":"arXiv Preprint."},{"key":"B10","doi-asserted-by":"publisher","first-page":"4215","DOI":"10.1016\/j.csda.2012.04.020","article-title":"The effect of the nugget on Gaussian process emulators of computer models","volume":"56","author":"Andrianakis","year":"2012","journal-title":"Comput Statist Data Anal."},{"key":"B11","doi-asserted-by":"publisher","first-page":"713","DOI":"10.1007\/s11222-010-9224-x","article-title":"Cases for the nugget in modeling computer experiments","volume":"22","author":"Gramacy","year":"2012","journal-title":"Stat Comput."},{"key":"B12","volume-title":"Gaussian Processes for Machine Learning.","author":"Rasmussen","year":"2006"},{"key":"B13","first-page":"327","article-title":"Portfolio allocation for Bayesian optimization","volume-title":"UAI'11: Proceedings of the Twenty-Seventh Conference on Uncertainty in Artificial Intelligence","author":"Brochu","year":"2011"},{"key":"B14","first-page":"3627","article-title":"Max-value entropy search for efficient Bayesian optimization","volume-title":"Proceedings of the 34th International Conference on Machine Learning, PMLR","author":"Wang","year":"2017"},{"key":"B15","first-page":"9334","article-title":"Multi-fidelity Bayesian optimization with max-value entropy search and its parallelization","author":"Takeno","year":"2020","journal-title":"Proceedings of the 37th International Conference on Machine Learning, PMLR"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1712.00424","article-title":"The reparameterization trick for acquisition functions","author":"Wilson","year":"2017","journal-title":"arXiv Preprint."},{"key":"B17","first-page":"21524","article-title":"BoTorch: a framework for efficient Monte-CarloBayesian optimization","volume-title":"33rd Annual Conference on Neural Information Processing Systems. NeurIPS 2019","author":"Balandat","year":"2020"},{"key":"B18","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1007\/978-3-642-10701-6_6","article-title":"Kriging is well-suited to parallelize optimization","volume-title":"Computational Intelligence in Expensive Optimization Problems.","author":"Ginsbourger","year":"2010"},{"key":"B19","unstructured":"Parallelizing exploration-exploitation tradeoffs in gaussian process bandit optimization4053103\n            DesautelsT\n            KrauseA\n            BurdickJW\n          J Mach Learn Res.152014"},{"key":"B20","first-page":"1","article-title":"Optical MEMS sensors for instantaneous wall-shear stress measurements in turbulent boundary-layer flows","volume-title":"12th Symposium on Turbulence and Shear Flow Phenomena (TSFP)","author":"Ebrahimzade","year":"2022"},{"key":"B21","doi-asserted-by":"publisher","first-page":"611","DOI":"10.1007\/s11081-010-9129-8","article-title":"Space-filling Latin hypercube designs for computer experiments","volume":"12","author":"Husslage","year":"2011","journal-title":"Optim Eng."},{"key":"B22","article-title":"Maximizing acquisition functions for Bayesian optimization","volume-title":"Advances in Neural Information Processing Systems 31 (NeurIPS 2018)","author":"Wilson","year":"2018"},{"key":"B23","doi-asserted-by":"publisher","first-page":"1925","DOI":"10.1007\/s10994-020-05899-z","article-title":"High-dimensional Bayesian optimization using low-dimensional feature spaces","volume":"109","author":"Moriconi","year":"2020","journal-title":"Mach Learn."},{"key":"B24","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1613\/jair.4806","article-title":"Bayesian optimization in a billion dimensions via random embeddings","volume":"55","author":"Wang","year":"2016","journal-title":"J Artif Intell Res."},{"key":"B25","first-page":"4752","article-title":"A framework for Bayesian optimization in embedded subspaces","author":"Nayebi","year":"2019","journal-title":"International Conference on Machine Learning. PMLR"},{"key":"B26","first-page":"1546","article-title":"Re-examining linear embeddings for high-dimensional Bayesian optimization","author":"Letham","year":"2022","journal-title":"Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020"},{"key":"B27","first-page":"295","article-title":"High dimensional Bayesian optimisation and bandits via additive models","volume-title":"Proceedings of the 32nd International Conference on Machine Learning, PMLR","author":"Kandasamy","year":"2015"},{"key":"B28","article-title":"Scalable global optimization via local bayesian optimization","volume-title":"33rd Conference on Neural Information Processing Systems (NeurIPS 2019)","author":"Eriksson","year":"2019"},{"key":"B29","first-page":"493","article-title":"High-dimensional Bayesian optimization with sparse axis-aligned subspaces","author":"Eriksson","year":"","journal-title":"Proceedings of the Thirty-Seventh Uncertainty in Artificial Intelligence (UAI 2021)"},{"key":"B30","doi-asserted-by":"crossref","DOI":"10.2514\/4.865978","volume-title":"Viscous Drag Reduction in Boundary Layers.","author":"Bushnell","year":"1990"},{"key":"B31","doi-asserted-by":"publisher","first-page":"100550","DOI":"10.1016\/j.softx.2020.100550","article-title":"Xcompact3D: an open-source framework for solving turbulence problems on a Cartesian mesh","volume":"12","author":"Bartholomew","year":"2020","journal-title":"SoftwareX."},{"key":"B32","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1017\/S0022112010003113","article-title":"Assessment of direct numerical simulation data of turbulent boundary layers","volume":"659","author":"Schlatter","year":"2010","journal-title":"J Fluid Mech."}],"container-title":["Frontiers in Applied Mathematics and Statistics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fams.2022.1076296\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,8]],"date-time":"2022-12-08T16:02:38Z","timestamp":1670515358000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fams.2022.1076296\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,8]]},"references-count":32,"alternative-id":["10.3389\/fams.2022.1076296"],"URL":"https:\/\/doi.org\/10.3389\/fams.2022.1076296","relation":{},"ISSN":["2297-4687"],"issn-type":[{"value":"2297-4687","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,8]]},"article-number":"1076296"}}