{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,4]],"date-time":"2026-01-04T08:08:22Z","timestamp":1767514102993,"version":"3.46.0"},"reference-count":92,"publisher":"Association for Computing Machinery (ACM)","issue":"6","funder":[{"DOI":"10.13039\/501100000780","name":"European Union","doi-asserted-by":"crossref","award":["101045765"],"award-info":[{"award-number":["101045765"]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"crossref"}]},{"name":"ERC Starting","award":["101041029"],"award-info":[{"award-number":["101041029"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput.-Hum. Interact."],"published-print":{"date-parts":[[2025,12,31]]},"abstract":"<jats:p>Programmatic hyperparameter optimization (HPO) methods, such as Bayesian optimization and evolutionary algorithms, are known for their sample efficiency in identifying optimal configurations for machine learning (ML) models. However, practitioners often use less efficient methods, such as grid search, potentially resulting in under-optimized models. This discrepancy suggests that HPO method selection may be influenced by practitioner-specific motives, which remain insufficiently understood hindering user-centered advancement of HPO tools. To uncover these motives, we conducted 20 semi-structured interviews and an online survey with 49 ML practitioners. We revealed six primary goals (e.g., increasing ML model understanding) and 14 contextual factors (e.g., available computational resources) that influence practitioners\u2019 choices of HPO methods. This study provides a conceptual foundation for understanding real-world HPO practices and informs the development of more user-centered and context-adaptive HPO tools in automated ML (AutoML).<\/jats:p>","DOI":"10.1145\/3745771","type":"journal-article","created":{"date-parts":[[2025,6,25]],"date-time":"2025-06-25T11:59:42Z","timestamp":1750852782000},"page":"1-33","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Practitioner Motives to Use Different Hyperparameter Optimization Methods"],"prefix":"10.1145","volume":"32","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2880-3361","authenticated-orcid":false,"given":"Niclas","family":"Kannengie\u00dfer","sequence":"first","affiliation":[{"name":"Institute of Applied Informatics and Formal Description Methods, Karlsruhe Institute of Technology, Karlsruhe, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-5092-924X","authenticated-orcid":false,"given":"Niklas","family":"Hasebrook","sequence":"additional","affiliation":[{"name":"Zeb Consulting, Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5455-4488","authenticated-orcid":false,"given":"Felix","family":"Morsbach","sequence":"additional","affiliation":[{"name":"Chair of Privacy and Security, Karlsruhe Institute of Technology, Karlsruhe, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8705-9862","authenticated-orcid":false,"given":"Marc-Andr\u00e9","family":"Z\u00f6ller","sequence":"additional","affiliation":[{"name":"Institute of Industrial Manufacturing and Management, University of Stuttgart, Stuttgart, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4390-4582","authenticated-orcid":false,"given":"J\u00f6rg K. H.","family":"Franke","sequence":"additional","affiliation":[{"name":"Machine Learning Lab, University of Freiburg, Freiburg im Breisgau, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9675-3175","authenticated-orcid":false,"given":"Marius","family":"Lindauer","sequence":"additional","affiliation":[{"name":"Institute of Artificial Intelligence, Leibniz University Hannover, Hannover, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2037-3694","authenticated-orcid":false,"given":"Frank","family":"Hutter","sequence":"additional","affiliation":[{"name":"Machine Learning Lab, University of Freiburg, Freiburg im Breisgau, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4353-8519","authenticated-orcid":false,"given":"Ali","family":"Sunyaev","sequence":"additional","affiliation":[{"name":"TUM School of Computation, Information and Technology, Technical University of Munich, Heilbronn, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,12,9]]},"reference":[{"key":"e_1_3_3_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/3292500.3330701"},{"key":"e_1_3_3_3_2","first-page":"2546","article-title":"Algorithms for hyper-parameter optimization","volume":"24","author":"Bergstra James","year":"2011","unstructured":"James Bergstra, R\u00e9mi Bardenet, Yoshua Bengio, and Bal\u00e1zs K\u00e9gl. 2011. Algorithms for hyper-parameter optimization. In Advances in Neural Information Processing Systems, Vol. 24, 2546\u20132554.","journal-title":"Advances in Neural Information Processing Systems"},{"issue":"10","key":"e_1_3_3_4_2","first-page":"281","article-title":"Random search for hyper-parameter optimization","volume":"13","author":"Bergstra James","year":"2012","unstructured":"James Bergstra and Yoshua Bengio. 2012. Random search for hyper-parameter optimization. Journal of Machine Learning Research 13, 10 (2012), 281\u2013305.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1088\/1749-4699\/8\/1\/014008"},{"issue":"1","key":"e_1_3_3_6_2","first-page":"773","article-title":"Efficient parameter importance analysis via ablation with surrogates","volume":"31","author":"Biedenkapp Andre","year":"2017","unstructured":"Andre Biedenkapp, Marius Lindauer, Katharina Eggensperger, Frank Hutter, Chris Fawcett, and Holger Hoos. 2017. Efficient parameter importance analysis via ablation with surrogates. Proceedings of the AAAI Conference on Artificial Intelligence 31, 1 (Feb. 2017), 773\u2013779.","journal-title":"Proceedings of the AAAI Conference on Artificial Intelligence"},{"key":"e_1_3_3_7_2","first-page":"115","volume-title":"Proceedings of the International Conference on Learning and Intelligent Optimization","author":"Biedenkapp Andr\u00e9","year":"2018","unstructured":"Andr\u00e9 Biedenkapp, Joshua Marben, Marius Lindauer, and Frank Hutter. 2018. Cave: Configuration assessment, visualization and evaluation. In Proceedings of the International Conference on Learning and Intelligent Optimization, 115\u2013130."},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3377930.3389815"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1002\/widm.1484"},{"key":"e_1_3_3_10_2","volume-title":"Survey of Machine-Learning Experimental Methods at NeurIPS2019 and ICLR2020","author":"Bouthillier Xavier","year":"2020","unstructured":"Xavier Bouthillier and Ga\u00ebl Varoquaux. 2020. Survey of Machine-Learning Experimental Methods at NeurIPS2019 and ICLR2020. Research Report, Inria Saclay Ile de France."},{"key":"e_1_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1191\/1478088706qp063oa"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1037\/13620-004"},{"key":"e_1_3_3_13_2","unstructured":"Eric Brochu Vlad M. Cora and Nando De Freitas. 2010. A tutorial on Bayesian optimization of expensive cost functions with application to active user modeling and hierarchical reinforcement learning. arXiv:1012.2599. Retrieved from https:\/\/arxiv.org\/abs\/1012.2599"},{"key":"e_1_3_3_14_2","unstructured":"Yutian Chen Aja Huang Ziyu Wang Ioannis Antonoglou Julian Schrittwieser David Silver and Nando de Freitas. 2018. Bayesian optimization in AlphaGo. arXiv:1812.06855. Retrieved from https:\/\/arxiv.org\/abs\/1812.06855."},{"key":"e_1_3_3_15_2","volume-title":"Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems","volume":"601","author":"Crisan Anamaria","year":"2021","unstructured":"Anamaria Crisan and Brittany Fiore-Gartland. 2021. Fits and starts: Enterprise use of AutoML and the role of humans in the loop. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. Article 601, 15 pages."},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.5555\/2832581.2832731"},{"key":"e_1_3_3_17_2","article-title":"On the importance of architectures and hyperparameters for fairness in face recognition","author":"Dooley Samuel","year":"2022","unstructured":"Samuel Dooley, Rhea Sanjay Sukthanker, John P. Dickerson, Colin White, Frank Hutter, and Micah Goldblum. 2022. On the importance of architectures and hyperparameters for fairness in face recognition. In Proceedings of the Workshop on Trustworthy and Socially Responsible Machine Learning (NeurIPS \u201922).","journal-title":"Proceedings of the Workshop on Trustworthy and Socially Responsible Machine Learning (NeurIPS \u201922)"},{"key":"e_1_3_3_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/3377325.3377501"},{"key":"e_1_3_3_19_2","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1109\/ICDMW.2019.00025","volume-title":"Proceedings of the 2019 International Conference on Data Mining Workshops","author":"Dyrmishi Salijona","year":"2019","unstructured":"Salijona Dyrmishi, Radwa Elshawi, and Sherif Sakr. 2019. A decision support framework for AutoML systems: A meta-learning approach. In Proceedings of the 2019 International Conference on Data Mining Workshops, 97\u2013106."},{"key":"e_1_3_3_20_2","article-title":"Towards an empirical foundation for assessing Bayesian optimization of hyperparameters","volume":"10","author":"Eggensperger Katharina","year":"2013","unstructured":"Katharina Eggensperger, Matthias Feurer, Frank Hutter, James Bergstra, Jasper Snoek, Holger Hoos, and Kevin Leyton-Brown. 2013. Towards an empirical foundation for assessing Bayesian optimization of hyperparameters. In NIPS Workshop on Bayesian Optimization in Theory and Practice, Vol. 10.","journal-title":"NIPS Workshop on Bayesian Optimization in Theory and Practice"},{"key":"e_1_3_3_21_2","first-page":"5497","volume-title":"Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019 (NeurIPS)","author":"Eriksson David","year":"2019","unstructured":"David Eriksson, Michael Pearce, Jacob R. Gardner, Ryan Turner, and Matthias Poloczek. 2019. Scalable global optimization via local Bayesian optimization. In Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019 (NeurIPS). Hanna M. Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d\u2019Alch\u00e9-Buc, Emily B. Fox, and Roman Garnett (Eds.), 5497\u20135508."},{"key":"e_1_3_3_22_2","first-page":"1437","volume-title":"Proceedings of the 35th International Conference on Machine Learning","author":"Falkner Stefan","year":"2018","unstructured":"Stefan Falkner, Aaron Klein, and Frank Hutter. 2018. BOHB: Robust and efficient hyperparameter optimization at scale. In Proceedings of the 35th International Conference on Machine Learning, 1437\u20131446."},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-05318-5_1"},{"key":"e_1_3_3_24_2","unstructured":"Matthias Feurer Matthias Klein and Frank Hutter. 2016. Winning the AutoML challenge with auto-sklearn. Retrieved from https:\/\/www.kdnuggets.com\/2016\/08\/winning-automl-challenge-auto-sklearn.html"},{"key":"e_1_3_3_25_2","unstructured":"Peter I. Frazier. 2018. A tutorial on Bayesian optimization. arXiv:1807.02811. Retreived from https:\/\/arxiv.org\/abs\/1807.02811"},{"key":"e_1_3_3_26_2","first-page":"1408","article-title":"Are we there yet? Data saturation in qualitative research","volume":"20","author":"Fusch Patricia","year":"2015","unstructured":"Patricia Fusch and Lawrence Ness. 2015. Are we there yet? Data saturation in qualitative research. Qualitative Report 20 (2015), 1408\u20131416.","journal-title":"Qualitative Report"},{"key":"e_1_3_3_27_2","first-page":"364","volume-title":"Proceedings of the 2019 IEEE International Conference on Data Science and Advanced Analytics","author":"Gardner Steven","year":"2019","unstructured":"Steven Gardner, Oleg Golovidov, Joshua Griffin, Patrick Koch, Wayne Thompson, Brett Wujek, and Yan Xu. 2019. Constrained Multi-Objective optimization for automated machine learning. In Proceedings of the 2019 IEEE International Conference on Data Science and Advanced Analytics, 364\u2013373."},{"key":"e_1_3_3_28_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1017\/9781108348973","volume-title":"Bayesian Optimization","author":"Garnett Roman","year":"2023","unstructured":"Roman Garnett. 2023. Introduction. In Bayesian Optimization. Cambridge University Press, Cambridge, UK, 1\u201314."},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1756-8765.2008.01006.x"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/1654.001.0001"},{"key":"e_1_3_3_31_2","unstructured":"Pieter Gijsbers Marcos L. P. Bueno Stefan Coors Erin LeDell S\u00e9bastien Poirier Janek Thomas Bernd Bischl and Joaquin Vanschoren. 2023. AMLB: An AutoML Benchmark. arXiv:2207.12560. Retreived from https:\/\/arxiv.org\/abs\/2207.12560"},{"key":"e_1_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3301275.3302324"},{"key":"e_1_3_3_33_2","unstructured":"Varun Godbole George E. Dahl Justin Gilmer Christopher J. Shallue and Zachary Nado. 2023. Deep Learning Tuning Playbook. Version 1.0. Retrieved from http:\/\/github.com\/google-research\/tuning_playbook"},{"key":"e_1_3_3_34_2","unstructured":"V. Godbole G. E. Dahl J. Gilmer C. J. Shallue and Z. Nado. 2023. Deep Learning Tuning Playbook. Version 1. Retrieved from http:\/\/github.com\/google-research\/tuning_playbook"},{"key":"e_1_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3097983.3098043"},{"key":"e_1_3_3_36_2","volume-title":"Interviewing: Strategy, Techniques, and Tactics","author":"Gorden Raymond L.","year":"1975","unstructured":"Raymond L. Gorden. 1975. Interviewing: Strategy, Techniques, and Tactics (Rev. ed.). Dorsey Press, Homewood, Ill."},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1177\/1525822X05279903"},{"key":"e_1_3_3_38_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-01234-2_48"},{"key":"e_1_3_3_39_2","volume-title":"AAAI \u201918\/IAAI \u201918\/EAAI \u201918","author":"Henderson Peter","year":"2018","unstructured":"Peter Henderson, Riashat Islam, Philip Bachman, Joelle Pineau, Doina Precup, and David Meger. 2018. Deep reinforcement learning that matters. In AAAI \u201918\/IAAI \u201918\/EAAI \u201918, Vol. 32, Article 392, 8 pages."},{"key":"e_1_3_3_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3399715.3399814"},{"key":"e_1_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1145\/3461778.3462077"},{"key":"e_1_3_3_42_2","first-page":"754","volume-title":"Proceedings of the 31st International Conference on Machine Learning","volume":"32","author":"Hutter Frank","year":"2014","unstructured":"Frank Hutter, Holger Hoos, and Kevin Leyton-Brown. 2014. An efficient approach for assessing hyperparameter importance. In Proceedings of the 31st International Conference on Machine Learning, Vol. 32, Bejing, China, 754\u2013762."},{"key":"e_1_3_3_43_2","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1007\/978-3-642-25566-3_40","volume-title":"Learning and Intelligent Optimization","author":"Hutter Frank","year":"2011","unstructured":"Frank Hutter, Holger H. Hoos, and Kevin Leyton-Brown. 2011. Sequential model-based optimization for general algorithm configuration. In Learning and Intelligent Optimization. Carlos A. Coello Coello (Ed.), Lecture Notes in Computer Science, Vol. 6683, Springer, Berlin, Germany, 507\u2013523."},{"key":"e_1_3_3_44_2","volume-title":"Preface","author":"Hutter Frank","year":"2018","unstructured":"Frank Hutter, Lars Kotthoff, and Joaquin Vanschoren. 2018. Preface. Springer, Cham, Switzerland, IX\u2013XI."},{"key":"e_1_3_3_45_2","first-page":"1","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Hvarfner Carl","year":"2022","unstructured":"Carl Hvarfner, Danny Stoll, Artyr Souza, Marius Lindauer, Frank Hutter, and Luigi Nardi. 2022. piBO: Augmenting acquisition functions with user beliefs for Bayesian optimization. In Proceedings of the International Conference on Learning Representations, 1\u201315."},{"key":"e_1_3_3_46_2","first-page":"240","article-title":"Non-stochastic best arm identification and hyperparameter optimization","author":"Jamieson Kevin","year":"2016","unstructured":"Kevin Jamieson and Ameet Talwalkar. 2016. Non-stochastic best arm identification and hyperparameter optimization. In Artificial Intelligence and Statistics, 240\u2013248.","journal-title":"Artificial Intelligence and Statistics"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12650-018-0531-1"},{"key":"e_1_3_3_48_2","first-page":"23928","volume-title":"Advances in Neural Information Processing Systems","author":"Kadra Arlind","year":"2021","unstructured":"Arlind Kadra, Marius Lindauer, Frank Hutter, and Josif Grabocka. 2021. Well-tuned simple nets excel on tabular datasets. In Advances in Neural Information Processing Systems. A. Beygelzimer, Y. Dauphin, P. Liang, and J. Wortman Vaughan (Eds.), Vol. 34, 23928\u201323941."},{"key":"e_1_3_3_49_2","first-page":"81:1","article-title":"Tuning hyperparameters without grad students: Scalable and robust Bayesian optimisation with dragonfly","volume":"21","author":"Kandasamy Kirthevasan","year":"2020","unstructured":"Kirthevasan Kandasamy, Karun Raju Vysyaraju, Willie Neiswanger, Biswajit Paria, Christopher R. Collins, Jeff Schneider, Barnab\u00e1s P\u00f3czos, and Eric P. Xing. 2020. Tuning hyperparameters without grad students: Scalable and robust Bayesian optimisation with dragonfly. Journal of Machine Learning Research 21 (2020), 81:1\u201381:27.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1145\/3610536"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1561\/1100000091"},{"key":"e_1_3_3_52_2","article-title":"A human-in-the-loop perspective on AutoML: Milestones and the road ahead","author":"Lee Doris Jung-Lin","year":"2020","unstructured":"Doris Jung-Lin Lee and Stephen Macke. 2020. A human-in-the-loop perspective on AutoML: Milestones and the road ahead. IEEE Data Engineering Bulletin. Retrieved from https:\/\/par.nsf.gov\/biblio\/10161752","journal-title":"IEEE Data Engineering Bulletin"},{"key":"e_1_3_3_53_2","unstructured":"Cheng Li Sunil Gupta Santu Rana Vu Nguyen Antonio Robles-Kelly and Svetha Venkatesh. 2020. Incorporating expert prior knowledge into experimental design via posterior sampling. arXiv:2002.11256. Retrieved from https:\/\/arxiv.org\/abs\/2002.11256"},{"key":"e_1_3_3_54_2","first-page":"257","volume-title":"Proceedings of the IEEE International Conference on Data Mining","author":"Li Cheng","year":"2018","unstructured":"Cheng Li, Santu Rana, Sunil Gupta, Vu Nguyen, Svetha Venkatesh, Alessandra Sutti, David Rubin, Teo Slezak, Murray Height, Mazher Mohammed, et al. 2018. Accelerating experimental design by incorporating experimenter hunches. In Proceedings of the IEEE International Conference on Data Mining, 257\u2013266."},{"key":"e_1_3_3_55_2","first-page":"6765","article-title":"Hyperband: A novel Bandit-based approach to hyperparameter optimization","volume":"18","author":"Li Lisha","year":"2018","unstructured":"Lisha Li, Kevin G. Jamieson, Giulia DeSalvo, Afshin Rostamizadeh, and Ameet Talwalkar. 2018. Hyperband: A novel Bandit-based approach to hyperparameter optimization. Journal of Machine Learning Research 18 (2018), 6765\u20136816.","journal-title":"Journal of Machine Learning Research"},{"issue":"54","key":"e_1_3_3_56_2","first-page":"1","article-title":"SMAC3: A versatile Bayesian optimization package for hyperparameter optimization","volume":"23","author":"Lindauer Marius","year":"2022","unstructured":"Marius Lindauer, Katharina Eggensperger, Matthias Feurer, Andr\u00e9 Biedenkapp, Difan Deng, Carolin Benjamins, Ren\u00e9 Sass, and Frank Hutter. 2022. SMAC3: A versatile Bayesian optimization package for hyperparameter optimization. Journal of Machine Learning Research 23, 54 (2022), 1\u20139.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_3_57_2","unstructured":"Marius Lindauer Florian Karl Anne Klier Julia Moosbauer Alexander Tornede Andreas Mueller Frank Hutter Matthias Feurer and Bernd Bischl. 2024. Position: A call to action for a human-centered AutoML paradigm. arXiv:2406.03348. Retrieved from https:\/\/arxiv.org\/pdf\/2406.03348"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2648.1994.tb01088.x"},{"key":"e_1_3_3_59_2","first-page":"7377","volume-title":"NIPS \u201923: Proceedings of the 37th International Conference on Neural Information Processing Systems","author":"Mallik Neeratyoy","year":"2023","unstructured":"Neeratyoy Mallik, Edward Bergman, Carl Hvarfner, Danny Stoll, Maciej Janowski, Marius Lindauer, Luigi Nardi, and Frank Hutter. 2023. PriorBand: Practical hyperparameter optimization in the age of deep learning. In NIPS \u201923: Proceedings of the 37th International Conference on Neural Information Processing Systems. Alice Oh, Tristan Naumann, Amir Globerson, Kate Saenko, Moritz Hardt, and Sergey Levine (Eds.), 7377\u20137391. Retrieved from https:\/\/dl.acm.org\/doi\/10.5555\/3666122.3666445"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1177\/2333393615597674"},{"key":"e_1_3_3_61_2","volume-title":"Proceedings of the International Conference on Learning Representations","author":"Melis G\u00e1bor","year":"2018","unstructured":"G\u00e1bor Melis, Chris Dyer, and Phil Blunsom. 2018. On the state of the art of evaluation in neural language models. In Proceedings of the International Conference on Learning Representations."},{"key":"e_1_3_3_62_2","volume-title":"Design and Analysis of Experiments","author":"Montgomery Douglas C.","year":"2017","unstructured":"Douglas C. Montgomery. 2017. Design and Analysis of Experiments. Wiley."},{"key":"e_1_3_3_63_2","first-page":"2280","article-title":"Explaining hyperparameter optimization via partial dependence plots","author":"Moosbauer Julia","year":"2021","unstructured":"Julia Moosbauer, Julia Herbinger, Giuseppe Casalicchio, Marius Lindauer, and Bernd Bischl. 2021. Explaining hyperparameter optimization via partial dependence plots. In Advances in Neural Information Processing Systems, 2280\u20132291.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_3_64_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-58595-2_41"},{"key":"e_1_3_3_65_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.infoandorg.2006.11.001"},{"key":"e_1_3_3_66_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-05318-5_8"},{"key":"e_1_3_3_67_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.01044"},{"key":"e_1_3_3_68_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2020.105663"},{"key":"e_1_3_3_69_2","first-page":"2367","volume-title":"Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining","author":"Van Rijn Jan N.","year":"2018","unstructured":"Jan N. Van Rijn and Frank Hutter. 2018. Hyperparameter importance across datasets. In Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2367\u20132376."},{"key":"e_1_3_3_70_2","article-title":"DeepCAVE: An interactive analysis tool for automated machine learning","author":"Sass Ren\u00e9","year":"2022","unstructured":"Ren\u00e9 Sass, Eddie Bergman, Andr\u00e9 Biedenkapp, Frank Hutter, and Marius Lindauer. 2022. DeepCAVE: An interactive analysis tool for automated machine learning. ICML Workshop on Adaptive Experimental Design and Active Learning in the Real World (ReALML).","journal-title":"ICML Workshop on Adaptive Experimental Design and Active Learning in the Real World (ReALML)"},{"key":"e_1_3_3_71_2","volume-title":"The Paradox of Choice: Why More Is Less","author":"Schwartz Barry","year":"2004","unstructured":"Barry Schwartz. 2004. The Paradox of Choice: Why More Is Less (1st ed.). Ecco, NY.","edition":"1"},{"key":"e_1_3_3_72_2","article-title":"Symbolic explanations for hyperparameter optimization","author":"Segel Sarah","year":"2023","unstructured":"Sarah Segel, Helena Graf, Alexander Tornede, Bernd Bischl, and Marius Lindauer. 2023. Symbolic explanations for hyperparameter optimization. In AutoML Conference 2023.","journal-title":"AutoML Conference 2023"},{"key":"e_1_3_3_73_2","doi-asserted-by":"publisher","DOI":"10.1109\/JPROC.2015.2494218"},{"key":"e_1_3_3_74_2","doi-asserted-by":"publisher","DOI":"10.1109\/CAIN58948.2023.00016"},{"key":"e_1_3_3_75_2","doi-asserted-by":"publisher","DOI":"10.5555\/2999325.2999464"},{"key":"e_1_3_3_76_2","first-page":"1674","volume-title":"Proceedings of the International Conference on Machine Learning","author":"Snoek Jasper","year":"2014","unstructured":"Jasper Snoek, Kevin Swersky, Rich Zemel, and Ryan Adams. 2014. Input warping for Bayesian optimization of non-stationary functions. In Proceedings of the International Conference on Machine Learning, 1674\u20131682."},{"key":"e_1_3_3_77_2","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1007\/978-3-030-86523-8_17","volume-title":"Machine Learning and Knowledge Discovery in Databases. Research Track: European Conference (ECML PKDD \u201921). Nuria Oliver, Fernando P\u00e9rez-Cruz, Stefan Kramer, Jesse Read, and Jose A. Lozano (Eds.), Lecture Notes in Computer Science, Vol. 12977","author":"Souza Arthur","year":"2021","unstructured":"Arthur Souza, Luigi Nardi, Leonardo Oliveira, Kunle Olukotun, Marius Lindauer, and Frank Hutter. 2021. Bayesian optimization with a prior for the optimum. In Machine Learning and Knowledge Discovery in Databases. Research Track: European Conference (ECML PKDD \u201921). Nuria Oliver, Fernando P\u00e9rez-Cruz, Stefan Kramer, Jesse Read, and Jose A. Lozano (Eds.), Lecture Notes in Computer Science, Vol. 12977, 265\u2013296. Retrieved from https:\/\/link.springer.com\/chapter\/10.1007\/978-3-030-86523-8_17"},{"issue":"1","key":"e_1_3_3_78_2","first-page":"1064","article-title":"explAIner: A visual analytics framework for interactive and explainable machine learning","volume":"26","author":"Spinner Thilo","year":"2020","unstructured":"Thilo Spinner, Udo Schlegel, Hanna Sch\u00e4fer, and Mennatallah El-Assady. 2020. explAIner: A visual analytics framework for interactive and explainable machine learning. IEEE Transactions on Visualization and Computer Graphics 26, 1 (2020), 1064\u20131074.","journal-title":"IEEE Transactions on Visualization and Computer Graphics"},{"key":"e_1_3_3_79_2","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581082"},{"key":"e_1_3_3_80_2","unstructured":"Kevin Swersky Jasper Snoek and Ryan Prescott Adams. 2014. Freeze-thaw Bayesian optimization. arXiv:1406.3896. Retrieved from https:\/\/arxiv.org\/pdf\/1406.3896"},{"key":"e_1_3_3_81_2","first-page":"3","volume-title":"Proceedings of the NeurIPS 2020 Competition and Demonstration Track","volume":"133","author":"Turner Ryan","year":"2021","unstructured":"Ryan Turner, David Eriksson, Michael McCourt, Juha Kiili, Eero Laaksonen, Zhen Xu, and Isabelle Guyon. 2021. Bayesian optimization is superior to random search for machine learning hyperparameter tuning: Analysis of the black-box optimization challenge 2020. In Proceedings of the NeurIPS 2020 Competition and Demonstration Track. Hugo Jair Escalante and Katja Hofmann (Eds.), Vol. 133, 3\u201326."},{"key":"e_1_3_3_82_2","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1007\/978-3-030-05318-5_2","volume-title":"Automated Machine Learning","author":"Joaquin Vanschoren","year":"2019","unstructured":"Joaquin Vanschoren. 2019. Meta-learning. In Automated Machine Learning. Frank Hutter, Lars Kotthoff, and Joaquin Vanschoren (Eds.), Springer International Publishing, Cham, Switzerland, 35\u201361. Retrieved from https:\/\/link.springer.com\/chapter\/10.1007\/978-3-030-05318-5_2"},{"key":"e_1_3_3_83_2","first-page":"434","article-title":"FLAML: A fast and lightweight AutoML library","author":"Wang Chi","year":"2021","unstructured":"Chi Wang, Qingyun Wu, Markus Weimer, and Erkang Zhu. 2021. FLAML: A fast and lightweight AutoML library. In Machine Learning and Systems, 434\u2013447.","journal-title":"Machine Learning and Systems"},{"key":"e_1_3_3_84_2","volume-title":"Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems","volume":"79","author":"Wang Dakuo","year":"2021","unstructured":"Dakuo Wang, Josh Andres, Justin D. Weisz, Erick Oduor, and Casey Dugan. 2021. AutoDS: Towards human-centered automation of data science. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. New York, NY, Article 79, 12 pages."},{"key":"e_1_3_3_85_2","unstructured":"Dakuo Wang Q. Vera Liao Yunfeng Zhang Udayan Khurana Horst Samulowitz Soya Park Michael Muller and Lisa Amini. 2021. How much automation does a data scientist want? arXiv:2101.03970. Retrieved from https:\/\/arxiv.org\/pdf\/2101.03970"},{"key":"e_1_3_3_86_2","volume-title":"Proceedings of the ACM on Conference on Human-Computer Interactions 3","author":"Wang Dakuo","year":"2019","unstructured":"Dakuo Wang, Justin D. Weisz, Michael Muller, Parikshit Ram, Werner Geyer, Casey Dugan, Yla Tausczik, Horst Samulowitz, and Alexander Gray. 2019. Human-AI collaboration in data science: Exploring data scientists\u2019 perceptions of automated AI. Proceedings of the ACM on Conference on Human-Computer Interactions 3, CSCW, Article 211 (Nov. 2019), 24 pages."},{"key":"e_1_3_3_87_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300911"},{"key":"e_1_3_3_88_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445306"},{"key":"e_1_3_3_89_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2020.07.061"},{"key":"e_1_3_3_90_2","first-page":"4015","volume-title":"Proceedings of the 24th International Conference on Artificial Intelligence and Statistics","author":"Zhang Baohe","year":"2021","unstructured":"Baohe Zhang, Raghu Rajan, Luis Pineda, Nathan Lambert, Andr\u00e9 Biedenkapp, Kurtland Chua, Frank Hutter, and Roberto Calandra. 2021. On the importance of hyperparameter optimization for model-based reinforcement learning. In Proceedings of the 24th International Conference on Artificial Intelligence and Statistics, 4015\u20134023."},{"key":"e_1_3_3_91_2","doi-asserted-by":"publisher","DOI":"10.1613\/jair.1.11854"},{"key":"e_1_3_3_92_2","first-page":"2907","volume-title":"Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics","author":"Z\u00f6ller Marc-Andr\u00e9","year":"2023","unstructured":"Marc-Andr\u00e9 Z\u00f6ller, Fabian Mauthe, Peter Zeiler, Marius Lindauer, and Marco F. Huber. 2023. Automated machine learning for remaining useful life predictions. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, 2907\u20132912."},{"key":"e_1_3_3_93_2","doi-asserted-by":"publisher","DOI":"10.1145\/3625240"}],"container-title":["ACM Transactions on Computer-Human Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3745771","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,9]],"date-time":"2025-12-09T13:56:54Z","timestamp":1765288614000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3745771"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,12,9]]},"references-count":92,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2025,12,31]]}},"alternative-id":["10.1145\/3745771"],"URL":"https:\/\/doi.org\/10.1145\/3745771","relation":{},"ISSN":["1073-0516","1557-7325"],"issn-type":[{"type":"print","value":"1073-0516"},{"type":"electronic","value":"1557-7325"}],"subject":[],"published":{"date-parts":[[2025,12,9]]},"assertion":[{"value":"2024-09-23","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-05-21","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-12-09","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}