{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,7]],"date-time":"2026-10-07T17:01:44Z","timestamp":1791392504420,"version":"4.3.3"},"reference-count":28,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2022,12,27]],"date-time":"2022-12-27T00:00:00Z","timestamp":1672099200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Training and evaluating the performance of many competing Artificial Intelligence (AI)\/Machine Learning (ML) models can be very time-consuming and expensive. Furthermore, the costs associated with this hyperparameter optimization task grow exponentially when cross validation is used during the model selection process. Finding ways of quickly identifying high-performing models when conducting hyperparameter optimization with cross validation is hence an important problem in AI\/ML research. Among the proposed methods of accelerating hyperparameter optimization, successive halving has emerged as a popular, state-of-the-art early stopping algorithm. Concurrently, recent work on cross validation has yielded a greedy cross validation algorithm that prioritizes the most promising candidate AI\/ML models during the early stages of the model selection process. The current paper proposes a greedy successive halving algorithm in which greedy cross validation is integrated into successive halving. An extensive series of experiments is then conducted to evaluate the comparative performance of the proposed greedy successive halving algorithm. The results show that the quality of the AI\/ML models selected by the greedy successive halving algorithm is statistically identical to those selected by standard successive halving, but that greedy successive halving is typically more than 3.5 times faster than standard successive halving.<\/jats:p>","DOI":"10.3390\/a16010017","type":"journal-article","created":{"date-parts":[[2022,12,28]],"date-time":"2022-12-28T05:30:27Z","timestamp":1672205427000},"page":"17","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":29,"title":["Hyperparameter Optimization Using Successive Halving with Greedy Cross Validation"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5922-3415","authenticated-orcid":false,"given":"Daniel S.","family":"Soper","sequence":"first","affiliation":[{"name":"Information Systems & Decision Sciences Department, California State University, Fullerton, CA 92831, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,12,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Hutter, F., Kotthoff, L., and Vanschoren, J. (2019). Hyperparameter Optimization. Automated Machine Learning: Methods, Systems, Challenges, Springer.","DOI":"10.1007\/978-3-030-05318-5"},{"key":"ref_2","unstructured":"Li, L., Jamieson, K., Rostamizadeh, A., Gonina, E., Ben-Tzur, J., Hardt, M., Recht, B., and Talwalkar, A. (2020, January 26\u201327). A System for Massively Parallel Hyperparameter Tuning. Proceedings of the 3rd Machine Learning and Systems Conference, Austin, TX, USA."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Agrawal, T. (2020). Hyperparameter Optimization in Machine Learning: Make Your Machine Learning and Deep Learning Models More Efficient, Apress.","DOI":"10.1007\/978-1-4842-6579-6"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kohavi, R., and John, G.H. (1995, January 1). Automatic Parameter Selection by Minimizing Estimated Error. Proceedings of the 12th International Conference on Machine Learning, Tahoe City, CA, USA.","DOI":"10.1016\/B978-1-55860-377-6.50045-1"},{"key":"ref_5","unstructured":"Olson, R.S., Cava, W.L., Mustahsan, Z., Varik, A., and Moore, J.H. (2018, January 4\u20138). Data-Driven Advice for Applying Machine Learning to Bioinformatics Problems. Proceedings of the Pacific Symposium on Biocomputing, Kohala Coast, HI, USA."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1145\/3065386","article-title":"ImageNet Classification with Deep Convolutional Neural Networks","volume":"60","author":"Krizhevsky","year":"2017","journal-title":"Commun. ACM"},{"key":"ref_7","unstructured":"Vanwinckelen, G., and Blockeel, H. (2014, January 8). Look Before You Leap: Some Insights into Learner Evaluation with Cross-Validation. Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, Workshop on Statistically Sound Data Mining, Nancy, France."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Soper, D.S. (2021). Greed Is Good: Rapid Hyperparameter Optimization and Model Selection Using Greedy k-Fold Cross Validation. Electronics, 10.","DOI":"10.3390\/electronics10161973"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1889","DOI":"10.1162\/089976600300015187","article-title":"Gradient-Based Optimization of Hyperparameters","volume":"12","author":"Bengio","year":"2000","journal-title":"Neural Comput."},{"key":"ref_10","unstructured":"Franceschi, L., Donini, M., Frasconi, P., and Pontil, M. (2017, January 6\u201311). Forward and Reverse Gradient-Based Hyperparameter Optimization. Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia."},{"key":"ref_11","unstructured":"Jamieson, K., and Talwalkar, A. (2016, January 22\u201326). Non-Stochastic Best Arm Identification and Hyperparameter Optimization. Proceedings of the 8th International Conference on Artificial Intelligence and Statistics, Cadiz, Spain."},{"key":"ref_12","first-page":"6765","article-title":"Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization","volume":"18","author":"Li","year":"2017","journal-title":"J. Mach. Learn. Res."},{"key":"ref_13","first-page":"2951","article-title":"Practical Bayesian Optimization of Machine Learning Algorithms","volume":"25","author":"Snoek","year":"2012","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Young, S.R., Rose, D.C., Karnowski, T.P., Lim, S.-H., and Patton, R.M. (2015, January 15). Optimizing Deep Learning Hyper-Parameters Through an Evolutionary Algorithm. Proceedings of the Workshop on Machine Learning in High-Performance Computing Environments, Austin, TX, USA.","DOI":"10.1145\/2834892.2834896"},{"key":"ref_15","first-page":"2825","article-title":"Scikit-Learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_16","unstructured":"Kumar, R. (2019). Machine Learning Quick Reference: Quick and Essential Machine Learning Hacks for Training Smart Data Models, Packt Publishing."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Liu, L., and \u00d6zsu, M.T. (2009). Encyclopedia of Database Systems, Springer.","DOI":"10.1007\/978-0-387-39940-9"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Sch\u00fctze, H., Manning, C.D., and Raghavan, P. (2008). Introduction to Information Retrieval, Cambridge University Press.","DOI":"10.1017\/CBO9780511809071"},{"key":"ref_19","unstructured":"Hastie, T., Tibshirani, R., and Friedman, J.H. (2016). The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Springer. [2nd ed.]."},{"key":"ref_20","first-page":"551","article-title":"Online Passive-Aggressive Algorithms","volume":"7","author":"Crammer","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"McCullagh, P., and Nelder, J.A. (2019). Generalized Linear Models, Chapman & Hall. [2nd ed.].","DOI":"10.1201\/9780203753736"},{"key":"ref_22","unstructured":"Lichman, M. (2013). UCI Machine Learning Repository, University of California Irvine, School of Information and Computer Science."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"570","DOI":"10.1287\/opre.43.4.570","article-title":"Breast Cancer Diagnosis and Prognosis via Linear Programming","volume":"43","author":"Mangasarian","year":"1995","journal-title":"Oper. Res."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1016\/S0167-7152(96)00140-X","article-title":"Sparse Spatial Autoregressions","volume":"33","author":"Pace","year":"1997","journal-title":"Stat. Probab. Lett."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1214\/009053604000000067","article-title":"Least Angle Regression","volume":"32","author":"Efron","year":"2004","journal-title":"Ann. Stat."},{"key":"ref_26","unstructured":"Wasserman, L. (2013). All of Statistics: A Concise Course in Statistical Inference, Springer."},{"key":"ref_27","first-page":"28","article-title":"The Generalization of \u201cStudent\u2019s\u201d Problem When Several Different Population Variances are Involved","volume":"34","author":"Welch","year":"1947","journal-title":"Biometrika"},{"key":"ref_28","unstructured":"Google (2022). Google Cloud Platform, Alphabet, Inc."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/1\/17\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:52:41Z","timestamp":1760147561000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/1\/17"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,27]]},"references-count":28,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["a16010017"],"URL":"https:\/\/doi.org\/10.3390\/a16010017","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,27]]}}}