{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,13]],"date-time":"2025-12-13T23:10:49Z","timestamp":1765667449651,"version":"3.37.3"},"reference-count":74,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2023,8,7]],"date-time":"2023-08-07T00:00:00Z","timestamp":1691366400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,7]],"date-time":"2023-08-07T00:00:00Z","timestamp":1691366400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004281","name":"Narodowe Centrum Nauki","doi-asserted-by":"publisher","award":["2019\/34\/E\/ST6\/0005"],"award-info":[{"award-number":["2019\/34\/E\/ST6\/0005"]}],"id":[{"id":"10.13039\/501100004281","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach Learn"],"published-print":{"date-parts":[[2024,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>For many machine learning models, a choice of hyperparameters is a\u00a0crucial step towards achieving high performance. Prevalent meta-learning approaches focus on obtaining good hyperparameter configurations with a limited computational budget for a completely new task based on the results obtained from the prior tasks. This paper proposes a new formulation of the tuning problem, called <jats:italic>consolidated learning<\/jats:italic>, more suited to practical challenges faced by model developers, in which a large number of predictive models are created on similar datasets. In such settings, we are interested in the total optimization time rather than tuning for a\u00a0single task. We show that a carefully selected static portfolio of hyperparameter configurations yields good results for anytime optimization, while maintaining the ease of use and implementation. Moreover, we point out how to construct such a portfolio for specific domains. The improvement in the optimization is possible due to the more efficient transfer of hyperparameter configurations between similar tasks. We demonstrate the effectiveness of this approach through an empirical study for the XGBoost algorithm and the newly created metaMIMIC benchmarks of predictive tasks extracted from the MIMIC-IV medical database. In the paper, we show that the potential of <jats:italic>consolidated learning<\/jats:italic> is considerably greater due to its compatibility with many machine learning application scenarios.<\/jats:p>","DOI":"10.1007\/s10994-023-06359-0","type":"journal-article","created":{"date-parts":[[2023,8,7]],"date-time":"2023-08-07T21:01:29Z","timestamp":1691442089000},"page":"4925-4949","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Consolidated learning: a domain-specific model-free optimization strategy with validation on metaMIMIC benchmarks"],"prefix":"10.1007","volume":"113","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2400-7592","authenticated-orcid":false,"given":"Katarzyna","family":"Wo\u017anica","sequence":"first","affiliation":[]},{"given":"Mateusz","family":"Grzyb","sequence":"additional","affiliation":[]},{"given":"Zuzanna","family":"Trafas","sequence":"additional","affiliation":[]},{"given":"Przemys\u0142aw","family":"Biecek","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,8,7]]},"reference":[{"key":"6359_CR1","unstructured":"Alaa, A., & Schaar, M. (2018). AutoPrognosis: Automated clinical prognostic modeling via bayesian optimization with structured kernel learning. In Proceedings of the International Conference on Machine Learning (ICML) (pp. 139\u2013148)."},{"key":"6359_CR2","doi-asserted-by":"publisher","unstructured":"Alibrahim, H., & Ludwig, S. A. (2021). Hyperparameter optimization: Comparing genetic algorithm against grid search and bayesian optimization. In Proceedings of the IEEE Congress on Evolutionary Computation (CEC) (pp. 1551\u20131559). https:\/\/doi.org\/10.1109\/CEC45853.2021.9504761","DOI":"10.1109\/CEC45853.2021.9504761"},{"key":"6359_CR3","unstructured":"Bergstra, J., Bardenet, R., Bengio, Y., & K\u00e9gl, B. (2011). Algorithms for hyper-parameter optimization. Advances in Neural Information Processing Systems, 24."},{"issue":"10","key":"6359_CR4","first-page":"281","volume":"13","author":"J Bergstra","year":"2012","unstructured":"Bergstra, J., & Bengio, Y. (2012). Random search for hyper-parameter optimization. Journal of Machine Learning Research, 13(10), 281\u2013305.","journal-title":"Journal of Machine Learning Research"},{"issue":"1","key":"6359_CR5","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1088\/1749-4699\/8\/1\/014008","volume":"8","author":"J Bergstra","year":"2015","unstructured":"Bergstra, J., Komer, B., Eliasmith, C., Yamins, D., & Cox, D. D. (2015). Hyperopt: A python library for model selection and hyperparameter optimization. Computational Science & Discovery, 8(1), 13\u201319. https:\/\/doi.org\/10.1088\/1749-4699\/8\/1\/014008","journal-title":"Computational Science & Discovery"},{"key":"6359_CR6","unstructured":"Bischl, B., Casalicchio, G., Feurer, M., Hutter, F., Lang, M., Mantovani, R. G., van Rijn, J. N., & Vanschoren, J. (2017). OpenML benchmarking suites and the OpenML100. stat 1050, 11."},{"key":"6359_CR7","unstructured":"Bouthillier, X., & Varoquaux, G. (2020). Survey of machine-learning experimental methods at NeurIPS2019 and ICLR2020. PhD thesis, Inria Saclay Ile de France."},{"key":"6359_CR8","doi-asserted-by":"publisher","unstructured":"Brazdil, P. B., & Soares, C. (2000). A comparison of ranking methods for classification algorithm selection. In Proceedings of the 11th European conference on machine learning (ECML) (pp. 63\u201375). Springer. https:\/\/doi.org\/10.1007\/3-540-45164-1_8","DOI":"10.1007\/3-540-45164-1_8"},{"issue":"1","key":"6359_CR9","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1023\/A:1010933404324","volume":"45","author":"L Breiman","year":"2001","unstructured":"Breiman, L. (2001). Random forests. Machine Learning, 45(1), 5\u201332.","journal-title":"Machine Learning"},{"issue":"12","key":"6359_CR10","doi-asserted-by":"publisher","first-page":"763","DOI":"10.1038\/s41571-019-0253-x","volume":"16","author":"J Brierley","year":"2019","unstructured":"Brierley, J., O\u2019Sullivan, B., Asamura, H., Byrd, D., Huang, S. H., Lee, A., Pi\u00f1eros, M., Mason, M., Moraes, F. Y., R\u00f6sler, W., et al. (2019). Global consultation on cancer staging: Promoting consistent understanding and use. Nature Reviews Clinical Oncology, 16(12), 763\u2013771.","journal-title":"Nature Reviews Clinical Oncology"},{"issue":"4","key":"6359_CR11","doi-asserted-by":"publisher","DOI":"10.1103\/RevModPhys.91.045002","volume":"91","author":"G Carleo","year":"2019","unstructured":"Carleo, G., Cirac, I., Cranmer, K., Daudet, L., Schuld, M., Tishby, N., Vogt-Maranto, L., & Zdeborov\u00e1, L. (2019). Machine learning and the physical sciences. Reviews of Modern Physics, 91(4), 045002.","journal-title":"Reviews of Modern Physics"},{"key":"6359_CR12","doi-asserted-by":"publisher","first-page":"61","DOI":"10.1146\/annurev-publhealth-032315-021353","volume":"37","author":"JA Casey","year":"2016","unstructured":"Casey, J. A., Schwartz, B. S., Stewart, W. F., & Adler, N. E. (2016). Using electronic health records for population health research: A review of methods and applications. Annual Review of Public Health, 37, 61\u201381.","journal-title":"Annual Review of Public Health"},{"issue":"9","key":"6359_CR13","doi-asserted-by":"publisher","first-page":"3067","DOI":"10.1109\/TPAMI.2021.3062900","volume":"43","author":"B Celik","year":"2021","unstructured":"Celik, B., & Vanschoren, J. (2021). Adaptation strategies for automated machine learning on evolving data. IEEE Transactions on Pattern Analysis and Machine Intelligence, 43(9), 3067\u20133078.","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"6359_CR14","doi-asserted-by":"crossref","unstructured":"Chen, T., Guestrin, C. (2016) XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining (pp. 785\u2013794).","DOI":"10.1145\/2939672.2939785"},{"key":"6359_CR15","unstructured":"Davis, C., & Giraud-Carrier, C. (2018). Annotative experts for hyperparameter selection. In AutoML workshop at ICML."},{"key":"6359_CR16","unstructured":"Edwards, H., & Storkey, A. (2017). Towards a neural statistician. In Proceedings of the 5th International Conference on ;earning Representations (ICLR)."},{"key":"6359_CR17","doi-asserted-by":"crossref","unstructured":"Escalante, H. J., Montes, M., & Sucar, E. (2010). Ensemble particle swarm model selection. In The 2010 international joint conference on neural networks (IJCNN) (pp. 1\u20138).","DOI":"10.1109\/IJCNN.2010.5596915"},{"key":"6359_CR18","unstructured":"Falkner, S., Klein, A., & Hutter, F. (2018). BOHB: Robust and efficient hyperparameter optimization at scale. In Proceedings of the 35th international conference on machine learning (ICML) (pp. 1437\u20131446)."},{"key":"6359_CR19","doi-asserted-by":"publisher","unstructured":"Feurer, M., Klein, A., Eggensperger, K., Springenberg, J. T., Blum, M., Hutter, F. (2019). In: F. Hutter, L. Kotthoff, J. Vanschoren (Eds.), Auto-sklearn: Efficient and robust automated machine learning (pp. 113\u2013134). Springer. https:\/\/doi.org\/10.1007\/978-3-030-05318-5_6","DOI":"10.1007\/978-3-030-05318-5_6"},{"key":"6359_CR20","doi-asserted-by":"crossref","unstructured":"Feurer, M., Springenberg, J., & Hutter, F. (2015). Initializing bayesian hyperparameter optimization via meta-learning. In Proceedings of the 29th AAAI conference on artificial intelligence (pp. 1128\u20131135).","DOI":"10.1609\/aaai.v29i1.9354"},{"issue":"261","key":"6359_CR21","first-page":"1","volume":"23","author":"M Feurer","year":"2022","unstructured":"Feurer, M., Eggensperger, K., Falkner, S., Lindauer, M., & Hutter, F. (2022). Auto-sklearn 2.0: Hands-free automl via meta-learning. Journal of Machine Learning Research, 23(261), 1\u201361.","journal-title":"Journal of Machine Learning Research"},{"issue":"177","key":"6359_CR22","first-page":"1","volume":"20","author":"A Fisher","year":"2019","unstructured":"Fisher, A., Rudin, C., & Dominici, F. (2019). All models are wrong, but many are useful: Learning a variable\u2019s importance by studying an entire class of prediction models simultaneously. Journal of Machine Learning Research, 20(177), 1\u201381.","journal-title":"Journal of Machine Learning Research"},{"issue":"D1","key":"6359_CR23","doi-asserted-by":"publisher","first-page":"1100","DOI":"10.1093\/nar\/gkr777","volume":"40","author":"A Gaulton","year":"2012","unstructured":"Gaulton, A., Bellis, L. J., Bento, A. P., Chambers, J., Davies, M., Hersey, A., Light, Y., McGlinchey, S., Michalovich, D., Al-Lazikani, B., et al. (2012). Chembl: A large-scale bioactivity database for drug discovery. Nucleic Acids Research, 40(D1), 1100\u20131107.","journal-title":"Nucleic Acids Research"},{"key":"6359_CR24","doi-asserted-by":"publisher","unstructured":"Guyon, I., Sun-Hosoya, L., Boull\u00e9, M., Escalante, H. J., Escalera, S., Liu, Z., Jajetic, D., Ray, B., Saeed, M., Sebag, M., Statnikov, A., Tu, W.-W., Viegas, E. (2019). In F. Hutter, L. Kotthoff, & Vanschoren, J. (Eds.), Analysis of the AutoML challenge series 2015\u20132018 (pp. 177\u2013219). Springer. https:\/\/doi.org\/10.1007\/978-3-030-05318-5_10","DOI":"10.1007\/978-3-030-05318-5_10"},{"key":"6359_CR25","unstructured":"Hewitt, L. B., Nye, M. I., Gane, A., Jaakkola, T. S., & Tenenbaum, J. B. (2018). The variational homoencoder: Learning to learn high capacity generative models from few examples. Preprint arxiv:1807.08919"},{"issue":"4","key":"6359_CR26","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1001\/jama.2010.1015","volume":"304","author":"JU Hibbard","year":"2010","unstructured":"Hibbard, J. U., Wilkins, I., Sun, L., Gregory, K., Haberman, S., Hoffman, M., Kominiarek, M. A., Reddy, U., Bailit, J., Branch, D. W., et al. (2010). Respiratory morbidity in late preterm births. JAMA: The journal of the American Medical Association, 304(4), 419.","journal-title":"JAMA: The journal of the American Medical Association"},{"key":"6359_CR27","series-title":"Lecture Notes in Computer Science","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1007\/978-3-642-25566-3_40","volume-title":"Sequential model-based optimization for general algorithm configuration","author":"F Hutter","year":"2011","unstructured":"Hutter, F., Hoos, H. H., & Leyton-Brown, K. (2011). Sequential model-based optimization for general algorithm configuration Lecture Notes in Computer Science (pp. 507\u2013523). Springer. https:\/\/doi.org\/10.1007\/978-3-642-25566-3_40"},{"key":"6359_CR28","unstructured":"Jamieson, K., & Talwalkar, A. (2016). Non-stochastic best arm identification and hyperparameter optimization. In Proceedings of the 19th international conference on artificial intelligence and statistics (AISTATS) (pp. 240\u2013248)."},{"key":"6359_CR29","doi-asserted-by":"publisher","unstructured":"Johnson, A., Bulgarelli, L., Pollard, T., Horng, S., Celi, L., & Mark, R. (2020). MIMIC-IV (version 1.0). https:\/\/doi.org\/10.13026\/a3wn-hq05","DOI":"10.13026\/a3wn-hq05"},{"key":"6359_CR30","unstructured":"Johnson, A. E. W., Pollard, T. J., & Mark, R. G. (2017). Reproducibility in critical care: A mortality prediction case study. In Proceedings of the 2nd machine learning for health care conference (MLHC) (pp. 361\u2013376)."},{"issue":"3","key":"6359_CR31","doi-asserted-by":"publisher","first-page":"964","DOI":"10.1007\/s10618-021-00737-9","volume":"35","author":"HS Jomaa","year":"2021","unstructured":"Jomaa, H. S., Schmidt-Thieme, L., & Grabocka, J. (2021). Dataset2vec: Learning dataset meta-features. Data Mining and Knowledge Discovery, 35(3), 964\u2013985. https:\/\/doi.org\/10.1007\/s10618-021-00737-9","journal-title":"Data Mining and Knowledge Discovery"},{"issue":"4","key":"6359_CR32","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1023\/A:1008306431147","volume":"13","author":"DR Jones","year":"1998","unstructured":"Jones, D. R., Schonlau, M., & Welch, W. J. (1998). Efficient global optimization of expensive black-box functions. Journal of Global optimization, 13(4), 455\u2013492. https:\/\/doi.org\/10.1023\/A:1008306431147","journal-title":"Journal of Global optimization"},{"issue":"3","key":"6359_CR33","doi-asserted-by":"publisher","first-page":"1027","DOI":"10.1021\/cr950202r","volume":"96","author":"M Karelson","year":"1996","unstructured":"Karelson, M., Lobanov, V. S., & Katritzky, A. R. (1996). Quantum-chemical descriptors in QSAR\/QSPR studies. Chemical Reviews, 96(3), 1027\u20131044.","journal-title":"Chemical Reviews"},{"issue":"7","key":"6359_CR34","doi-asserted-by":"publisher","first-page":"1070","DOI":"10.1097\/CCM.0000000000003123","volume":"46","author":"JL Koyner","year":"2018","unstructured":"Koyner, J. L., Carey, K. A., Edelson, D. P., & Churpek, M. M. (2018). The development of a machine learning inpatient acute kidney injury prediction model. Critical Care Medicine, 46(7), 1070\u20131077. https:\/\/doi.org\/10.1097\/CCM.0000000000003123","journal-title":"Critical Care Medicine"},{"key":"6359_CR35","unstructured":"Kretowicz, W., & Biecek, P. (2020). MementoML: Performance of selected machine learning algorithm configurations on OpenML100 datasets. Preprint arXiv:2008.13162"},{"issue":"3","key":"6359_CR36","doi-asserted-by":"publisher","first-page":"052","DOI":"10.1093\/jamiaopen\/ooab052","volume":"4","author":"S Kumar","year":"2021","unstructured":"Kumar, S., Oh, I., Schindler, S., Lai, A. M., Payne, P. R., & Gupta, A. (2021). Machine learning for modeling the progression of Alzheimer disease dementia using clinical data: A systematic literature review. JAMIA Open, 4(3), 052. https:\/\/doi.org\/10.1093\/jamiaopen\/ooab052","journal-title":"JAMIA Open"},{"key":"6359_CR37","unstructured":"Lavesson, N., & Davidsson, P. (2006). Quantifying the impact of learning algorithm parameter tuning. In Proceedings of the 21st AAAI conference on artificial intelligence (Vol. 6, pp. 395\u2013400)."},{"key":"6359_CR38","unstructured":"Li, K., & Malik, J. (2017). Learning to optimize. In International Conference on Learning Representations (ICLR). https:\/\/openreview.net\/forum?id=ry4Vrt5gl"},{"key":"6359_CR39","unstructured":"Li, L., Jamieson, K. G., DeSalvo, G., Rostamizadeh, A., & Talwalkar, A. (2017). Hyperband: Bandit-based configuration evaluation for hyperparameter optimization. In Proceedings of the 5th International Conference on Learning Representations (ICLR)."},{"issue":"1","key":"6359_CR40","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12890-021-01526-2","volume":"21","author":"T Liu","year":"2021","unstructured":"Liu, T., Zhao, Q., & Du, B. (2021). Effects of high-flow oxygen therapy on patients with hypoxemia after extubation and predictors of reintubation: A retrospective study based on the MIMIC-IV database. BMC Pulmonary Medicine, 21(1), 1\u201315. https:\/\/doi.org\/10.1186\/s12890-021-01526-2","journal-title":"BMC Pulmonary Medicine"},{"key":"6359_CR41","unstructured":"Mantovani, R. G., Rossi, A. L. D., Alcoba\u00e7a, E., Gertrudes, J. C., Junior, S. B., & de Carvalho, A. C. P. D. L. F. (2020). Rethinking default values: A low cost and efficient strategy to define hyperparameters. arXiv preprint arXiv:2008.00025"},{"issue":"1","key":"6359_CR42","doi-asserted-by":"publisher","first-page":"7166","DOI":"10.1038\/s41598-022-11012-2","volume":"12","author":"C Meng","year":"2022","unstructured":"Meng, C., Trinh, L., Xu, N., Enouen, J., & Liu, Y. (2022). Interpretability and fairness evaluation of deep learning models on MIMIC-IV dataset. Scientific Reports, 12(1), 7166. https:\/\/doi.org\/10.1038\/s41598-022-11012-2","journal-title":"Scientific Reports"},{"issue":"1","key":"6359_CR43","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1093\/cid\/cis815","volume":"56","author":"AC Moorman","year":"2013","unstructured":"Moorman, A. C., Gordon, S. C., Rupp, L. B., Spradling, P. R., Teshale, E. H., Lu, M., Nerenz, D. R., Nakasato, C. C., Boscarino, J. A., Henkle, E. M., et al. (2013). Baseline characteristics and mortality among people in care for chronic viral hepatitis: The chronic hepatitis cohort study. Clinical Infectious Diseases, 56(1), 40\u201350.","journal-title":"Clinical Infectious Diseases"},{"issue":"4","key":"6359_CR44","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1097\/CCM.0000000000002936","volume":"46","author":"S Nemati","year":"2018","unstructured":"Nemati, S., Holder, A., Razmi, F., Stanley, M. D., Clifford, G. D., & Buchman, T. G. (2018). An interpretable machine learning model for accurate prediction of sepsis in the ICU. Critical Care Medicine, 46(4), 547\u2013553. https:\/\/doi.org\/10.1097\/CCM.0000000000002936","journal-title":"Critical Care Medicine"},{"key":"6359_CR45","unstructured":"Oh, C., Gavves, E., & Welling, M. (2018). BOCK: Bayesian optimization with cylindrical kernels. In Proceedings of the 35th international conference on machine learning (ICML) (pp. 3868\u20133877)."},{"issue":"1","key":"6359_CR46","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1007\/s10994-017-5685-x","volume":"107","author":"I Olier","year":"2018","unstructured":"Olier, I., Sadawi, N., Bickerton, G. R., Vanschoren, J., Grosan, C., Soldatova, L., & King, R. D. (2018). Meta-QSAR: A large-scale application of meta-learning to drug design and discovery. Machine Learning, 107(1), 285\u2013311.","journal-title":"Machine Learning"},{"key":"6359_CR47","doi-asserted-by":"publisher","unstructured":"Olson, R. S., & Moore, J. H. (2019). In F. Hutter, L. Kotthoff, & J. Vanschoren (Eds.), TPOT: A tree-based pipeline optimization tool for automating machine learning (pp. 151\u2013160). Springer. https:\/\/doi.org\/10.1007\/978-3-030-05318-5_8","DOI":"10.1007\/978-3-030-05318-5_8"},{"key":"6359_CR48","unstructured":"Perrone, V., Shen, H., Seeger, M. W., Archambeau, C., & Jenatton, R. (2019). Learning search spaces for bayesian optimization: Another view of hyperparameter transfer learning. In Advances in neural information processing systems."},{"key":"6359_CR49","unstructured":"Pfahringer, B., Bensusan, H., & Giraud-Carrier, C. G. (2000). Meta-learning by landmarking various learning algorithms. In Proceedings of the 17th international conference on machine learning (ICML) (pp. 743\u2013750)."},{"key":"6359_CR50","doi-asserted-by":"publisher","unstructured":"Pfisterer, F., van Rijn, J. N., Probst, P., M\u00fcller, A. C., & Bischl, B. (2021). Learning multiple defaults for machine learning algorithms. In Proceedings of the genetic and evolutionary computation conference companion (GECCO) (pp. 241\u2013242). https:\/\/doi.org\/10.1145\/3449726.3459523","DOI":"10.1145\/3449726.3459523"},{"issue":"53","key":"6359_CR51","first-page":"1","volume":"20","author":"P Probst","year":"2019","unstructured":"Probst, P., Boulesteix, A.-L., & Bischl, B. (2019). Tunability: Importance of hyperparameters of machine learning algorithms. Journal of Machine Learning Research, 20(53), 1\u201332.","journal-title":"Journal of Machine Learning Research"},{"key":"6359_CR52","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1016\/j.jbi.2018.04.007","volume":"83","author":"S Purushotham","year":"2018","unstructured":"Purushotham, S., Meng, C., Che, Z., & Liu, Y. (2018). Benchmarking deep learning models on large healthcare datasets. Journal of Biomedical Informatics, 83, 112\u2013134.","journal-title":"Journal of Biomedical Informatics"},{"key":"6359_CR53","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1016\/j.jbi.2018.04.007","volume":"83","author":"S Purushotham","year":"2018","unstructured":"Purushotham, S., Meng, C., Che, Z., & Liu, Y. (2018). Benchmarking deep learning models on large healthcare datasets. Journal of Biomedical Informatics, 83, 112\u2013134.","journal-title":"Journal of Biomedical Informatics"},{"issue":"1","key":"6359_CR54","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1007\/s10044-012-0280-z","volume":"17","author":"M Reif","year":"2014","unstructured":"Reif, M., Shafait, F., Goldstein, M., Breuel, T., & Dengel, A. (2014). Automatic classifier selection for non-experts. Pattern Analysis and Applications, 17(1), 83\u201396. https:\/\/doi.org\/10.1007\/s10044-012-0280-z","journal-title":"Pattern Analysis and Applications"},{"key":"6359_CR55","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2021.10810","volume":"240","author":"A Rivolli","year":"2022","unstructured":"Rivolli, A., Garcia, L. P., Soares, C., Vanschoren, J., & de Carvalho, A. C. (2022). Meta-features for meta-learning. Knowledge-Based Systems, 240, 108101. https:\/\/doi.org\/10.1016\/j.knosys.2021.10810","journal-title":"Knowledge-Based Systems"},{"issue":"1","key":"6359_CR56","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/1472-6947-14-36","volume":"14","author":"C Roth","year":"2014","unstructured":"Roth, C., Foraker, R. E., Payne, P. R., & Embi, P. J. (2014). Community-level determinants of obesity: Harnessing the power of electronic health records for retrospective data analysis. BMC Medical Informatics and Decision Making, 14(1), 1\u20138.","journal-title":"BMC Medical Informatics and Decision Making"},{"key":"6359_CR57","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1016\/j.smhl.2018.07.001","volume":"9","author":"R Sadeghi","year":"2018","unstructured":"Sadeghi, R., Banerjee, T., & Romine, W. (2018). Early hospital mortality prediction using vital signals. Smart Health, 9, 265\u2013274.","journal-title":"Smart Health"},{"issue":"82","key":"6359_CR58","doi-asserted-by":"publisher","first-page":"719","DOI":"10.7326\/0003-4819-127-8_Part_2-199710151-00056","volume":"127","author":"JV Selby","year":"1997","unstructured":"Selby, J. V. (1997). Linking automated databases for research in managed care settings. Annals of Internal Medicine, 127(82), 719\u2013724.","journal-title":"Annals of Internal Medicine"},{"key":"6359_CR59","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1016\/j.inffus.2021.11.011","volume":"81","author":"R Shwartz-Ziv","year":"2022","unstructured":"Shwartz-Ziv, R., & Armon, A. (2022). Tabular data: Deep learning is not all you need. Information Fusion, 81, 84\u201390.","journal-title":"Information Fusion"},{"issue":"7","key":"6359_CR60","doi-asserted-by":"publisher","first-page":"1002861","DOI":"10.1371\/journal.pmed.1002861","volume":"16","author":"M Simonov","year":"2019","unstructured":"Simonov, M., Ugwuowo, U., Moreira, E., Yamamoto, Y., Biswas, A., Martin, M., Testani, J., & Wilson, F. P. (2019). A simple real-time model for predicting acute kidney injury in hospitalized patients in the us: A descriptive modeling study. PLoS Medicine, 16(7), 1002861.","journal-title":"PLoS Medicine"},{"key":"6359_CR61","unstructured":"Snoek, J., Larochelle, H., & Adams, R. P. (2012). Practical bayesian optimization of machine learning algorithms. Advances in Neural Information Processing Systems, 25."},{"key":"6359_CR62","doi-asserted-by":"publisher","unstructured":"Souza, A., Nardi, L., Oliveira, L., Olukotun, K., Lindauer, M., & Hutter, F. (2021). Bayesian Optimization with a prior for the optimum (pp. 265\u2013296). https:\/\/doi.org\/10.1007\/978-3-030-86523-8_17","DOI":"10.1007\/978-3-030-86523-8_17"},{"key":"6359_CR63","doi-asserted-by":"publisher","unstructured":"Thornton, C., Hutter, F., Hoos, H. H., & Leyton-Brown, K. (2013). Auto-WEKA. In Proceedings of the 19th ACM SIGKDD international conference on knowledge discovery and data mining (pp. 847\u2013855). https:\/\/doi.org\/10.1145\/2487575.2487629","DOI":"10.1145\/2487575.2487629"},{"key":"6359_CR64","doi-asserted-by":"publisher","first-page":"376","DOI":"10.1016\/j.eswa.2017.02.023","volume":"78","author":"L Turgeman","year":"2017","unstructured":"Turgeman, L., May, J. H., & Sciulli, R. (2017). Insights from a machine learning model for predicting the hospital length of stay (los) at the time of admission. Expert Systems with Applications, 78, 376\u2013385.","journal-title":"Expert Systems with Applications"},{"key":"6359_CR65","unstructured":"Vakhrushev, A., Ryzhkov, A., Savchenko, M., Simakov, D., Damdinov, R., & Tuzhilin, A. (2021). LightAutoML: AutoML solution for a large financial services ecosystem. Preprint arXiv:2109.01528"},{"key":"6359_CR66","doi-asserted-by":"publisher","unstructured":"Vanschoren, J. (2019). In F. Hutter, L. Kotthoff, & J. Vanschoren (Eds.), Meta-learning (pp. 35\u201361). Springer. https:\/\/doi.org\/10.1007\/978-3-030-05318-5_6","DOI":"10.1007\/978-3-030-05318-5_6"},{"key":"6359_CR67","first-page":"31","volume":"1","author":"R Vilalta","year":"2004","unstructured":"Vilalta, R., Giraud-Carrier, C., Brazdil, P., & Soares, C. (2004). Using meta-learning to support data mining. International Journal of Computer Science & Applications, 1, 31\u201345.","journal-title":"International Journal of Computer Science & Applications"},{"key":"6359_CR68","unstructured":"Wang, A. Y., Sable, J. H., & Spackman, K. A. (2002). The SNOMED clinical terms development process: Refinement and analysis of content. In Proceedings of the AMIA symposium (p. 845). American Medical Informatics Association."},{"key":"6359_CR69","unstructured":"Winkelmolen, F., Ivkin, N., Bozkurt, H. F., & Karnin, Z. (2020). Practical and sample efficient zero-shot hpo. arXiv preprint arXiv:2007.13382"},{"key":"6359_CR70","doi-asserted-by":"publisher","unstructured":"Wistuba, M., Schilling, N., & Schmidt-Thieme, L. (2015). Learning hyperparameter optimization initializations. In Proceedings in the IEEE International Conference on Data sSience and Advanced Analytics (DSAA) (pp. 1\u201310). https:\/\/doi.org\/10.1109\/dsaa.2015.7344817","DOI":"10.1109\/dsaa.2015.7344817"},{"key":"6359_CR71","doi-asserted-by":"publisher","unstructured":"Wistuba, M., Schilling, N., & Schmidt-Thieme, L. (2016). Sequential model-free hyperparameter tuning. In Proceedings in the IEEE International Conference on Data Mining (ICDM) (pp. 1033\u20131038). https:\/\/doi.org\/10.1109\/ICDM.2015.20","DOI":"10.1109\/ICDM.2015.20"},{"issue":"1","key":"6359_CR72","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1007\/s10994-017-5684-y","volume":"107","author":"M Wistuba","year":"2018","unstructured":"Wistuba, M., Schilling, N., & Schmidt-Thieme, L. (2018). Scalable gaussian process-based transfer surrogates for hyperparameter optimization. Machine Learning, 107(1), 43\u201378. https:\/\/doi.org\/10.1007\/s10994-017-5684-y","journal-title":"Machine Learning"},{"key":"6359_CR73","doi-asserted-by":"publisher","unstructured":"Wo\u017anica, K., & Biecek, P. (2021). Towards explainable meta-learning. In: Kamp, M., et al. Machine Learning and Principles and Practice of Knowledge Discovery in Databases. ECML PKDD 2021. Communications in Computer and Information Science, vol 1524. Springer. https:\/\/doi.org\/10.1007\/978-3-030-93736-2_38","DOI":"10.1007\/978-3-030-93736-2_38"},{"issue":"1","key":"6359_CR74","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13054-019-2411-z","volume":"23","author":"Z Zhang","year":"2019","unstructured":"Zhang, Z., Ho, K. M., & Hong, Y. (2019). Machine learning for the prediction of volume responsiveness in patients with oliguric acute kidney injury in critical care. Critical Care, 23(1), 1\u201310. https:\/\/doi.org\/10.1186\/s13054-019-2411-z","journal-title":"Critical Care"}],"container-title":["Machine Learning"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-023-06359-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10994-023-06359-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-023-06359-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,31]],"date-time":"2024-05-31T18:45:53Z","timestamp":1717181153000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10994-023-06359-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,7]]},"references-count":74,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2024,7]]}},"alternative-id":["6359"],"URL":"https:\/\/doi.org\/10.1007\/s10994-023-06359-0","relation":{},"ISSN":["0885-6125","1573-0565"],"issn-type":[{"type":"print","value":"0885-6125"},{"type":"electronic","value":"1573-0565"}],"subject":[],"published":{"date-parts":[[2023,8,7]]},"assertion":[{"value":"30 January 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 March 2023","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 June 2023","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 August 2023","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no conflict of interest to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent to participate"}},{"value":"Not applicable.","order":5,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}}]}}