{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,1]],"date-time":"2026-10-01T20:15:34Z","timestamp":1790885734718,"version":"4.1.0"},"reference-count":40,"publisher":"IOP Publishing","issue":"3","license":[{"start":{"date-parts":[[2021,6,14]],"date-time":"2021-06-14T00:00:00Z","timestamp":1623628800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,6,14]],"date-time":"2021-06-14T00:00:00Z","timestamp":1623628800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"DOI":"10.13039\/501100000921","name":"European Cooperation in Science and Technology","doi-asserted-by":"crossref","award":["18234"],"award-info":[{"award-number":["18234"]}],"id":[{"id":"10.13039\/501100000921","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Finnish Center for Artificial Intelligence"},{"DOI":"10.13039\/501100003125","name":"Suomen Kulttuurirahasto","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100003125","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Aalto Science-IT"},{"name":"CSC-IT Center for Science, Finland"},{"DOI":"10.13039\/501100004155","name":"Magnus Ehrnroothin S\u00e4\u00e4ti\u00f6","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004155","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100002341","name":"Academy of Finland","doi-asserted-by":"crossref","award":["316601"],"award-info":[{"award-number":["316601"]}],"id":[{"id":"10.13039\/501100002341","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Mach. Learn.: Sci. Technol."],"published-print":{"date-parts":[[2021,9,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Machine learning methods usually depend on internal parameters\u2014so called hyperparameters\u2014that need to be optimized for best performance. Such optimization poses a burden on machine learning practitioners, requiring expert knowledge, intuition or computationally demanding brute-force parameter searches. We here assess three different hyperparameter selection methods: grid search, random search and an efficient automated optimization technique based on Bayesian optimization (BO). We apply these methods to a machine learning problem based on kernel ridge regression in computational chemistry. Two different descriptors are employed to represent the atomic structure of organic molecules, one of which introduces its own set of hyperparameters to the method. We identify optimal hyperparameter configurations and infer entire prediction error landscapes in hyperparameter space that serve as visual guides for the hyperparameter performance. We further demonstrate that for an increasing number of hyperparameters, BO and random search become significantly more efficient in computational time than an exhaustive grid search, while delivering an equivalent or even better accuracy.<\/jats:p>","DOI":"10.1088\/2632-2153\/abee59","type":"journal-article","created":{"date-parts":[[2021,3,12]],"date-time":"2021-03-12T17:31:06Z","timestamp":1615570266000},"page":"035022","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":90,"title":["Efficient hyperparameter tuning for kernel ridge regression with Bayesian optimization"],"prefix":"10.1088","volume":"2","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4761-7425","authenticated-orcid":false,"given":"Annika","family":"Stuke","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1898-723X","authenticated-orcid":false,"given":"Patrick","family":"Rinke","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0028-0105","authenticated-orcid":false,"given":"Milica","family":"Todorovi\u0107","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"266","published-online":{"date-parts":[[2021,6,14]]},"reference":[{"key":"mlstabee59bib1","author":"Hey","year":"2009"},{"key":"mlstabee59bib2","doi-asserted-by":"publisher","DOI":"10.1063\/1.4946894","volume":"4","author":"Agrawal","year":"2016","journal-title":"APL Mater."},{"key":"mlstabee59bib3","doi-asserted-by":"publisher","first-page":"1433","DOI":"10.1016\/j.matt.2019.10.024","volume":"1","author":"Aykol","year":"2019","journal-title":"Matter"},{"key":"mlstabee59bib4","doi-asserted-by":"publisher","DOI":"10.1002\/advs.201900808","volume":"6","author":"Himanen","year":"2019","journal-title":"Adv. Sci."},{"key":"mlstabee59bib5","author":"","year":"2017"},{"key":"mlstabee59bib6","first-page":"186","author":"M\u00fcller","year":"2016"},{"key":"mlstabee59bib7","doi-asserted-by":"publisher","first-page":"0121","DOI":"10.1038\/s41570-018-0121","volume":"2","author":"Zunger","year":"2018","journal-title":"Nat. Rev. Chem."},{"key":"mlstabee59bib8","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1021\/ci500747n","volume":"55","author":"Ma","year":"2015","journal-title":"J. Chem. Inf. Model."},{"key":"mlstabee59bib9","doi-asserted-by":"publisher","first-page":"270","DOI":"10.1016\/j.commatsci.2016.02.021","volume":"117","author":"Shandiz","year":"2016","journal-title":"Comp. Mat. Sci."},{"key":"mlstabee59bib10","doi-asserted-by":"publisher","first-page":"1120","DOI":"10.1038\/nmat4717","volume":"15 10","author":"G\u00f3mez-Bombarelli","year":"2016","journal-title":"Nat. Mater."},{"key":"mlstabee59bib11","author":"Sendek","year":"2018"},{"key":"mlstabee59bib12","doi-asserted-by":"publisher","DOI":"10.1063\/1.5043213","volume":"148","author":"Rupp","year":"2018","journal-title":"J. Chem. Phys."},{"key":"mlstabee59bib13","doi-asserted-by":"publisher","first-page":"2311","DOI":"10.1002\/aic.16198","volume":"64","author":"Goldsmith","year":"2018","journal-title":"AIChE J."},{"key":"mlstabee59bib14","doi-asserted-by":"publisher","first-page":"7069","DOI":"10.1039\/C8SC01949E","volume":"9","author":"Meyer","year":"2018","journal-title":"Chem. Sci."},{"key":"mlstabee59bib15","doi-asserted-by":"publisher","first-page":"17096","DOI":"10.1039\/C9TA02356A","article-title":"Machine learning for renewable energy materials","volume":"7","author":"Gu","year":"2019","journal-title":"J. Mater. Chem. A"},{"key":"mlstabee59bib16","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1038\/s41524-019-0221-0","volume":"5","author":"Schmidt","year":"2019","journal-title":"npj Comput. Mater."},{"key":"mlstabee59bib17","doi-asserted-by":"publisher","first-page":"22858","DOI":"10.1002\/anie.201909987","volume":"59","author":"Coley","year":"2020","journal-title":"Angew. Chem., Int. Ed."},{"key":"mlstabee59bib18","doi-asserted-by":"publisher","first-page":"23414","DOI":"10.1002\/anie.201909989","volume":"59","author":"Coley","year":"2020","journal-title":"Angew. Chem., Int. Ed."},{"key":"mlstabee59bib19","first-page":"1015","article-title":"Gaussian process optimization in the bandit setting: no regret and experimental design","author":"Srinivas","year":"2010"},{"key":"mlstabee59bib20","first-page":"26","volume":"17","author":"Wu","year":"2019","journal-title":"J. Electr. Sci. Tech."},{"key":"mlstabee59bib21","author":"Yogatama","year":"2014"},{"key":"mlstabee59bib22","author":"Perrone","year":"2019"},{"key":"mlstabee59bib23","first-page":"485","article-title":"Evaluation of a tree-based pipeline optimization tool for automating data science","author":"Olson","year":"2016"},{"key":"mlstabee59bib24","first-page":"339","article-title":"Hyperspace: distributed Bayesian hyperparameter optimization","author":"Young","year":"2018"},{"key":"mlstabee59bib25","author":"Dua","year":"2017"},{"key":"mlstabee59bib26","doi-asserted-by":"publisher","DOI":"10.1063\/1.5086105","volume":"150","author":"Stuke","year":"2019","journal-title":"J. Chem. Phys."},{"key":"mlstabee59bib27","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.108.058301","volume":"108","author":"Rupp","year":"2012","journal-title":"Phys. Rev. Lett."},{"key":"mlstabee59bib28","author":"Huo","year":"2017"},{"key":"mlstabee59bib29","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2014.22","volume":"1","author":"Ramakrishnan","year":"2014","journal-title":"Sci. Data"},{"key":"mlstabee59bib30","doi-asserted-by":"publisher","first-page":"1058","DOI":"10.1002\/qua.24954","volume":"115","author":"Rupp","year":"2015","journal-title":"Int. J. Quantum. Chem."},{"key":"mlstabee59bib31","author":""},{"key":"mlstabee59bib32","doi-asserted-by":"publisher","author":"Rasmussen","year":"2006","DOI":"10.1007\/978-3-540-28650-9_4"},{"key":"mlstabee59bib33","first-page":"1","volume":"17","author":"Gutmann","year":"2016"},{"key":"mlstabee59bib34","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1038\/s41524-019-0175-2","volume":"5","author":"Todorovi\u0107","year":"2019","journal-title":"npj Comp. Mat."},{"key":"mlstabee59bib35","author":""},{"key":"mlstabee59bib36","author":"Brochu","year":"2010"},{"key":"mlstabee59bib37","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.9","volume":"3","author":"Ropo","year":"2016","journal-title":"Sci. Data"},{"key":"mlstabee59bib38","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1038\/s41597-020-0385-y","volume":"7","author":"Stuke","year":"2020","journal-title":"Sci. Data"},{"key":"mlstabee59bib39","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s13321-019-0391-2","volume":"11","author":"Glavatskikh","year":"2019","journal-title":"J. Cheminf."},{"key":"mlstabee59bib40","author":"Stuke","year":"2021"}],"container-title":["Machine Learning: Science and Technology"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abee59","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abee59\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abee59","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abee59\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abee59\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abee59\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abee59\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abee59\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,12,13]],"date-time":"2021-12-13T08:55:48Z","timestamp":1639385748000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/abee59"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,14]]},"references-count":40,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2021,6,14]]},"published-print":{"date-parts":[[2021,9,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2632-2153\/abee59","relation":{},"ISSN":["2632-2153"],"issn-type":[{"value":"2632-2153","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,14]]},"assertion":[{"value":"Efficient hyperparameter tuning for kernel ridge regression with Bayesian optimization","name":"article_title","label":"Article Title"},{"value":"Machine Learning: Science and Technology","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2021 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2020-10-05","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2021-03-12","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2021-06-14","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}