{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,11]],"date-time":"2026-02-11T18:02:52Z","timestamp":1770832972218,"version":"3.50.1"},"reference-count":72,"publisher":"IOP Publishing","issue":"4","license":[{"start":{"date-parts":[[2022,10,28]],"date-time":"2022-10-28T00:00:00Z","timestamp":1666915200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,10,28]],"date-time":"2022-10-28T00:00:00Z","timestamp":1666915200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Mach. Learn.: Sci. Technol."],"published-print":{"date-parts":[[2022,12,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>A myriad of phenomena in materials science and chemistry rely on quantum-level simulations of the electronic structure in matter. While moving to larger length and time scales has been a pressing issue for decades, such large-scale electronic structure calculations are still challenging despite modern software approaches and advances in high-performance computing. The silver lining in this regard is the use of machine learning to accelerate electronic structure calculations\u2014this line of research has recently gained growing attention. The grand challenge therein is finding a suitable machine-learning model during a process called hyperparameter optimization. This, however, causes a massive computational overhead in addition to that of data generation. We accelerate the construction of neural network models by roughly two orders of magnitude by circumventing excessive training during the hyperparameter optimization phase. We demonstrate our workflow for Kohn\u2013Sham density functional theory, the most popular computational method in materials science and chemistry.<\/jats:p>","DOI":"10.1088\/2632-2153\/ac9956","type":"journal-article","created":{"date-parts":[[2022,10,11]],"date-time":"2022-10-11T22:31:05Z","timestamp":1665527465000},"page":"045008","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Training-free hyperparameter optimization of neural networks for electronic structures in matter"],"prefix":"10.1088","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8311-0613","authenticated-orcid":true,"given":"Lenz","family":"Fiedler","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nils","family":"Hoffmann","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Parvez","family":"Mohammed","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gabriel A","family":"Popoola","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tamar","family":"Yovell","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Vladyslav","family":"Oles","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9901-102X","authenticated-orcid":false,"given":"J","family":"Austin Ellis","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5854-409X","authenticated-orcid":false,"given":"Sivasankaran","family":"Rajamanickam","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9162-262X","authenticated-orcid":false,"given":"Attila","family":"Cangi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"266","published-online":{"date-parts":[[2022,10,28]]},"reference":[{"key":"mlstac9956bib1","doi-asserted-by":"publisher","first-page":"814","DOI":"10.1002\/(SICI)1097-461X(2000)77:53.0.CO;2-F","volume":"77","author":"Kurth","year":"2000","journal-title":"Int. J. Quantum Chem."},{"key":"mlstac9956bib2","author":"Martin","year":"2004"},{"key":"mlstac9956bib3","doi-asserted-by":"publisher","first-page":"B864","DOI":"10.1103\/PhysRev.136.B864","volume":"136","author":"Hohenberg","year":"1964","journal-title":"Phys. Rev."},{"key":"mlstac9956bib4","doi-asserted-by":"publisher","first-page":"A1133","DOI":"10.1103\/PhysRev.140.A1133","volume":"140","author":"Kohn","year":"1965","journal-title":"Phys. Rev."},{"key":"mlstac9956bib5","doi-asserted-by":"publisher","first-page":"A1441","DOI":"10.1103\/PhysRev.137.A1441","volume":"137","author":"Mermin","year":"1965","journal-title":"Phys. Rev."},{"key":"mlstac9956bib6","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1002\/andp.19273892002","volume":"389","author":"Born","year":"1927","journal-title":"Ann. Phys., Lpz."},{"key":"mlstac9956bib7","author":"Toulouse","year":"2021"},{"key":"mlstac9956bib8","doi-asserted-by":"publisher","first-page":"7860","DOI":"10.1021\/acs.jpcc.0c00762","volume":"124","author":"Dziedzic","year":"2020","journal-title":"J. Phys. Chem. C"},{"key":"mlstac9956bib9","doi-asserted-by":"publisher","first-page":"E12","DOI":"10.1038\/s41586-021-04078-x","volume":"600","author":"Karasiev","year":"2021","journal-title":"Nature"},{"key":"mlstac9956bib10","doi-asserted-by":"publisher","DOI":"10.1063\/5.0005074","volume":"152","author":"Nakata","year":"2020","journal-title":"J. Chem. Phys."},{"key":"mlstac9956bib11","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.125.075702","volume":"125","author":"Dharma-wardana","year":"2020","journal-title":"Phys. Rev. Lett."},{"key":"mlstac9956bib12","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevResearch.3.023026","volume":"3","author":"Massacrier","year":"2021","journal-title":"Phys. Rev. Res."},{"key":"mlstac9956bib13","author":"Callow","year":"2021"},{"key":"mlstac9956bib14","author":"Fiedler","year":"2021"},{"key":"mlstac9956bib15","doi-asserted-by":"publisher","first-page":"338","DOI":"10.1002\/inf2.12028","volume":"1","author":"Wei","year":"2019","journal-title":"InfoMat"},{"key":"mlstac9956bib16","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevMaterials.2.120301","volume":"2","author":"Gubernatis","year":"2018","journal-title":"Phys. Rev. Mater."},{"key":"mlstac9956bib17","doi-asserted-by":"publisher","DOI":"10.1103\/RevModPhys.91.045002","volume":"91","author":"Carleo","year":"2019","journal-title":"Rev. Mod. Phys."},{"key":"mlstac9956bib18","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1038\/s41524-019-0221-0","volume":"5","author":"Schmidt","year":"2019","journal-title":"npj Comput. Mater."},{"key":"mlstac9956bib19","doi-asserted-by":"publisher","first-page":"7273","DOI":"10.1021\/acs.jpca.7b07045","volume":"121","author":"Liu","year":"2017","journal-title":"J. Phys. Chem. A"},{"key":"mlstac9956bib20","doi-asserted-by":"publisher","first-page":"6425","DOI":"10.1021\/acs.jpclett.9b02422","volume":"10","author":"Schmidt","year":"2019","journal-title":"J. Phys. Chem. Lett."},{"key":"mlstac9956bib21","doi-asserted-by":"publisher","first-page":"1385","DOI":"10.1126\/science.abj6511","volume":"374","author":"Kirkpatrick","year":"2021","journal-title":"Science"},{"key":"mlstac9956bib22","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms14621","volume":"8","author":"Ulissi","year":"2017","journal-title":"Nat. Commun."},{"key":"mlstac9956bib23","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevB.89.205118","volume":"89","author":"Sch\u00fctt","year":"2014","journal-title":"Phys. Rev. B"},{"key":"mlstac9956bib24","doi-asserted-by":"publisher","first-page":"2087","DOI":"10.1021\/acs.jctc.5b00099","volume":"11","author":"Ramakrishnan","year":"2015","journal-title":"J. Chem. Theory Comput."},{"key":"mlstac9956bib25","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevB.95.094203","volume":"95","author":"Deringer","year":"2017","journal-title":"Phys. Rev. B"},{"key":"mlstac9956bib26","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevB.85.174103","volume":"85","author":"Sosso","year":"2012","journal-title":"Phys. Rev. B"},{"key":"mlstac9956bib27","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1021\/jp401225b","volume":"117","author":"Morawietz","year":"2013","journal-title":"J. Phys. Chem. A"},{"key":"mlstac9956bib28","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.104.136403","volume":"104","author":"Bart\u00f3k","year":"2010","journal-title":"Phys. Rev. Lett."},{"key":"mlstac9956bib29","doi-asserted-by":"publisher","first-page":"5090","DOI":"10.1021\/acs.chemmater.7b00156","volume":"29","author":"Schmidt","year":"2017","journal-title":"Chem. Mater."},{"key":"mlstac9956bib30","doi-asserted-by":"publisher","first-page":"3192","DOI":"10.1039\/c6sc05720a","volume":"8","author":"Smith","year":"2017","journal-title":"Chem. Sci."},{"key":"mlstac9956bib31","doi-asserted-by":"publisher","first-page":"1079","DOI":"10.1103\/PhysRevLett.108.253002","volume":"108","author":"Snyder","year":"2012","journal-title":"Phys. Rev. Lett."},{"key":"mlstac9956bib32","doi-asserted-by":"publisher","first-page":"872","DOI":"10.1038\/s41467-017-00839-3","volume":"8","author":"Brockherde","year":"2017","journal-title":"Nat. Commun."},{"key":"mlstac9956bib33","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.125.206401","volume":"125","author":"Tsubaki","year":"2020","journal-title":"Phys. Rev. Lett."},{"key":"mlstac9956bib34","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1038\/s41524-019-0162-7","volume":"5","author":"Chandrasekaran","year":"2019","journal-title":"npj Comput. Mater."},{"key":"mlstac9956bib35","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevB.104.035120","volume":"104","author":"Ellis","year":"2021","journal-title":"Phys. Rev. B"},{"key":"mlstac9956bib36","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1007\/s13218-015-0381-0","volume":"29","author":"Hutter","year":"2015","journal-title":"K\u00fcnstl Intell."},{"key":"mlstac9956bib37","first-page":"pp 2623","article-title":"Optuna: a next-generation hyperparameter optimization framework","author":"Akiba","year":"2019"},{"key":"mlstac9956bib38","author":"Mellor","year":"2020"},{"key":"mlstac9956bib39","doi-asserted-by":"publisher","first-page":"300","DOI":"10.1038\/s41597-020-00638-4","volume":"7","author":"Huber","year":"2020","journal-title":"Sci. Data"},{"key":"mlstac9956bib40","doi-asserted-by":"publisher","DOI":"10.1088\/1361-648X\/aa680e","volume":"29","author":"Larsen","year":"2017","journal-title":"J. Phys.: Condens. Matter"},{"key":"mlstac9956bib41","doi-asserted-by":"publisher","DOI":"10.1016\/j.commatsci.2020.110086","volume":"187","author":"Uhrin","year":"2021","journal-title":"Comput. Mater. Sci."},{"key":"mlstac9956bib42","first-page":"pp 205","article-title":"Automated machine learning: the new wave of machine learning","author":"Chauhan","year":"2020"},{"key":"mlstac9956bib43","doi-asserted-by":"publisher","author":"Cangi","year":"2021","DOI":"10.5281\/zenodo.5557254"},{"key":"mlstac9956bib44","doi-asserted-by":"publisher","first-page":"566","DOI":"10.1103\/PhysRevLett.45.566","volume":"45","author":"Ceperley","year":"1980","journal-title":"Phys. Rev. Lett."},{"key":"mlstac9956bib45","doi-asserted-by":"publisher","first-page":"3865","DOI":"10.1103\/PhysRevLett.77.3865","volume":"77","author":"Perdew","year":"1996","journal-title":"Phys. Rev. Lett."},{"key":"mlstac9956bib46","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.119.135001","volume":"119","author":"Groth","year":"2017","journal-title":"Phys. Rev. Lett."},{"key":"mlstac9956bib47","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.112.076403","volume":"112","author":"Karasiev","year":"2014","journal-title":"Phys. Rev. Lett."},{"key":"mlstac9956bib48","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevB.88.081102","volume":"88","author":"Brown","year":"2013","journal-title":"Phys. Rev. B"},{"key":"mlstac9956bib49","article-title":"The perceptron: a perceiving and recognizing automaton (Project PARA)","author":"Rosenblatt","year":"1957"},{"key":"mlstac9956bib50","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1016\/0893-6080(89)90020-8","volume":"2","author":"Hornik","year":"1989","journal-title":"Neural Netw."},{"key":"mlstac9956bib51","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1016\/0893-6080(91)90009-T","volume":"4","author":"Hornik","year":"1991","journal-title":"Neural Netw."},{"key":"mlstac9956bib52","author":"Goodfellow","year":"2016","edition":"illustrated edn"},{"key":"mlstac9956bib53","article-title":"PyTorch: an imperative style, high-performance deep learning library","volume":"vol 32","author":"Paszke","year":"2019"},{"key":"mlstac9956bib54","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1016\/j.jcp.2014.12.018","volume":"285","author":"Thompson","year":"2015","journal-title":"J. Comput. Phys."},{"key":"mlstac9956bib55","doi-asserted-by":"publisher","DOI":"10.1063\/1.5017641","volume":"148","author":"Wood","year":"2018","journal-title":"J. Chem. Phys."},{"key":"mlstac9956bib56","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevB.99.184305","volume":"99","author":"Wood","year":"2019","journal-title":"Phys. Rev. B"},{"key":"mlstac9956bib57","doi-asserted-by":"publisher","first-page":"5456","DOI":"10.1021\/acs.jpca.0c02450","volume":"124","author":"Cusentino","year":"2020","journal-title":"J. Phys. Chem. A"},{"key":"mlstac9956bib58","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1145\/321062.321069","volume":"8","author":"Hooke","year":"1961","journal-title":"J. ACM"},{"key":"mlstac9956bib59","doi-asserted-by":"publisher","first-page":"191","DOI":"10.1016\/S0377-0427(00)00423-4","volume":"124","author":"Lewis","year":"2000","journal-title":"J. Comput. Appl. Math."},{"key":"mlstac9956bib60","volume":"vol 24","author":"Bergstra","year":"2011"},{"key":"mlstac9956bib61","first-page":"pp 287","article-title":"Deep neural network hyperparameter optimization with orthogonal array tuning","author":"Zhang","year":"2019"},{"key":"mlstac9956bib62","doi-asserted-by":"publisher","first-page":"3690","DOI":"10.1080\/03610926.2015.1071391","volume":"46","author":"Beder","year":"2017","journal-title":"Commun. Stat. - Theory Methods"},{"key":"mlstac9956bib63","doi-asserted-by":"publisher","DOI":"10.14278\/rodare.1834","article-title":"LDOS\/SNAP data for MALA: Beryllium at 298 K","author":"Fiedler","year":"2022"},{"key":"mlstac9956bib64","doi-asserted-by":"publisher","DOI":"10.23728\/b2share.436e1e79daa54436a7703340431b4e19","article-title":"Scripts and networks for \u201cElectronic structure machine learning surrogates without training\u201d","author":"Fiedler","year":"2022"},{"key":"mlstac9956bib65","doi-asserted-by":"publisher","DOI":"10.14278\/rodare.1107","article-title":"LDOS\/SNAP data for MALA: aluminium at 298 K and 933 K","author":"Ellis","year":"2021"},{"key":"mlstac9956bib66","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1093\/biomet\/30.1-2.81","volume":"30","author":"Kendall","year":"1938","journal-title":"Biometrika"},{"key":"mlstac9956bib67","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevB.87.184115","volume":"87","author":"Bart\u00f3k","year":"2013","journal-title":"Phys. Rev. B"},{"key":"mlstac9956bib68","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.108.058301","volume":"108","author":"Rupp","year":"2012","journal-title":"Phys. Rev. Lett."},{"key":"mlstac9956bib69","doi-asserted-by":"publisher","first-page":"1948","DOI":"10.1021\/acs.jpclett.5b00831","volume":"6","author":"Hansen","year":"2015","journal-title":"J. Phys. Chem. Lett."},{"key":"mlstac9956bib70","author":"Faber","year":"2017"},{"key":"mlstac9956bib71","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevB.99.014104","volume":"99","author":"Drautz","year":"2019","journal-title":"Phys. Rev. B"},{"key":"mlstac9956bib72","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41524-021-00559-9","volume":"7","author":"Lysogorskiy","year":"2021","journal-title":"npj Comput. Mater."}],"container-title":["Machine Learning: Science and Technology"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ac9956","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ac9956\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ac9956","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ac9956\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ac9956\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ac9956\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ac9956\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ac9956\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,10,28]],"date-time":"2022-10-28T11:23:20Z","timestamp":1666956200000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ac9956"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,28]]},"references-count":72,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2022,10,28]]},"published-print":{"date-parts":[[2022,12,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2632-2153\/ac9956","relation":{},"ISSN":["2632-2153"],"issn-type":[{"value":"2632-2153","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,10,28]]},"assertion":[{"value":"Training-free hyperparameter optimization of neural networks for electronic structures in matter","name":"article_title","label":"Article Title"},{"value":"Machine Learning: Science and Technology","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2022 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2022-08-08","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2022-10-11","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2022-10-28","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}