{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,28]],"date-time":"2026-09-28T02:25:26Z","timestamp":1790562326117,"version":"4.1.0"},"reference-count":140,"publisher":"IOP Publishing","issue":"4","license":[{"start":{"date-parts":[[2024,12,2]],"date-time":"2024-12-02T00:00:00Z","timestamp":1733097600000},"content-version":"vor","delay-in-days":1,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2024,12,2]],"date-time":"2024-12-02T00:00:00Z","timestamp":1733097600000},"content-version":"tdm","delay-in-days":1,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"name":"National Science Foundation","award":["1931298"],"award-info":[{"award-number":["1931298"]}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Mach. Learn.: Sci. Technol."],"published-print":{"date-parts":[[2024,12,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>One compelling vision of the future of materials discovery and design involves the use of machine learning (ML) models to predict materials properties and then rapidly find materials tailored for specific applications. However, realizing this vision requires both providing detailed uncertainty quantification (model prediction errors and domain of applicability) and making models readily usable. At present, it is common practice in the community to assess ML model performance only in terms of prediction accuracy (e.g. mean absolute error), while neglecting detailed uncertainty quantification and robust model accessibility and usability. Here, we demonstrate a practical method for realizing both uncertainty and accessibility features with a large set of models. We develop random forest ML models for 33 materials properties spanning an array of data sources (computational and experimental) and property types (electrical, mechanical, thermodynamic, etc). All models have calibrated ensemble error bars to quantify prediction uncertainty and domain of applicability guidance enabled by kernel-density-estimate-based feature distance measures. All data and models are publicly hosted on the Garden-AI infrastructure, which provides an easy-to-use, persistent interface for model dissemination that permits models to be invoked with only a few lines of Python code. We demonstrate the power of this approach by using our models to conduct a fully ML-based materials discovery exercise to search for new stable, highly active perovskite oxide catalyst materials.<\/jats:p>","DOI":"10.1088\/2632-2153\/ad95db","type":"journal-article","created":{"date-parts":[[2024,12,2]],"date-time":"2024-12-02T02:24:07Z","timestamp":1733106247000},"page":"045051","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["Machine learning materials properties with accurate predictions, uncertainty estimates, domain guidance, and persistent online accessibility"],"prefix":"10.1088","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2229-6730","authenticated-orcid":true,"given":"Ryan","family":"Jacobs","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lane E","family":"Schultz","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aristana","family":"Scourtas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"KJ","family":"Schmidt","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Owen","family":"Price-Skelly","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Will","family":"Engler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2129-5269","authenticated-orcid":true,"given":"Ian","family":"Foster","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5326-4902","authenticated-orcid":true,"given":"Ben","family":"Blaiszik","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul M","family":"Voyles","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dane","family":"Morgan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"266","published-online":{"date-parts":[[2024,12,2]]},"reference":[{"key":"mlstad95dbbib1","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1146\/annurev-matsci-070218-010015","article-title":"Opportunities and challenges for machine learning in materials science","volume":"50","author":"Morgan","year":"2020","journal-title":"Annu. Rev. Mater. Res."},{"key":"mlstad95dbbib2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41524-019-0221-0","article-title":"Recent advances and applications of machine learning in solid-state materials science","volume":"5","author":"Schmidt","year":"2019","journal-title":"npj Comput. Mater."},{"key":"mlstad95dbbib3","doi-asserted-by":"publisher","first-page":"54","DOI":"10.1038\/s41524-017-0056-5","article-title":"Machine learning and materials informatics: recent applications and prospects","volume":"30","author":"Ramprasad","year":"2017","journal-title":"npj Comput. Mater."},{"key":"mlstad95dbbib4","first-page":"186","article-title":"Machine learning in materials science: recent progress and emerging applications","author":"Mueller","year":"2016"},{"key":"mlstad95dbbib5","doi-asserted-by":"publisher","first-page":"547","DOI":"10.1038\/s41586-018-0337-2","article-title":"Machine learning for molecular and materials science","volume":"559","author":"Butler","year":"2018","journal-title":"Nature"},{"key":"mlstad95dbbib6","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1007\/s40192-018-0117-8","article-title":"Perspectives on the impact of machine learning, deep learning, and artificial intelligence on materials, processes, and structures engineering","volume":"7","author":"Dimiduk","year":"2018","journal-title":"Integr. Mater. Manuf. Innov."},{"key":"mlstad95dbbib7","doi-asserted-by":"publisher","first-page":"779","DOI":"10.1557\/mrc.2019.73","article-title":"Deep materials informatics: applications of deep learning in materials science","volume":"9","author":"Agrawal","year":"2019","journal-title":"MRS Commun."},{"key":"mlstad95dbbib8","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1038\/s41524-022-00734-6","article-title":"Recent advances and applications of deep learning methods in materials science","volume":"8","author":"Choudhary","year":"2022","journal-title":"npj Comput. Mater."},{"key":"mlstad95dbbib9","doi-asserted-by":"publisher","first-page":"338","DOI":"10.1002\/inf2.12028","article-title":"Machine learning in materials science","volume":"1","author":"Wei","year":"2019","journal-title":"InfoMat"},{"key":"mlstad95dbbib10","doi-asserted-by":"publisher","first-page":"1","DOI":"10.26434\/chemrxiv-2024-x6spt","article-title":"Machine learning in materials research: developments over the last decade and challenges for the future","author":"Jain","year":"2024","journal-title":"ChemRxiv"},{"key":"mlstad95dbbib11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/npjcompumats.2016.28","article-title":"A general-purpose machine learning framework for predicting properties of inorganic materials","volume":"2","author":"Ward","year":"2016","journal-title":"npj Comput. Mater."},{"key":"mlstad95dbbib12","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41524-020-00406-3","article-title":"Benchmarking materials property prediction methods: the matbench test set and automatminer reference algorithm","volume":"6","author":"Dunn","year":"2020","journal-title":"npj Comput. Mater."},{"key":"mlstad95dbbib13","doi-asserted-by":"publisher","first-page":"2810","DOI":"10.1038\/srep02810","article-title":"Accelerating materials property predictions using machine learning","volume":"3","author":"Pilania","year":"2013","journal-title":"Sci. Rep."},{"key":"mlstad95dbbib14","doi-asserted-by":"publisher","first-page":"5977","DOI":"10.3390\/ma16175977","article-title":"Application of machine learning in material synthesis and property prediction","volume":"16","author":"Huang","year":"2023","journal-title":"Materials"},{"key":"mlstad95dbbib15","doi-asserted-by":"publisher","first-page":"49","DOI":"10.1146\/annurev-matsci-090319-010954","article-title":"Machine learning in materials discovery: confirmed predictions and their underlying approaches","volume":"50","author":"Saal","year":"2020","journal-title":"Annu. Rev. Mater. Res."},{"key":"mlstad95dbbib16","doi-asserted-by":"publisher","DOI":"10.1016\/j.commatsci.2023.112031","article-title":"Enhancing property prediction and process optimization in building materials through machine learning: a review","volume":"220","author":"Stergiou","year":"2023","journal-title":"Comput. Mater. Sci."},{"key":"mlstad95dbbib17","doi-asserted-by":"publisher","DOI":"10.1016\/j.commatsci.2021.110560","article-title":"A deep learning based automatic defect analysis framework for in-situ TEM ion irradiations","volume":"197","author":"Shen","year":"2021","journal-title":"Comput. Mater. Sci."},{"key":"mlstad95dbbib18","doi-asserted-by":"publisher","DOI":"10.1016\/j.commatsci.2021.110576","article-title":"Multi defect detection and analysis of electron microscopy images with deep learning","volume":"199","author":"Shen","year":"2021","journal-title":"Comput. Mater. Sci."},{"key":"mlstad95dbbib19","doi-asserted-by":"publisher","DOI":"10.1016\/j.xcrp.2022.100876","article-title":"Performance and limitations of deep learning semantic segmentation of multiple defects in transmission electron micrographs","volume":"3","author":"Jacobs","year":"2022","journal-title":"Cell Rep. Phys. Sci."},{"key":"mlstad95dbbib20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-023-32454-2","article-title":"Materials swelling revealed through automated semantic segmentation of cavities in electron microscopy images","volume":"13","author":"Jacobs","year":"2023","journal-title":"Sci. Rep."},{"key":"mlstad95dbbib21","doi-asserted-by":"publisher","DOI":"10.1016\/j.commatsci.2022.111527","article-title":"Deep learning object detection in materials science\u202f: current state and future directions","volume":"211","author":"Jacobs","year":"2022","journal-title":"Comput. Mater. Sci."},{"key":"mlstad95dbbib22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-019-49105-0","article-title":"Deep learning for semantic segmentation of defects in advanced STEM images of steels","volume":"9","author":"Roberts","year":"2019","journal-title":"Sci. Rep."},{"key":"mlstad95dbbib23","doi-asserted-by":"publisher","DOI":"10.1016\/j.ultramic.2020.113068","article-title":"Automated detection of helium bubbles in irradiated X-750","volume":"217","author":"Anderson","year":"2020","journal-title":"Ultramicroscopy"},{"key":"mlstad95dbbib24","doi-asserted-by":"publisher","first-page":"731","DOI":"10.1021\/acs.jpca.9b08723","article-title":"Performance and cost assessment of machine learning interatomic potentials","volume":"124","author":"Zuo","year":"2020","journal-title":"J. Phys. Chem. A"},{"key":"mlstad95dbbib25","doi-asserted-by":"publisher","first-page":"10037","DOI":"10.1021\/acs.chemrev.0c00868","article-title":"Four generations of high-dimensional neural network potentials","volume":"121","author":"Behler","year":"2021","journal-title":"Chem. Rev."},{"key":"mlstad95dbbib26","doi-asserted-by":"publisher","first-page":"10073","DOI":"10.1021\/acs.chemrev.1c00022","article-title":"Gaussian process regression for materials and molecules","volume":"121","author":"Deringer","year":"2021","journal-title":"Chem. Rev."},{"key":"mlstad95dbbib27","doi-asserted-by":"publisher","DOI":"10.1016\/j.actamat.2021.116980","article-title":"Machine-learning interatomic potentials for materials science","volume":"214","author":"Mishin","year":"2021","journal-title":"Acta Mater."},{"key":"mlstad95dbbib28","doi-asserted-by":"publisher","first-page":"3192","DOI":"10.1039\/C6SC05720A","article-title":"ANI-1: an extensible neural network potential with DFT accuracy at force field computational cost","volume":"8","author":"Smith","year":"2017","journal-title":"Chem. Sci."},{"key":"mlstad95dbbib29","doi-asserted-by":"publisher","first-page":"1031","DOI":"10.1038\/s42256-023-00716-3","article-title":"CHGNet: pretrained universal neural network potential for charge-informed atomistic modeling","volume":"5","author":"Deng","year":"2023","journal-title":"Nat. Mach. Intell."},{"key":"mlstad95dbbib30","doi-asserted-by":"publisher","first-page":"718","DOI":"10.1038\/s43588-022-00349-3","article-title":"A universal graph deep learning interatomic potential for the periodic table","volume":"2","author":"Chen","year":"2022","journal-title":"Nat. Comput. Sci."},{"key":"mlstad95dbbib31","doi-asserted-by":"publisher","first-page":"80","DOI":"10.1038\/s41586-023-06735-9","article-title":"Scaling deep learning for materials discovery","volume":"624","author":"Merchant","year":"2023","journal-title":"Nature"},{"key":"mlstad95dbbib32","doi-asserted-by":"publisher","first-page":"9436","DOI":"10.1021\/acs.chemmater.7b03500","article-title":"Materials synthesis insights from scientific literature via text extraction and machine learning","volume":"29","author":"Kim","year":"2017","journal-title":"Chem. Mater."},{"key":"mlstad95dbbib33","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1038\/s41524-019-0204-1","article-title":"Semi-supervised machine-learning classification of materials synthesis procedures","volume":"5","author":"Huo","year":"2019","journal-title":"npj Comput. Mater."},{"key":"mlstad95dbbib34","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1038\/s41586-019-1335-8","article-title":"Unsupervised word embeddings capture latent knowledge from materials science literature","volume":"571","author":"Tshitoyan","year":"2019","journal-title":"Nature"},{"key":"mlstad95dbbib35","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1063\/5.0021106","article-title":"Data-driven materials research enabled by natural language processing and information extraction","volume":"7","author":"Olivetti","year":"2020","journal-title":"Appl. Phys. Rev."},{"key":"mlstad95dbbib36","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.isci.2021.102155","article-title":"Opportunities and challenges of text mining in materials research","volume":"24","author":"Kononova","year":"2021","journal-title":"iScience"},{"key":"mlstad95dbbib37","article-title":"Extracting accurate materials data from research papers with conversational language models and prompt engineering","author":"Polak","year":"2023"},{"key":"mlstad95dbbib38","doi-asserted-by":"publisher","first-page":"328","DOI":"10.1039\/D3DD00202K","article-title":"Harnessing GPT-3.5 for text parsing in solid-state synthesis\u2014case study of ternary chalcogenides","volume":"3","author":"Thway","year":"2024","journal-title":"Digit. Discovery"},{"key":"mlstad95dbbib39","doi-asserted-by":"publisher","DOI":"10.1016\/j.mattod.2024.08.028","article-title":"A prompt-engineered large language model, deep learning workflow for materials classification","author":"Liu","year":"2024","journal-title":"Mater. Today"},{"key":"mlstad95dbbib40","article-title":"Towards development of automated knowledge maps and databases for materials engineering using large language models","author":"Prasad","year":"2024"},{"key":"mlstad95dbbib41","article-title":"Crystal diffusion variational autoencoder for periodic material generation","author":"Xie","year":"2021"},{"key":"mlstad95dbbib42","doi-asserted-by":"publisher","first-page":"6630","DOI":"10.1021\/acs.jpclett.3c01260","article-title":"Inverse design of next-generation superconductors using data-driven deep generative models","volume":"14","author":"Wines","year":"2023","journal-title":"J. Phys. Chem. Lett."},{"key":"mlstad95dbbib43","article-title":"MatterGen: a generative model for inorganic materials design","author":"Zeni","year":"2023"},{"key":"mlstad95dbbib44","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1039\/D3DD00137G","article-title":"Generative adversarial networks and diffusion models in material discovery","volume":"3","author":"Alverson","year":"2024","journal-title":"Digit. Discovery"},{"key":"mlstad95dbbib45","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1063\/5.0076324","article-title":"Toward autonomous materials research: recent progress and future challenges","volume":"9","author":"Montoya","year":"2022","journal-title":"Appl. Phys. Rev."},{"key":"mlstad95dbbib46","doi-asserted-by":"publisher","DOI":"10.1016\/j.pmatsci.2022.101043","article-title":"Toward autonomous laboratories: convergence of artificial intelligence and experimental automation","volume":"132","author":"Xie","year":"2023","journal-title":"Prog. Mater. Sci."},{"key":"mlstad95dbbib47","doi-asserted-by":"publisher","first-page":"2169","DOI":"10.1039\/d1mh00495f","article-title":"Toward autonomous design and synthesis of novel inorganic materials","volume":"8","author":"Szymanski","year":"2021","journal-title":"Mater. Horiz."},{"key":"mlstad95dbbib48","doi-asserted-by":"publisher","first-page":"2702","DOI":"10.1016\/j.matt.2021.06.036","article-title":"Autonomous experimentation systems for materials development: a community perspective","volume":"4","author":"Stach","year":"2021","journal-title":"Matter"},{"key":"mlstad95dbbib49","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1038\/s41578-018-0005-z","article-title":"Accelerating the discovery of materials for clean energy in the era of smart automation","volume":"3","author":"Tabor","year":"2018","journal-title":"Nat. Rev. Mater."},{"key":"mlstad95dbbib50","doi-asserted-by":"publisher","first-page":"722","DOI":"10.1038\/s41563-021-01156-3","article-title":"Flexible automation accelerates materials discovery","volume":"21","author":"MacLeod","year":"2022","journal-title":"Nat. Mater."},{"key":"mlstad95dbbib51","doi-asserted-by":"publisher","first-page":"483","DOI":"10.1038\/s44160-022-00231-0","article-title":"The rise of self-driving labs in chemical and materials sciences","volume":"2","author":"Abolhasani","year":"2023","journal-title":"Nat. Synth."},{"key":"mlstad95dbbib52","doi-asserted-by":"publisher","first-page":"563","DOI":"10.1038\/s41578-023-00588-4","article-title":"Autonomous experiments using active learning and AI","volume":"8","author":"Ren","year":"2023","journal-title":"Nat. Rev. Mater."},{"key":"mlstad95dbbib53","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1038\/s41524-021-00545-1","article-title":"Compositionally restricted attention-based network for materials property predictions","volume":"7","author":"Wang","year":"2021","journal-title":"npj Comput. Mater."},{"key":"mlstad95dbbib54","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1038\/s41524-020-00440-1","article-title":"The joint automated repository for various integrated simulations (JARVIS) for data-driven materials design","volume":"6","author":"Choudhary","year":"2020","journal-title":"npj Comput. Mater."},{"key":"mlstad95dbbib55","doi-asserted-by":"publisher","first-page":"866","DOI":"10.1038\/s41560-022-01098-3","article-title":"A combined ionic lewis acid descriptor and machine-learning approach to prediction of efficient oxygen reduction electrodes for ceramic fuel cells","volume":"7","author":"Zhai","year":"2022","journal-title":"Nat. Energy"},{"key":"mlstad95dbbib56","article-title":"Discovery of stable surfaces with extreme work functions by high-throughput density functional theory and machine learning","author":"Schindler","year":"2020"},{"key":"mlstad95dbbib57","doi-asserted-by":"publisher","DOI":"10.1002\/aenm.202303684","article-title":"Machine learning design of perovskite catalytic properties","volume":"14","author":"Jacobs","year":"2024","journal-title":"Adv. Energy Mater."},{"key":"mlstad95dbbib58","doi-asserted-by":"publisher","first-page":"3405","DOI":"10.1038\/s41467-018-05761-w","article-title":"Accelerated discovery of stable lead-free hybrid organic-inorganic perovskites via machine learning","volume":"9","author":"Lu","year":"2018","journal-title":"Nat. Commun."},{"key":"mlstad95dbbib59"},{"key":"mlstad95dbbib60","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1038\/s41524-024-01259-w","article-title":"JARVIS-leaderboard: a large scale benchmark of materials design methods","volume":"10","author":"Choudhary","year":"2024","journal-title":"npj Comput. Mater."},{"key":"mlstad95dbbib61","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41467-020-19597-w","article-title":"On-the-fly closed-loop materials discovery via bayesian active learning","volume":"11","author":"Kusne","year":"2020","journal-title":"Nat. Commun."},{"key":"mlstad95dbbib62","doi-asserted-by":"publisher","first-page":"5854","DOI":"10.1021\/acs.chemmater.0c01894","article-title":"Active learning accelerated discovery of stable iridium oxide polymorphs for the oxygen evolution reaction","volume":"32","author":"Flores","year":"2020","journal-title":"Chem. Mater."},{"key":"mlstad95dbbib63","doi-asserted-by":"publisher","first-page":"8517","DOI":"10.1039\/d0sc01101k","article-title":"Autonomous intelligent agents for accelerated materials discovery","volume":"11","author":"Montoya","year":"2020","journal-title":"Chem. Sci."},{"key":"mlstad95dbbib64","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41597-022-01438-8","article-title":"Novel inorganic crystal structures predicted using autonomous simulation agents","volume":"9","author":"Ye","year":"2022","journal-title":"Sci. Data"},{"key":"mlstad95dbbib65","doi-asserted-by":"publisher","DOI":"10.1016\/j.actamat.2021.117431","article-title":"A machine learning-based alloy design system to facilitate the rational design of high entropy alloys with enhanced hardness","volume":"222","author":"Yang","year":"2022","journal-title":"Acta Mater."},{"key":"mlstad95dbbib66","doi-asserted-by":"publisher","DOI":"10.1088\/2632-2153\/ad1627","article-title":"Role of multifidelity data in sequential active learning materials discovery campaigns: case study of electronic bandgap","volume":"4","author":"Jacobs","year":"2023","journal-title":"Mach. Learn. Sci. Technol."},{"key":"mlstad95dbbib67","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-022-08413-8","article-title":"Agents for sequential learning using multiple\u2014fidelity data","volume":"12","author":"Palizhati","year":"2022","journal-title":"Sci. Rep."},{"key":"mlstad95dbbib68","doi-asserted-by":"publisher","first-page":"327","DOI":"10.1039\/d2dd00113f","article-title":"Quantifying the performance of machine learning models in materials discovery","volume":"2","author":"Borg","year":"2023","journal-title":"Digit. Discovery"},{"key":"mlstad95dbbib69","doi-asserted-by":"crossref","first-page":"999","DOI":"10.1039\/D3DD00244F","article-title":"A multiobjective closed-loop approach towards autonomous discovery of electrocatalysts for nitrogen reduction","volume":"3","author":"Kavalsky","year":"2024","journal-title":"Digit. Discovery"},{"key":"mlstad95dbbib70","doi-asserted-by":"publisher","first-page":"207","DOI":"10.1007\/s40192-017-0098-z","article-title":"High-dimensional materials and process optimization using data-driven experimental design with well-calibrated uncertainty estimates","volume":"6","author":"Ling","year":"2017","journal-title":"Integr. Mater. Manuf. Innov."},{"key":"mlstad95dbbib71","doi-asserted-by":"publisher","first-page":"906","DOI":"10.1021\/acs.jctc.8b00959","article-title":"Fast and accurate uncertainty estimation in chemical machine learning","volume":"15","author":"Musil","year":"2019","journal-title":"J. Chem. Theory Comput."},{"key":"mlstad95dbbib72","doi-asserted-by":"publisher","DOI":"10.1088\/2632-2153\/ab7e1a","article-title":"Methods for comparing uncertainty quantifications for material property predictions","volume":"1","author":"Tran","year":"2020","journal-title":"Mach. Learn. Sci. Technol."},{"key":"mlstad95dbbib73","doi-asserted-by":"publisher","DOI":"10.1088\/2632-2153\/ac3eb3","article-title":"Calibrated uncertainty for molecular property prediction using ensembles of message passing neural networks","volume":"3","author":"Busk","year":"2022","journal-title":"Mach. Learn. Sci. Technol."},{"key":"mlstad95dbbib74","doi-asserted-by":"publisher","first-page":"7913","DOI":"10.1039\/c9sc02298h","article-title":"A quantitative uncertainty metric controls error in neural network-driven chemical discovery","volume":"10","author":"Janet","year":"2019","journal-title":"Chem. Sci."},{"key":"mlstad95dbbib75","doi-asserted-by":"publisher","first-page":"3770","DOI":"10.1021\/acs.jcim.0c00502","article-title":"Uncertainty quantification using neural networks for molecular property prediction","volume":"60","author":"Hirschfeld","year":"2020","journal-title":"J. Chem. Inf. Model."},{"key":"mlstad95dbbib76","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41524-022-00794-8","article-title":"Calibration after bootstrap for accurate uncertainty quantification in regression models","volume":"8","author":"Palmer","year":"2022","journal-title":"npj Comput. Mater."},{"key":"mlstad95dbbib77","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1021\/acs.jcim.8b00597","article-title":"Molecular similarity-based domain applicability metric efficiently identifies out-of-domain compounds","volume":"59","author":"Liu","year":"2019","journal-title":"J. Chem. Inf. Model."},{"key":"mlstad95dbbib78","doi-asserted-by":"publisher","first-page":"4428","DOI":"10.1038\/s41467-020-17112-9","article-title":"Identifying domains of applicability of machine learning models for materials science","volume":"11","author":"Sutton","year":"2020","journal-title":"Nat. Commun."},{"key":"mlstad95dbbib79","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-022-19205-5","article-title":"A universal similarity based approach for predictive uncertainty quantification in materials science","volume":"12","author":"Korolev","year":"2022","journal-title":"Sci. Rep."},{"key":"mlstad95dbbib80","doi-asserted-by":"publisher","first-page":"7350","DOI":"10.1021\/acs.jcim.3c01684","article-title":"Identification of high-reliability regions of machine learning predictions based on materials chemistry","volume":"63","author":"Askenazi","year":"2023","journal-title":"J. Chem. Inf. Model."},{"key":"mlstad95dbbib81","doi-asserted-by":"crossref","DOI":"10.26434\/chemrxiv-2023-pmrfw-v2","article-title":"Outlier-based domain of applicability identification for materials property prediction models","author":"Panapitiya","year":"2023"},{"key":"mlstad95dbbib82","article-title":"Probing out-of-distribution generalization in machine learning for materials","author":"Li","year":"2024"},{"key":"mlstad95dbbib83","article-title":"Determining domain of machine learning models using kernel density estimates: applications in materials property prediction","author":"Schultz","year":"2024"},{"key":"mlstad95dbbib84","doi-asserted-by":"publisher","first-page":"5467","DOI":"10.21105\/joss.05467","article-title":"Foundry-ML\u2014software and services to simplify access to machine learning datasets in materials science","volume":"9","author":"Schmidt","year":"2024","journal-title":"J. Open Source Softw."},{"key":"mlstad95dbbib85","doi-asserted-by":"publisher","first-page":"676","DOI":"10.1557\/mrs.2018.208","article-title":"NOMAD: the FAIR concept for big data-driven materials science","volume":"43","author":"Draxl","year":"2018","journal-title":"MRS Bull."},{"key":"mlstad95dbbib86","doi-asserted-by":"publisher","first-page":"2045","DOI":"10.1007\/s11837-016-2001-3","article-title":"The materials data facility: data services to advance materials science research","volume":"68","author":"Blaiszik","year":"2016","journal-title":"JOM"},{"key":"mlstad95dbbib87","doi-asserted-by":"publisher","DOI":"10.1016\/j.commatsci.2020.109544","article-title":"The materials simulation toolkit for machine learning (MAST-ML): an automated open source toolkit to accelerate data-driven materials research","volume":"176","author":"Jacobs","year":"2020","journal-title":"Comput. Mater. Sci."},{"key":"mlstad95dbbib88","author":"Blaiszik"},{"key":"mlstad95dbbib89","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1145\/3369583.3392683","article-title":"FuncX: a federated function serving fabric for science","author":"Chard","year":"2020"},{"key":"mlstad95dbbib90","doi-asserted-by":"publisher","first-page":"1668","DOI":"10.1021\/acs.jpclett.8b00124","article-title":"Predicting the band gaps of inorganic solids by machine learning","volume":"9","author":"Zhuo","year":"2018","journal-title":"J. Phys. Chem. Lett."},{"key":"mlstad95dbbib91","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1038\/s41524-022-00810-x","article-title":"Machine learning in concrete science: applications, challenges, and best practices","volume":"8","author":"Li","year":"2022","journal-title":"npj Comput. Mater."},{"key":"mlstad95dbbib92","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1007\/s40192-020-00174-4","article-title":"Benchmark AFLOW data sets for machine learning","volume":"9","author":"Clement","year":"2020","journal-title":"Integr. Mater. Manuf. Innov."},{"key":"mlstad95dbbib93","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2016.134","article-title":"High-throughput screening of inorganic compounds for the discovery of novel dielectric and optical materials","volume":"4","author":"Petousis","year":"2017","journal-title":"Sci. Data"},{"key":"mlstad95dbbib94","doi-asserted-by":"publisher","DOI":"10.1088\/1367-2630\/16\/1\/015018","article-title":"Elemental vacancy diffusion database from high-throughput first-principles calculations for Fcc and Hcp structures","volume":"16","author":"Angsten","year":"2014","journal-title":"New J. Phys."},{"key":"mlstad95dbbib95","doi-asserted-by":"publisher","DOI":"10.1038\/srep19375","article-title":"Machine learning bandgaps of double perovskites","volume":"6","author":"Pilania","year":"2016","journal-title":"Sci. Rep."},{"key":"mlstad95dbbib96","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2015.9","article-title":"Charting the complete elastic properties of inorganic crystalline compounds","volume":"2","author":"de Jong","year":"2015","journal-title":"Sci. Data"},{"key":"mlstad95dbbib97","author":"Borg"},{"key":"mlstad95dbbib98","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1038\/s41524-022-00951-z","article-title":"A database of experimentally measured lithium solid electrolyte conductivities evaluated with machine learning","volume":"9","author":"Hargreaves","year":"2023","journal-title":"npj Comput. Mater."},{"key":"mlstad95dbbib99","doi-asserted-by":"publisher","DOI":"10.18126\/7yg1-osf2","article-title":"Metallic glasses and their properties","author":"Voyles","year":"2021"},{"key":"mlstad95dbbib100","doi-asserted-by":"publisher","first-page":"1569","DOI":"10.1038\/s41467-024-45914-8","article-title":"Extracting accurate materials data from research papers with conversational language models and prompt engineering","volume":"15","author":"Polak","year":"2024","journal-title":"Nat. Commun."},{"key":"mlstad95dbbib101","doi-asserted-by":"publisher","first-page":"2945","DOI":"10.1021\/acs.chemmater.1c03542","article-title":"Machine learning prediction of the critical cooling rate for metallic glasses from expanded datasets and elemental features","volume":"34","author":"Afflerbach","year":"2022","journal-title":"Chem. Mater."},{"key":"mlstad95dbbib102","doi-asserted-by":"publisher","DOI":"10.1016\/j.matlet.2023.134605","article-title":"Prediction of mechanical properties of biomedical magnesium alloys based on ensemble machine learning","volume":"348","author":"Hou","year":"2023","journal-title":"Mater. Lett."},{"key":"mlstad95dbbib103","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2017.153","article-title":"High-throughput DFT calculations of formation energy, stability and oxygen vacancy formation energy of ABO3 perovskites","volume":"4","author":"Emery","year":"2017","journal-title":"Sci. Data"},{"key":"mlstad95dbbib104","doi-asserted-by":"publisher","first-page":"3366","DOI":"10.1021\/acsaem.4c00125","article-title":"Critical assessment of electronic structure descriptors for predicting perovskite catalytic properties","volume":"7","author":"Jacobs","year":"2024","journal-title":"ACS Appl. Energy Mater."},{"key":"mlstad95dbbib105","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1038\/s41524-021-00551-3","article-title":"Accelerated design and discovery of perovskites with high conductivity for energy applications through machine learning","volume":"7","author":"Priya","year":"2021","journal-title":"npj Comput. Mater."},{"key":"mlstad95dbbib106","doi-asserted-by":"publisher","first-page":"5814","DOI":"10.1039\/C1EE02717D","article-title":"Computational screening of perovskite metal oxides for optimal solar light capture","volume":"5","author":"Castelli","year":"2012","journal-title":"Energy Environ. Sci."},{"key":"mlstad95dbbib107","doi-asserted-by":"publisher","DOI":"10.1002\/adfm.202309855","article-title":"Machine\u2010learning assisted screening proton conducting Co\/Fe Based oxide for the air electrode of protonic solid oxide cell","volume":"34","author":"Wang","year":"2023","journal-title":"Adv. Funct. Mater."},{"key":"mlstad95dbbib108","doi-asserted-by":"publisher","first-page":"12778","DOI":"10.1039\/D1TC01286J","article-title":"Discovery and engineering of low work function perovskite materials","volume":"9","author":"Ma","year":"2021","journal-title":"J. Mater. Chem. C"},{"key":"mlstad95dbbib109","doi-asserted-by":"publisher","first-page":"32123","DOI":"10.1039\/D3CP04017H","article-title":"Machine-learning prediction of thermal expansion coefficient for perovskite oxides with experimental validation","volume":"25","author":"McGuinness","year":"2023","journal-title":"Phys. Chem. Chem. Phys."},{"key":"mlstad95dbbib110","doi-asserted-by":"publisher","first-page":"6880","DOI":"10.1039\/D0CP05595F","article-title":"Data-driven analysis of the electronic-structure factors controlling the work functions of perovskite oxides","volume":"23","author":"Xiong","year":"2021","journal-title":"Phys. Chem. Chem. Phys."},{"key":"mlstad95dbbib111","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2018.65","article-title":"High-throughput density-functional perturbation theory phonons for inorganic materials","volume":"5","author":"Petretto","year":"2018","journal-title":"Sci. Data"},{"key":"mlstad95dbbib112","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2015.53","article-title":"A database to enable discovery and design of piezoelectric materials","volume":"2","author":"de Jong","year":"2015","journal-title":"Sci. Data"},{"key":"mlstad95dbbib113","doi-asserted-by":"publisher","DOI":"10.1016\/j.matdes.2023.112491","article-title":"Predictions and uncertainty estimates of reactor pressure vessel steel embrittlement using machine learning","volume":"236","author":"Jacobs","year":"2023","journal-title":"Mater. Des."},{"key":"mlstad95dbbib114","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1063\/5.0083877","article-title":"Machine learning for impurity charge-state transition levels in semiconductors from elemental properties using multi-fidelity datasets","volume":"156","author":"Polak","year":"2022","journal-title":"J. Chem. Phys."},{"key":"mlstad95dbbib115","author":"Bajaj"},{"key":"mlstad95dbbib116","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1038\/s41524-018-0085-8","article-title":"Machine learning modeling of superconducting critical temperature","volume":"4","author":"Stanev","year":"2018","journal-title":"npj Comput. Mater."},{"key":"mlstad95dbbib117","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1016\/j.commatsci.2017.03.052","article-title":"Robust FCC solute diffusion predictions from ab-initio machine learning methods","volume":"134","author":"Wu","year":"2017","journal-title":"Comput. Mater. Sci."},{"key":"mlstad95dbbib118","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1016\/j.commatsci.2018.05.018","article-title":"Matminer\u202f: an open source toolkit for materials data mining","volume":"152","author":"Ward","year":"2018","journal-title":"Comput. Mater. Sci."},{"key":"mlstad95dbbib119","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1007\/s40192-020-00179-z","article-title":"Is domain knowledge necessary for machine learning materials properties?","volume":"9","author":"Murdock","year":"2020","journal-title":"Integr. Mater. Manuf. Innov."},{"key":"mlstad95dbbib120","doi-asserted-by":"publisher","first-page":"3564","DOI":"10.1021\/acs.chemmater.9b01294","article-title":"Graph networks as a universal machine learning framework for molecules and crystals","volume":"31","author":"Chen","year":"2019","journal-title":"Chem. Mater."},{"key":"mlstad95dbbib121","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1038\/s41524-021-00650-1","article-title":"Atomistic line graph neural network for improved materials property predictions","volume":"7","author":"Choudhary","year":"2021","journal-title":"npj Comput. Mater."},{"key":"mlstad95dbbib122","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-018-35934-y","article-title":"ElemNet\u202f: deep learning the chemistry of materials from only elemental composition","volume":"8","author":"Jha","year":"2018","journal-title":"Sci. Rep."},{"key":"mlstad95dbbib123","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1063\/5.0174943","article-title":"Calibration in machine learning uncertainty quantification: beyond consistency to target adaptivity","volume":"1","author":"Pernot","year":"2023","journal-title":"APL Mach. Learn."},{"key":"mlstad95dbbib124","article-title":"Validation of uncertainty quantification metrics: a primer based on the consistency and adaptivity concepts","author":"Pernot","year":"2023"},{"key":"mlstad95dbbib125","article-title":"How to validate average calibration for machine learning regression tasks?","author":"Pernot","year":"2024"},{"key":"mlstad95dbbib126","doi-asserted-by":"publisher","DOI":"10.1016\/j.commatsci.2019.06.010","article-title":"Error assessment and optimal cross-validation approaches in machine learning applied to impurity diffusion","volume":"169","author":"Lu","year":"2019","journal-title":"Comput. Mater. Sci."},{"key":"mlstad95dbbib127","doi-asserted-by":"publisher","DOI":"10.1016\/j.commatsci.2021.110494","article-title":"Exploration of characteristic temperature contributions to metallic glass forming ability","volume":"196","author":"Schultz","year":"2021","journal-title":"Comput. Mater. Sci."},{"key":"mlstad95dbbib128","doi-asserted-by":"publisher","first-page":"454","DOI":"10.1016\/j.commatsci.2018.04.033","article-title":"Predicting the thermodynamic stability of perovskite oxides using machine learning models","volume":"150","author":"Li","year":"2018","journal-title":"Comput. Mater. Sci."},{"key":"mlstad95dbbib129","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1039\/c6ee01915c","article-title":"Zr and Y co-doped perovskite as a stable, high performance cathode for solid oxide fuel cells operating below 500 \u00b0C","volume":"10","author":"Duan","year":"2017","journal-title":"Energy Environ. Sci."},{"key":"mlstad95dbbib130","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1002\/aenm.201702708","article-title":"Material discovery and design principles for stable, high activity perovskite cathodes for solid oxide fuel cells","volume":"8","author":"Jacobs","year":"2018","journal-title":"Adv. Energy Mater."},{"key":"mlstad95dbbib131","doi-asserted-by":"publisher","DOI":"10.1002\/aenm.202201203","article-title":"Unconventional highly active and stable oxygen reduction catalysts informed by computational design strategies","volume":"12","author":"Jacobs","year":"2022","journal-title":"Adv. Energy Mater."},{"key":"mlstad95dbbib132","doi-asserted-by":"publisher","first-page":"274","DOI":"10.29317\/ejpfm.2018020309","article-title":"A brief review of conductivity and thermal expansion of perovskite-related oxides for SOFC cathode","volume":"2","author":"Nikonov","year":"2018","journal-title":"Eurasian J. Phys. Funct. Mater."},{"key":"mlstad95dbbib133","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1016\/S0167-2738(00)00770-0","article-title":"Correlation between thermal expansion and oxide ion transport in mixed conducting perovskite-type oxides for SOFC cathodes","volume":"138","author":"Ullmann","year":"2000","journal-title":"Solid State Ion."},{"key":"mlstad95dbbib134","doi-asserted-by":"publisher","first-page":"2196","DOI":"10.1039\/D1TA08475E","article-title":"Recent advances, practical challenges, and perspectives of intermediate temperature solid oxide fuel cell cathodes","volume":"10","author":"Ndubuisi","year":"2022","journal-title":"J. Mater. Chem. A"},{"key":"mlstad95dbbib135","doi-asserted-by":"publisher","first-page":"3413","DOI":"10.1039\/C9TA12208G","article-title":"From theory to experiment: baFe0.125Co0.125Zr0.75O3-\u03b4, a highly promising cathode for intermediate temperature SOFCs","volume":"8","author":"Sanchez-Ahijon","year":"2020","journal-title":"J. Mater. Chem. A"},{"key":"mlstad95dbbib136","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1016\/j.ssi.2004.08.021","article-title":"Thermal expansion coefficient of yttria stabilized zirconia for various yttria contents","volume":"176","author":"Hayashi","year":"2005","journal-title":"Solid State Ion."},{"key":"mlstad95dbbib137","doi-asserted-by":"publisher","first-page":"1463","DOI":"10.1016\/j.jeurceramsoc.2008.08.029","article-title":"Thermal expansion behaviour of Sr- and Mg-doped LaGaO3 solid electrolyte","volume":"29","author":"Datta","year":"2009","journal-title":"J. Eur. Ceram. Soc."},{"key":"mlstad95dbbib138","doi-asserted-by":"publisher","first-page":"227","DOI":"10.1016\/S0167-2738(00)00646-9","article-title":"Thermal expansion of Gd-doped ceria and reduced ceria","volume":"132","author":"Hayashi","year":"2000","journal-title":"Solid State Ion."},{"key":"mlstad95dbbib139","doi-asserted-by":"publisher","first-page":"1125","DOI":"10.1557\/mrc.2019.118","article-title":"A data ecosystem to support machine learning in materials science","volume":"9","author":"Blaiszik","year":"2019","journal-title":"MRS Commun."},{"key":"mlstad95dbbib140","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3219104.3219127","article-title":"Globus platform services for data publication","author":"Ananthakrishnan","year":"2018"}],"container-title":["Machine Learning: Science and Technology"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad95db","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad95db\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad95db\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad95db\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,2]],"date-time":"2024-12-02T02:24:12Z","timestamp":1733106252000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad95db"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,1]]},"references-count":140,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2024,12,2]]},"published-print":{"date-parts":[[2024,12,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2632-2153\/ad95db","relation":{},"ISSN":["2632-2153"],"issn-type":[{"value":"2632-2153","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,1]]},"assertion":[{"value":"Machine learning materials properties with accurate predictions, uncertainty estimates, domain guidance, and persistent online accessibility","name":"article_title","label":"Article Title"},{"value":"Machine Learning: Science and Technology","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2024 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2024-09-20","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-11-21","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-12-02","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}