{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T23:59:00Z","timestamp":1740182340350,"version":"3.37.3"},"reference-count":55,"publisher":"IOP Publishing","issue":"1","license":[{"start":{"date-parts":[[2024,2,20]],"date-time":"2024-02-20T00:00:00Z","timestamp":1708387200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,2,20]],"date-time":"2024-02-20T00:00:00Z","timestamp":1708387200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"DOI":"10.13039\/100006168","name":"National Nuclear Security Administration","doi-asserted-by":"crossref","award":["DE-NA0003856"],"award-info":[{"award-number":["DE-NA0003856"]}],"id":[{"id":"10.13039\/100006168","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["Mach. Learn.: Sci. Technol."],"published-print":{"date-parts":[[2024,3,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>In this paper, we aim to explore novel machine learning (ML) techniques to facilitate and accelerate the construction of universal equation-Of-State (EOS) models with a high accuracy while ensuring important thermodynamic consistency. When applying ML to fit a universal EOS model, there are two key requirements: (1) a high prediction accuracy to ensure precise estimation of relevant physics properties and (2) physical interpretability to support important physics-related downstream applications. We first identify a set of fundamental challenges from the accuracy perspective, including an extremely wide range of input\/output space and highly sparse training data. We demonstrate that while a neural network (NN) model may fit the EOS data well, the black-box nature makes it difficult to provide physically interpretable results, leading to weak accountability of prediction results outside the training range and lack of guarantee to meet important thermodynamic consistency constraints. To this end, we propose a principled deep regression model that can be trained following a meta-learning style to predict the desired quantities with a high accuracy using scarce training data. We further introduce a uniquely designed kernel-based regularizer for accurate uncertainty quantification. An ensemble technique is leveraged to battle model overfitting with improved prediction stability. Auto-differentiation is conducted to verify that necessary thermodynamic consistency conditions are maintained. Our evaluation results show an excellent fit of the EOS table and the predicted values are ready to use for important physics-related tasks.<\/jats:p>","DOI":"10.1088\/2632-2153\/ad2626","type":"journal-article","created":{"date-parts":[[2024,2,5]],"date-time":"2024-02-05T22:22:30Z","timestamp":1707171750000},"page":"015031","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Deep energy-pressure regression for a thermodynamically consistent EOS model"],"prefix":"10.1088","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-2373-4907","authenticated-orcid":true,"given":"Dayou","family":"Yu","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0009-0006-1404-3716","authenticated-orcid":true,"given":"Deep","family":"Shankar Pandey","sequence":"additional","affiliation":[]},{"given":"Joshua","family":"Hinz","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8874-5503","authenticated-orcid":true,"given":"Deyan","family":"Mihaylov","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3445-6797","authenticated-orcid":true,"given":"Valentin V","family":"Karasiev","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2465-3818","authenticated-orcid":true,"given":"S X","family":"Hu","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0426-5407","authenticated-orcid":true,"given":"Qi","family":"Yu","sequence":"additional","affiliation":[]}],"member":"266","published-online":{"date-parts":[[2024,2,20]]},"reference":[{"key":"mlstad2626bib1","doi-asserted-by":"publisher","first-page":"251","DOI":"10.1038\/s41567-021-01485-9","article-title":"Design of inertial fusion implosions reaching the burning plasma regime","volume":"18","author":"Kritcher","year":"2022","journal-title":"Nat. Phys."},{"key":"mlstad2626bib2","doi-asserted-by":"publisher","DOI":"10.1063\/1.5108667","article-title":"Making inertial confinement fusion models more predictive","volume":"26","author":"Gaffney","year":"2019","journal-title":"Phys. Plasmas"},{"key":"mlstad2626bib3","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.121.025001","article-title":"Absolute equation-of-state measurement for polystyrene from 25 to 60 mbar using a spherically converging shock wave","volume":"121","author":"D\u00f6ppner","year":"2018","journal-title":"Phys. Rev. Lett."},{"key":"mlstad2626bib4","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.122.255702","article-title":"Shock compression of liquid deuterium up to 1 TPa","volume":"122","author":"Fernandez-Pa\u00f1ella","year":"2019","journal-title":"Phys. Rev. Lett."},{"key":"mlstad2626bib5","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1038\/s41586-020-2535-y","article-title":"A measurement of the equation of state of carbon envelopes of white dwarfs","volume":"584","author":"Kritcher","year":"2020","journal-title":"Nature"},{"key":"mlstad2626bib6","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1016\/j.hedp.2018.08.001","article-title":"A review of equation-of-state models for inertial confinement fusion materials","volume":"28","author":"Gaffney","year":"2018","journal-title":"High Energy Density Phys."},{"key":"mlstad2626bib7","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevB.104.144104","article-title":"Improved first-principles equation-of-state table of deuterium for high-energy-density applications","volume":"104","author":"Mihaylov","year":"2021","journal-title":"Phys. Rev. B"},{"key":"mlstad2626bib8","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevB.84.224109","article-title":"First-principles equation-of-state table of deuterium for inertial confinement fusion applications","volume":"84","author":"Hu","year":"2011","journal-title":"Phys. Rev. B"},{"key":"mlstad2626bib9","doi-asserted-by":"publisher","DOI":"10.1063\/1.4917477","article-title":"Impact of first-principles properties of deuterium\u2013tritium on inertial confinement fusion target designs","volume":"22","author":"Hu","year":"2015","journal-title":"Phys. Plasmas"},{"key":"mlstad2626bib10","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevB.105.L081109","article-title":"Meta-GGA exchange-correlation free energy density functional to increase the accuracy of warm dense matter simulations","volume":"105","author":"Karasiev","year":"2022","journal-title":"Phys. Rev. B"},{"year":"2003","author":"Irwin Kerley","key":"mlstad2626bib11","doi-asserted-by":"publisher","DOI":"10.2172\/917468"},{"article-title":"The sesame 5267 equation of state of deuterium","year":"2013","author":"Saumon","key":"mlstad2626bib12"},{"key":"mlstad2626bib13","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.93.043210","article-title":"equation of state of warm dense deuterium and its isotopes from density-functional theory molecular dynamics","volume":"93","author":"Danel","year":"2016","journal-title":"Phys. Rev. E"},{"key":"mlstad2626bib14","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1088\/0067-0049\/215\/2\/21","article-title":"Ab initio equations of state for hydrogen (H-REOS.3) and helium (H-REOS.3) and their implications for the interior of brown dwarfs","volume":"215","author":"Becker","year":"2014","journal-title":"Astrophys. J. Suppl. Ser."},{"key":"mlstad2626bib15","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevB.83.094101","article-title":"Multiphase equation of state of hydrogen from ab initio calculations in the range 0.2 to 5 g\/cc up to 10 eV","volume":"83","author":"Caillabet","year":"2011","journal-title":"Phys. Rev. B"},{"key":"mlstad2626bib16","doi-asserted-by":"publisher","DOI":"10.1063\/1.5053994","article-title":"Measurement of the sound speed in dense fluid deuterium along the cryogenic liquid hugoniot","volume":"26","author":"Fratanduono","year":"2019","journal-title":"Phys. Plasmas"},{"key":"mlstad2626bib17","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.118.035501","article-title":"High-precision shock wave measurements of deuterium: evaluation of exchange-correlation functionals at the molecular-to-atomic transition","volume":"118","author":"Knudson","year":"2017","journal-title":"Phys. Rev. Lett."},{"key":"mlstad2626bib18","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevB.103.134107","article-title":"High-precision equation of state benchmark for cryogenic liquid deuterium at ultrahigh pressure","volume":"103","author":"He","year":"2021","journal-title":"Phys. Rev. B"},{"key":"mlstad2626bib19","doi-asserted-by":"publisher","first-page":"422","DOI":"10.1038\/s42254-021-00314-5","article-title":"Physics-informed machine learning","volume":"3","author":"Em Karniadakis","year":"2021","journal-title":"Nat. Rev. Phys."},{"article-title":"Constraining model uncertainty in plasma equation-of-state models with a physics-constrained gaussian process","year":"2022","author":"Gaffney","key":"mlstad2626bib20"},{"key":"mlstad2626bib21","doi-asserted-by":"publisher","DOI":"10.1063\/5.0126708","article-title":"Neural network surrogate models for equations of state","volume":"30","author":"Mentzer","year":"2023","journal-title":"Phys. Plasmas"},{"key":"mlstad2626bib22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1162\/neco.1992.4.1.1","article-title":"Neural networks and the bias\/variance Dilemma","volume":"4","author":"Geman","year":"1992","journal-title":"Neural Comput."},{"key":"mlstad2626bib23","first-page":"pp 10767","article-title":"Rethinking bias-variance trade-off for generalization of neural networks","author":"Yang","year":"2020"},{"key":"mlstad2626bib24","first-page":"pp 1704","article-title":"Conditional neural processes","author":"Garnelo","year":"2018"},{"key":"mlstad2626bib25","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"key":"mlstad2626bib26","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1007\/s10462-018-09679-z","article-title":"Machine learning and deep learning frameworks and libraries for large-scale data mining: a survey","volume":"52","author":"Nguyen","year":"2019","journal-title":"Artif. Intell. Rev."},{"key":"mlstad2626bib27","doi-asserted-by":"publisher","first-page":"409","DOI":"10.1007\/s40808-018-0431-3","article-title":"Prediction of vegetation dynamics using ndvi time series data and lstm","volume":"4","author":"Sushma Reddy","year":"2018","journal-title":"Model. Earth Syst. Environ."},{"key":"mlstad2626bib28","doi-asserted-by":"publisher","first-page":"195","DOI":"10.1038\/s41586-019-0912-1","article-title":"Deep learning and process understanding for data-driven earth system science","volume":"566","author":"Reichstein","year":"2019","journal-title":"Nature"},{"key":"mlstad2626bib29","doi-asserted-by":"publisher","DOI":"10.1063\/5.0033376","article-title":"A point-cloud deep learning framework for prediction of fluid flow fields on irregular geometries","volume":"33","author":"Kashefi","year":"2021","journal-title":"Phys. Fluids"},{"key":"mlstad2626bib30","doi-asserted-by":"publisher","first-page":"686","DOI":"10.1016\/j.jcp.2018.10.045","article-title":"Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations","volume":"378","author":"Raissi","year":"2019","journal-title":"J. Comput. Phys."},{"key":"mlstad2626bib31","doi-asserted-by":"publisher","first-page":"A639","DOI":"10.1137\/19M1260141","article-title":"Learning in modal space: solving time-dependent stochastic pdes using physics-informed neural networks","volume":"42","author":"Zhang","year":"2020","journal-title":"SIAM J. Sci. Comput."},{"key":"mlstad2626bib32","doi-asserted-by":"publisher","DOI":"10.1029\/2019WR026731","article-title":"Physics-informed deep neural networks for learning parameters and constitutive relationships in subsurface flow problems","volume":"56","author":"Tartakovsky","year":"2020","journal-title":"Water Resour. Res."},{"key":"mlstad2626bib33","doi-asserted-by":"publisher","first-page":"A292","DOI":"10.1137\/18M1225409","article-title":"Physics-informed generative adversarial networks for stochastic differential equations","volume":"42","author":"Yang","year":"2020","journal-title":"SIAM J. Sci. Comput."},{"key":"mlstad2626bib34","doi-asserted-by":"publisher","first-page":"2339","DOI":"10.1038\/s41467-019-10343-5","article-title":"Physically informed artificial neural networks for atomistic modeling of materials","volume":"10","author":"Purja Pun","year":"2019","journal-title":"Nat. Commun."},{"key":"mlstad2626bib35","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/j.jcp.2019.05.024","article-title":"Physics-constrained deep learning for high-dimensional surrogate modeling and uncertainty quantification without labeled data","volume":"394","author":"Zhu","year":"2019","journal-title":"J. Comput. Phys."},{"key":"mlstad2626bib36","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.124.010508","article-title":"Discovering physical concepts with neural networks","volume":"124","author":"Iten","year":"2020","journal-title":"Phys. Rev. Lett."},{"key":"mlstad2626bib37","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevResearch.2.033429","article-title":"Ab initio solution of the many-electron Schr\u00f6dinger equation with deep neural networks","volume":"2","author":"Pfau","year":"2020","journal-title":"Phys. Rev. Res."},{"key":"mlstad2626bib38","doi-asserted-by":"publisher","first-page":"272","DOI":"10.1016\/j.neunet.2021.11.022","article-title":"Transformers for modeling physical systems","volume":"146","author":"Geneva","year":"2022","journal-title":"Neural Netw."},{"key":"mlstad2626bib39","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1109\/MSP.2017.2693418","article-title":"Geometric deep learning: going beyond euclidean data","volume":"34","author":"Bronstein","year":"2017","journal-title":"IEEE Signal Process. Mag."},{"key":"mlstad2626bib40","first-page":"pp 1321","article-title":"Gauge equivariant convolutional networks and the icosahedral cnn","author":"Cohen","year":"2019"},{"key":"mlstad2626bib41","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1038\/s42256-021-00302-5","article-title":"Learning nonlinear operators via deeponet based on the universal approximation theorem of operators","volume":"3","author":"Lu","year":"2021","journal-title":"Nat. Mach. Intell."},{"article-title":"Fourier neural operator for parametric partial differential equations","year":"2020","author":"Li","key":"mlstad2626bib42"},{"key":"mlstad2626bib43","doi-asserted-by":"publisher","first-page":"270","DOI":"10.1016\/j.jcp.2019.01.045","article-title":"Neural-net-induced gaussian process regression for function approximation and pde solution","volume":"384","author":"Pang","year":"2019","journal-title":"J. Comput. Phys."},{"key":"mlstad2626bib44","doi-asserted-by":"publisher","first-page":"385","DOI":"10.5555\/1248659.1248674","article-title":"Learning equivariant functions with matrix valued kernels","volume":"8","author":"Reisert","year":"2007","journal-title":"J. Mach. Learn. Res."},{"key":"mlstad2626bib45","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2021.113938","article-title":"On the eigenvector bias of fourier feature networks: from regression to solving multi-scale pdes with physics-informed neural networks","volume":"384","author":"Wang","year":"2021","journal-title":"Comput. Methods Appl. Mech. Eng."},{"key":"mlstad2626bib46","doi-asserted-by":"publisher","first-page":"A172","DOI":"10.1137\/17M1120762","article-title":"Numerical gaussian processes for time-dependent and nonlinear partial differential equations","volume":"40","author":"Raissi","year":"2018","journal-title":"SIAM J. Sci. Comput."},{"key":"mlstad2626bib47","doi-asserted-by":"publisher","first-page":"683","DOI":"10.1016\/j.jcp.2017.07.050","article-title":"Machine learning of linear differential equations using gaussian processes","volume":"348","author":"Raissi","year":"2017","journal-title":"J. Comput. Phys."},{"key":"mlstad2626bib48","doi-asserted-by":"publisher","first-page":"987","DOI":"10.1109\/72.712178","article-title":"Artificial neural networks for solving ordinary and partial differential equations","volume":"9","author":"Lagaris","year":"1998","journal-title":"IEEE Trans. Neural Netw."},{"volume":"vol 4","year":"2006","author":"Bishop","key":"mlstad2626bib49"},{"key":"mlstad2626bib50","first-page":"p 3","volume":"vol 10","author":"Aggarwal","year":"2018"},{"key":"mlstad2626bib51","doi-asserted-by":"publisher","first-page":"326","DOI":"10.1145\/212094.212114","article-title":"Overfitting and undercomputing in machine learning","volume":"27","author":"Dietterich","year":"1995","journal-title":"ACM Comput. Surv. (CSUR)"},{"article-title":"Deep sets","year":"2017","author":"Zaheer","key":"mlstad2626bib52"},{"key":"mlstad2626bib53","doi-asserted-by":"publisher","first-page":"p 30","DOI":"10.5555\/3295222.3295309","article-title":"What uncertainties do we need in bayesian deep learning for computer vision?","author":"Kendall","year":"2017"},{"key":"mlstad2626bib54","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevE.106.045207","article-title":"First-principles equation of state of chon resin for inertial confinement fusion applications","volume":"106","author":"Zhang","year":"2022","journal-title":"Phys. Rev. E"},{"article-title":"Automatic differentiation in pytorch","year":"2017","author":"Paszke","key":"mlstad2626bib55"}],"container-title":["Machine Learning: Science and Technology"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad2626","content-type":"text\/html","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad2626\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad2626","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad2626\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad2626\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad2626\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad2626\/pdf","content-type":"application\/pdf","content-version":"am","intended-application":"similarity-checking"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad2626\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,2,20]],"date-time":"2024-02-20T09:59:12Z","timestamp":1708423152000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.1088\/2632-2153\/ad2626"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,2,20]]},"references-count":55,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,2,20]]},"published-print":{"date-parts":[[2024,3,1]]}},"URL":"https:\/\/doi.org\/10.1088\/2632-2153\/ad2626","relation":{},"ISSN":["2632-2153"],"issn-type":[{"type":"electronic","value":"2632-2153"}],"subject":[],"published":{"date-parts":[[2024,2,20]]},"assertion":[{"value":"Deep energy-pressure regression for a thermodynamically consistent EOS model","name":"article_title","label":"Article Title"},{"value":"Machine Learning: Science and Technology","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2024 The Author(s). Published by IOP Publishing Ltd","name":"copyright_information","label":"Copyright Information"},{"value":"2023-04-08","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-02-05","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2024-02-20","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}