{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,14]],"date-time":"2025-10-14T01:17:35Z","timestamp":1760404655966,"version":"build-2065373602"},"reference-count":25,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2016,4,30]],"date-time":"2016-04-30T00:00:00Z","timestamp":1461974400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computation"],"abstract":"<jats:p>Benchmark calculations provide a large amount of information that can be very useful in assessing the performance of density functional approximations, and for choosing the one to use. In order to condense the information some indicators are provided. However, these indicators might be insufficient and a more careful analysis is needed, as shown by some examples from an existing data set for cubic crystals.<\/jats:p>","DOI":"10.3390\/computation4020020","type":"journal-article","created":{"date-parts":[[2016,5,2]],"date-time":"2016-05-02T10:17:11Z","timestamp":1462184231000},"page":"20","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["On the Use of Benchmarks for Multiple Properties"],"prefix":"10.3390","volume":"4","author":[{"given":"Bartolomeo","family":"Civalleri","sequence":"first","affiliation":[{"name":"Department of Chemistry and Center for Nanostructured Interfaces and Surfaces, University of Torino, Via P. Giuria 7, Torino I-10125, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Roberto","family":"Dovesi","sequence":"additional","affiliation":[{"name":"Department of Chemistry and Center for Nanostructured Interfaces and Surfaces, University of Torino, Via P. Giuria 7, Torino I-10125, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8586-6222","authenticated-orcid":false,"given":"Pascal","family":"Pernot","sequence":"additional","affiliation":[{"name":"Centre National de la Recherche Scientifique (CNRS), UMR8000, Laboratoire de Chimie Physique, Orsay F-91405, France"},{"name":"Universit\u00e9 Paris-Sud, UMR8000, Laboratoire de Chimie Physique, Orsay F-91405, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Davide","family":"Presti","sequence":"additional","affiliation":[{"name":"Department of Chemical and Geological Sciences, University of Modena and Reggio-Emilia, Via Campi 103, Modena I-41125, Italy"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andreas","family":"Savin","sequence":"additional","affiliation":[{"name":"Centre National de la Recherche Scientifique (CNRS), UMR7616, Laboratoire de Chimie Th\u00e9orique, Paris F-75005, France"},{"name":"Universit\u00e9 Paris 06 (UPMC), UMR7616, Laboratoire de Chimie Th\u00e9orique, F-75005 Paris, France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2016,4,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"7374","DOI":"10.1063\/1.481336","article-title":"Assessment of Gaussian-3 and density functional theories for a larger experimental test set","volume":"112","author":"Curtiss","year":"2000","journal-title":"J. Chem. Phys."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Curtiss, L.A., Redfern, P.C., and Raghavachari, K. (2005). Assessment of Gaussian-3 and density-functional theories on the G3\/05 test set of experimental energies. J. Chem. Phys., 123.","DOI":"10.1063\/1.2039080"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1016\/j.cplett.2011.05.007","article-title":"W4-11: A high-confidence benchmark dataset for computational thermochemistry derived from first-principles {W4} Data","volume":"510","author":"Karton","year":"2011","journal-title":"Chem. Phys. Lett."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1021\/ct100466k","article-title":"Efficient and accurate double-hybrid-meta-GGA density functionals evaluation with the extended GMTKN30 database for general main group thermochemistry, kinetics, and noncovalent interactions","volume":"7","author":"Goerigk","year":"2010","journal-title":"J. Chem. Theory Comput."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Peverati, R., and Truhlar, D.G. (2014). Quest for a universal density functional: The accuracy of density functionals across a broad spectrum of databases in chemistry and physics. Philos. Trans. R. Soc. Lond. A, 372.","DOI":"10.1098\/rsta.2012.0476"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/10408436.2013.772503","article-title":"Error estimates for solid-state density-functional theory predictions: An overview by means of the ground-state elemental crystals","volume":"39","author":"Lejaeghere","year":"2014","journal-title":"Crit. Rev. Solid State Mater. Sci."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Wellendorff, J., Lundgaard, K.T., M\u00f8gelh\u00f8j, A., Petzold, V., Landis, D.D., N\u00f8rskov, J.K., Bligaard, T., and Jacobsen, K.W. (2012). Density functionals for surface science: Exchange-correlation model development with Bayesian error estimation. Phys. Rev. B, 85.","DOI":"10.1103\/PhysRevB.85.235149"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Wellendorff, J., Lundgaard, K.T., Jacobsen, K.W., and Bligaard, T. (2014). mBEEF: An accurate semi-local Bayesian error estimation density functional. J. Chem. Phys., 140.","DOI":"10.1063\/1.4870397"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"9904","DOI":"10.1039\/c3cp54374a","article-title":"xB97X-V: A 10-parameter, range-separated hybrid, generalized gradient approximation density functional with nonlocal correlation, designed by a survival-of-the-fittest strategy","volume":"16","author":"Mardirossian","year":"2014","journal-title":"Phys. Chem. Chem. Phys."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"12146","DOI":"10.1039\/C5CP01425E","article-title":"Nonseparable exchange\u2013correlation functional for molecules, including homogeneous catalysis involving transition metals","volume":"17","author":"Yu","year":"2015","journal-title":"Phys. Chem. Chem. Phys."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"6670","DOI":"10.1039\/c0cp02984j","article-title":"A thorough benchmark of density functional methods for general main group thermochemistry, kinetics, and noncovalent interactions","volume":"13","author":"Goerigk","year":"2011","journal-title":"Phys. Chem. Chem. Phys."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1021\/ct300868x","article-title":"Performance of meta-GGA functionals on general main group thermochemistry, kinetics, and noncovalent interactions","volume":"9","author":"Hao","year":"2013","journal-title":"J. Chem. Theory Comput."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1039\/9781849734790-00168","article-title":"On choosing the best density functional approximation","volume":"Volume 9","author":"Civalleri","year":"2012","journal-title":"Chemical Modelling: Applications and Theory"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/128_2014_600","article-title":"Judging density functional approximations: Some pitfalls of statistics","volume":"365","author":"Savin","year":"2015","journal-title":"Top. Curr. Chem."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Perdew, J.P., Sun, J., Garza, A.J., and Scuseria, G. (2016). Intensive atomization energy: Re-thinking a metric for electronic-structure-theory methods. Z. Phys. Chem., in press.","DOI":"10.1515\/zpch-2015-0713"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"5288","DOI":"10.1021\/jp509980w","article-title":"Prediction uncertainty of density functional approximations for properties of crystals with cubic symmetry","volume":"119","author":"Pernot","year":"2015","journal-title":"J. Phys. Chem. A"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1103\/PhysRev.81.385","article-title":"A simplification of the hartree-fock method","volume":"81","author":"Slater","year":"1951","journal-title":"Phys. Rev."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1200","DOI":"10.1139\/p80-159","article-title":"Accurate spin-dependent electron liquid correlation energies for local spin density calculations: A critical analysis","volume":"58","author":"Vosko","year":"1980","journal-title":"Can. J. Phys."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Perdew, J.P., Ruzsinszky, A., Csonka, G.I., Vydrov, O.A., Scuseria, G.E., Constantin, L.A., Zhou, X., and Burke, K. (2008). Restoring the density-gradient expansion for exchange in solids and surfaces. Phys. Rev. Lett., 100.","DOI":"10.1103\/PhysRevLett.100.136406"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Henderson, T.M., Izmaylov, A.F., Scuseria, G.E., and Savin, A. (2007). The importance of middle-range hartree-fock-type exchange for hybrid density functionals. J. Chem. Phys., 127.","DOI":"10.1063\/1.2822021"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1254","DOI":"10.1021\/ct800149y","article-title":"Assessment of a middle-range hybrid functional","volume":"4","author":"Henderson","year":"2008","journal-title":"J. Chem. Theory Comput."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1214\/ss\/1009213286","article-title":"Interval estimation for a binomial proportion","volume":"16","author":"Brown","year":"2001","journal-title":"Stat. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1016\/j.commatsci.2016.01.039","article-title":"Is the error on first-principles volume predictions absolute or relative?","volume":"117","author":"Lejaeghere","year":"2016","journal-title":"Comput. Mater. Sci."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Duan, X.M., Song, G.L., Li, Z.H., Wang, X.J., Chen, G.H., and Fan, K.N. (2004). Accurate prediction of heat of formation by combining Hartree-Fock\/density functional theory calculation with linear regression correction approach. J. Chem. Phys., 121.","DOI":"10.1063\/1.1786582"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Lejaeghere, K., Jaeken, J., Speybroeck, V.V., and Cottenier, S. (2014). Ab initio based thermal property predictions at a low cost: An error analysis. Phys. Rev. B, 89.","DOI":"10.1103\/PhysRevB.89.014304"}],"container-title":["Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-3197\/4\/2\/20\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T19:23:08Z","timestamp":1760210588000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-3197\/4\/2\/20"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,4,30]]},"references-count":25,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2016,6]]}},"alternative-id":["computation4020020"],"URL":"https:\/\/doi.org\/10.3390\/computation4020020","relation":{},"ISSN":["2079-3197"],"issn-type":[{"type":"electronic","value":"2079-3197"}],"subject":[],"published":{"date-parts":[[2016,4,30]]}}}