{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,25]],"date-time":"2026-01-25T13:02:20Z","timestamp":1769346140373,"version":"3.49.0"},"reference-count":21,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2019,4,12]],"date-time":"2019-04-12T00:00:00Z","timestamp":1555027200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The most widely used forms of model selection criteria, the Bayesian Information Criterion (BIC) and the Akaike Information Criterion (AIC), are expressed in terms of synthetic indicators of the residual distribution: the variance and the mean-squared error of the residuals respectively. In many applications in science, the noise affecting the data can be expected to have a Gaussian distribution. Therefore, at the same level of variance and mean-squared error, models, whose residuals are more uniformly distributed, should be favoured. The degree of uniformity of the residuals can be quantified by the Shannon entropy. Including the Shannon entropy in the BIC and AIC expressions improves significantly these criteria. The better performances have been demonstrated empirically with a series of simulations for various classes of functions and for different levels and statistics of the noise. In presence of outliers, a better treatment of the errors, using the Geodesic Distance, has proved essential.<\/jats:p>","DOI":"10.3390\/e21040394","type":"journal-article","created":{"date-parts":[[2019,4,12]],"date-time":"2019-04-12T12:55:04Z","timestamp":1555073704000},"page":"394","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["On the Use of Entropy to Improve Model Selection Criteria"],"prefix":"10.3390","volume":"21","author":[{"given":"Andrea","family":"Murari","sequence":"first","affiliation":[{"name":"Consorzio RFX (CNR, ENEA, INFN, Universita\u2019 di Padova, Acciaierie Venete SpA), 35127 Padova, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6829-2180","authenticated-orcid":false,"given":"Emmanuele","family":"Peluso","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, University of Rome \u201cTor Vergata\u201d, 00133 Roma, Italy"}]},{"given":"Francesco","family":"Cianfrani","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, University of Rome \u201cTor Vergata\u201d, 00133 Roma, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0861-558X","authenticated-orcid":false,"given":"Pasquale","family":"Gaudio","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, University of Rome \u201cTor Vergata\u201d, 00133 Roma, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1500-363X","authenticated-orcid":false,"given":"Michele","family":"Lungaroni","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, University of Rome \u201cTor Vergata\u201d, 00133 Roma, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2019,4,12]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Bailly, F., and Longo, G. (2011). Mathematics and the Natural Sciences, Imperial College Press.","DOI":"10.1142\/9781848166943"},{"key":"ref_2","unstructured":"D\u2019Espargnat, B. (2002). On Physics and Philosophy, Princeton University Press."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1214\/aos\/1176344136","article-title":"Estimating the dimension of a model","volume":"6","author":"Schwarz","year":"1978","journal-title":"Ann. Stat."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"716","DOI":"10.1109\/TAC.1974.1100705","article-title":"A new look at the statistical model identification","volume":"19","author":"Akaike","year":"1974","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_5","unstructured":"Kenneth, P.B., and Anderson, D.R. (2002). Model Selection and Multi-Model Inference: A Practical Information-Theoretic Approach, Springer. [2nd ed.]."},{"key":"ref_6","unstructured":"Dubois, G. (2018). Modeling and Simulation, Taylor & Francis, CRC Press."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"033006","DOI":"10.1088\/0029-5515\/53\/3\/033006","article-title":"Clustering based on the geodesic distance on Gaussian manifolds for the automatic classification of disruptions","volume":"53","author":"Murari","year":"2013","journal-title":"Nucl. Fusion"},{"key":"ref_8","unstructured":"Amari, S., and Nagaoka, H. (2000). Methods of Information Geometry, Oxford University Press."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"104006","DOI":"10.1088\/0029-5515\/49\/10\/104006","article-title":"Overview of JET results","volume":"49","author":"Romanelli","year":"2009","journal-title":"Nucl. Fusion"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1088\/0029-5515\/44\/1\/015","article-title":"Towards the realization on JET of an integrated H-mode scenario for ITER","volume":"44","author":"Ongena","year":"2004","journal-title":"Nucl. Fusion"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"043001","DOI":"10.1088\/0029-5515\/53\/4\/043001","article-title":"Non-power law scaling for access to the H-mode in tokamaks via symbolic regression","volume":"53","author":"Murari","year":"2013","journal-title":"Nucl. Fusion"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"014008","DOI":"10.1088\/0741-3335\/57\/1\/014008","article-title":"Symbolic regression via genetic programming for data driven derivation of confinement scaling laws without any assumption on their mathematical form","volume":"57","author":"Murari","year":"2015","journal-title":"Plasma Phys. Control. Fusion"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"26005","DOI":"10.1088\/0029-5515\/56\/2\/026005","article-title":"Application of symbolic regression to the derivation of scaling laws for tokamak energy confinement time in terms of dimensionless quantities","volume":"56","author":"Murari","year":"2015","journal-title":"Nucl. Fusion"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1088\/1741-4326\/aa7bb4","article-title":"Robust scaling laws for energy confinement time, including radiated fraction, in Tokamaks","volume":"57","author":"Murari","year":"2017","journal-title":"Nucl. Fusion"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Murari, A., Pisano, F., Vega, J., Cannas, B., Fanni, A., Gonzalez, S., Gelfusa, M., Grosso, M., and JET EFDA Contributors (2014). Extensive statistical analysis of ELMs on JET with a carbon wall. Plasma Phys. Control. Fusion, 56.","DOI":"10.1088\/0741-3335\/56\/11\/114007"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"10D533","DOI":"10.1063\/1.3502039","article-title":"Mutual interaction of Faraday rotation and Cotton-Mouton phase shift in JET polarimetric measurements","volume":"81","author":"Orsitto","year":"2010","journal-title":"Rev. Sci. Instrum."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"053504","DOI":"10.1063\/1.5027880","article-title":"Maximum likelihood bolometric tomography for the determination of the uncertainties in the radiation emission on JET TOKAMAK","volume":"89","author":"Craciunescu","year":"2018","journal-title":"Rev. Sci. Instrum."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1016\/j.nima.2009.03.224","article-title":"A comparison of four reconstruction methods for JET neutron and gamma tomography","volume":"605","author":"Craciunescu","year":"2009","journal-title":"Nucl. Instrum. Methods Phys. Res. Sect. A"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1007\/s11071-016-2915-x","article-title":"Geodesic distance on Gaussian manifolds for the robust identification of chaotic systems","volume":"86","author":"Craciunescu","year":"2016","journal-title":"Nonlinear Dyn."},{"key":"ref_20","unstructured":"Hugh, C., Edward, G.I., and McCulloch, R.E. (2001). The Practical Implementation of Bayesian Model Selection. IMS Lect. Notes Monogr. Ser., 38."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1803","DOI":"10.1038\/s41467-018-04241-5","article-title":"Bayesian model selection for complex dynamic systems","volume":"9","author":"Mark","year":"2018","journal-title":"Nat. Commun."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/4\/394\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:44:54Z","timestamp":1760186694000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/4\/394"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4,12]]},"references-count":21,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2019,4]]}},"alternative-id":["e21040394"],"URL":"https:\/\/doi.org\/10.3390\/e21040394","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,4,12]]}}}