{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,8]],"date-time":"2026-02-08T00:46:17Z","timestamp":1770511577702,"version":"3.49.0"},"reference-count":32,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2020,4,15]],"date-time":"2020-04-15T00:00:00Z","timestamp":1586908800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The Bayesian information criterion (BIC), the Akaike information criterion (AIC), and some other indicators derived from them are widely used for model selection. In their original form, they contain the likelihood of the data given the models. Unfortunately, in many applications, it is practically impossible to calculate the likelihood, and, therefore, the criteria have been reformulated in terms of descriptive statistics of the residual distribution: the variance and the mean-squared error of the residuals. These alternative versions are strictly valid only in the presence of additive noise of Gaussian distribution, not a completely satisfactory assumption in many applications in science and engineering. Moreover, the variance and the mean-squared error are quite crude statistics of the residual distributions. More sophisticated statistical indicators, capable of better quantifying how close the residual distribution is to the noise, can be profitably used. In particular, specific goodness of fit tests have been included in the expressions of the traditional criteria and have proved to be very effective in improving their discriminating capability. These improved performances have been demonstrated with a systematic series of simulations using synthetic data for various classes of functions and different noise statistics.<\/jats:p>","DOI":"10.3390\/e22040447","type":"journal-article","created":{"date-parts":[[2020,4,15]],"date-time":"2020-04-15T09:19:50Z","timestamp":1586942390000},"page":"447","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":36,"title":["Upgrading Model Selection Criteria with Goodness of Fit Tests for Practical Applications"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4414-6119","authenticated-orcid":false,"given":"Riccardo","family":"Rossi","sequence":"first","affiliation":[{"name":"Department of Industrial Engineering, University of Rome \u201cTor Vergata\u201d, via del Politecnico 1, 01100 Roma, Italy"}]},{"given":"Andrea","family":"Murari","sequence":"additional","affiliation":[{"name":"Consorzio RFX (CNR, ENEA, INFN, Universit\u00e0 di Padova, Acciaierie Venete SpA), Corso Stati Uniti 4, 35127 Padova, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0861-558X","authenticated-orcid":false,"given":"Pasquale","family":"Gaudio","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, University of Rome \u201cTor Vergata\u201d, via del Politecnico 1, 01100 Roma, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5158-7292","authenticated-orcid":false,"given":"Michela","family":"Gelfusa","sequence":"additional","affiliation":[{"name":"Department of Industrial Engineering, University of Rome \u201cTor Vergata\u201d, via del Politecnico 1, 01100 Roma, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2020,4,15]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Bailly, F., and Longo, G. (2011). Mathematics and the Natural Sciences, Imperial College Press.","DOI":"10.1142\/9781848166943"},{"key":"ref_2","unstructured":"D\u2019Espargnat, B. (2002). On Physics and Philosophy, Princeton University Press."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1146\/annurev-statistics-041715-033413","article-title":"Statistical model choice","volume":"3","author":"Claeskens","year":"2016","journal-title":"Annu. Rev. Stat. Appl."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Corder, G.W., and Foreman, D.I. (2009). Nonparametric Statistics for Non-Statisticians: A Step-by-Step Approach, Wiley.","DOI":"10.1002\/9781118165881"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"716","DOI":"10.1109\/TAC.1974.1100705","article-title":"A new look at the statistical model identification","volume":"19","author":"Akaike","year":"1974","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_6","first-page":"461","article-title":"Estimating the dimension of a model","volume":"6","year":"1978","journal-title":"Ann. Stat."},{"key":"ref_7","unstructured":"Kenneth, P.B., and Anderson, D.R. (2002). Model Selection and Multi-Model Inference: A Practical Information-Theoretic Approach, Springer. [2nd ed.]."},{"key":"ref_8","unstructured":"Dubois, G. (2018). Modeling and Simulation, CRC Press."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Murari, A., Peluso, E., Cianfrani, F., Gaudio, P., and Lungaroni, M. (2019). On the use of entropy to improve model selection criteria. Entropy, 21.","DOI":"10.3390\/e21040394"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1080\/14786440009463897","article-title":"On the criterion that a given system of deviations from the probable in the case of a correlated system of variables is such that it can be reasonably supposed to have arisen from random sampling","volume":"50","author":"Pearson","year":"1900","journal-title":"Lond. Edinb. Dublin Philos. Mag. J. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1214\/aoms\/1177729437","article-title":"Asymptotic theory of certain \u201cgoodness-of-fit\u201d criteria based on stochastic processes","volume":"23","author":"Anderson","year":"1952","journal-title":"Ann. Math. Stat."},{"key":"ref_12","unstructured":"Shapiro, S.S. (1980). How to test normality and other distributional assumptions. The ASQC Basic References in Quality Control: Statistical Techniques 3, American Society for Quality."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v008.i18","article-title":"Evaluating Kolmogorov\u2019s distribution","volume":"8","author":"Marsaglia","year":"2003","journal-title":"J. Stat. Softw."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Bonamente, M. (2017). Statistics and Analysis of Scientific Data, Springer Scince + Bussiness Media. Graduate Texts in Physics.","DOI":"10.1007\/978-1-4939-6572-4"},{"key":"ref_15","unstructured":"Kelley, C.T. (1999). Iterative Methods for Optimization, SIAM Frontiers in Applied Mathematics, Society for Industrial and Applied Mathematics."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"104006","DOI":"10.1088\/0029-5515\/49\/10\/104006","article-title":"Overview of JET results","volume":"49","author":"Romanelli","year":"2009","journal-title":"Nucl. Fusion"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1088\/0029-5515\/44\/1\/015","article-title":"Towards the realization on JET of an integrated H-mode scenario for ITER","volume":"44","author":"Ongena","year":"2004","journal-title":"Nucl. Fusion"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"043001","DOI":"10.1088\/0029-5515\/53\/4\/043001","article-title":"Non-power law scaling for access to the H-mode in tokamaks via symbolic regression","volume":"53","author":"Murari","year":"2013","journal-title":"Nucl. Fusion"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"014008","DOI":"10.1088\/0741-3335\/57\/1\/014008","article-title":"Symbolic regression via genetic programming for data driven derivation of confinement scaling laws without any assumption on their mathematical form","volume":"57","author":"Murari","year":"2015","journal-title":"Plasma Phys. Control. Fusion"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"26005","DOI":"10.1088\/0029-5515\/56\/2\/026005","article-title":"Application of symbolic regression to the derivation of scaling laws for tokamak energy confinement time in terms of dimensionless quantities","volume":"56","author":"Murari","year":"2015","journal-title":"Nucl. Fusion"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"063016","DOI":"10.1088\/0029-5515\/52\/6\/063016","article-title":"A statistical methodology to derive the scaling law for the H-mode power threshold using a large multi-machine database","volume":"52","author":"Murari","year":"2012","journal-title":"Nucl. Fusion"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Murari, A., Pisano, F., Vega, J., Cannas, B., Fanni, A., Gonzalez, S., Gelfusa, M., Grosso, M., and JET EFDA Contributors (2014). Extensive statistical analysis of ELMs on JET with a carbon wall. Plasma Phys. Control. Fusion, 56.","DOI":"10.1088\/0741-3335\/56\/11\/114007"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"10D533","DOI":"10.1063\/1.3502039","article-title":"Mutual interaction of faraday rotation and cotton-mouton phase shift in JET polarimetric measurements","volume":"81","author":"Orsitto","year":"2010","journal-title":"Rev. Sci. Instrum."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Gaudio, P., Gelfusa, M., Malizia, A., Richetta, M., Antonucci, A., Ventura, P., Murari, A., and Vega, J. (2013, January 23\u201326). Design and development of a compact Lidar\/Dial system for aerial surveillance of urban areas. Proceedings of the SPIE\u2014The International Society for Optical Engineering, Dresden, Germany.","DOI":"10.1117\/12.2028940"},{"key":"ref_25","first-page":"195","article-title":"New frontiers of forest fire protection: A portable laser system","volume":"9","author":"Gaudio","year":"2013","journal-title":"WSEAS Trans. Environ. Dev."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"053504","DOI":"10.1063\/1.5027880","article-title":"Maximum likelihood bolometric tomography for the determination of the uncertainties in the radiation emission on JET TOKAMAK","volume":"89","author":"Craciunescu","year":"2018","journal-title":"Rev. Sci. Instrum."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1016\/j.nima.2009.03.224","article-title":"A comparison of four reconstruction methods for JET neutron and gamma tomography","volume":"605","author":"Craciunescu","year":"2009","journal-title":"Nucl. Instrum. Methods Phys. Res. Sect. A"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1007\/s11071-016-2915-x","article-title":"Geodesic distance on Gaussian manifolds for the robust identification of chaotic systems","volume":"86","author":"Craciunescu","year":"2000","journal-title":"Nonlinear Dyn."},{"key":"ref_29","unstructured":"Amari, S., and Nagaoka, H. (2000). Methods of Information Geometry, Oxford University Press."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"033006","DOI":"10.1088\/0029-5515\/53\/3\/033006","article-title":"Clustering based on the geodesic distance on Gaussian manifolds for the automatic classification of disruptions","volume":"53","author":"Murari","year":"2013","journal-title":"Nucl. Fusion"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"113001","DOI":"10.1088\/0029-5515\/53\/11\/113001","article-title":"Development of an efficient real-time disruption predictor from scratch on JET and implications for ITER","volume":"53","author":"Vega","year":"2013","journal-title":"Nucl. Fusion"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Toma, A., Karagrigoriou, A., and Trentou, P. (2020). Robust model selection criteria using pseudodistnaces. Entropy.","DOI":"10.3390\/e22030304"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/4\/447\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:30:49Z","timestamp":1760362249000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/4\/447"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,15]]},"references-count":32,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2020,4]]}},"alternative-id":["e22040447"],"URL":"https:\/\/doi.org\/10.3390\/e22040447","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,4,15]]}}}