{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,12]],"date-time":"2026-03-12T11:35:41Z","timestamp":1773315341675,"version":"3.50.1"},"reference-count":14,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2020,1,24]],"date-time":"2020-01-24T00:00:00Z","timestamp":1579824000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The increasingly sophisticated investigations of complex systems require more robust estimates of the correlations between the measured quantities. The traditional Pearson correlation coefficient is easy to calculate but sensitive only to linear correlations. The total influence between quantities is, therefore, often expressed in terms of the mutual information, which also takes into account the nonlinear effects but is not normalized. To compare data from different experiments, the information quality ratio is, therefore, in many cases, of easier interpretation. On the other hand, both mutual information and information quality ratio are always positive and, therefore, cannot provide information about the sign of the influence between quantities. Moreover, they require an accurate determination of the probability distribution functions of the variables involved. As the quality and amount of data available are not always sufficient to grant an accurate estimation of the probability distribution functions, it has been investigated whether neural computational tools can help and complement the aforementioned indicators. Specific encoders and autoencoders have been developed for the task of determining the total correlation between quantities related by a functional dependence, including information about the sign of their mutual influence. Both their accuracy and computational efficiencies have been addressed in detail, with extensive numerical tests using synthetic data. A careful analysis of the robustness against noise has also been performed. The neural computational tools typically outperform the traditional indicators in practically every respect.<\/jats:p>","DOI":"10.3390\/e22020141","type":"journal-article","created":{"date-parts":[[2020,1,24]],"date-time":"2020-01-24T11:01:00Z","timestamp":1579863660000},"page":"141","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Quantifying Total Influence between Variables with Information Theoretic and Machine Learning Techniques"],"prefix":"10.3390","volume":"22","author":[{"given":"Andrea","family":"Murari","sequence":"first","affiliation":[{"name":"Consorzio RFX (CNR, ENEA, INFN, Universita\u2019 di Padova, Acciaierie Venete SpA), Corso Stati Uniti 4, 35127 Padova, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4414-6119","authenticated-orcid":false,"given":"Riccardo","family":"Rossi","sequence":"additional","affiliation":[{"name":"Associazione EURATOM-ENEA, University of Rome \u201cTor Vergata\u201d, 00133 Rome, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1500-363X","authenticated-orcid":false,"given":"Michele","family":"Lungaroni","sequence":"additional","affiliation":[{"name":"Associazione EURATOM-ENEA, University of Rome \u201cTor Vergata\u201d, 00133 Rome, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0861-558X","authenticated-orcid":false,"given":"Pasquale","family":"Gaudio","sequence":"additional","affiliation":[{"name":"Associazione EURATOM-ENEA, University of Rome \u201cTor Vergata\u201d, 00133 Rome, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5158-7292","authenticated-orcid":false,"given":"Michela","family":"Gelfusa","sequence":"additional","affiliation":[{"name":"Associazione EURATOM-ENEA, University of Rome \u201cTor Vergata\u201d, 00133 Rome, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2020,1,24]]},"reference":[{"key":"ref_1","unstructured":"Erl, T., Khattak, W., and Buhler, P. (2016). Big Data Fundamentals: Concepts, Drivers & Techniques, Prentice Hall Press."},{"key":"ref_2","unstructured":"Goldacre, B. (2008). Bad Science, Forth Estate."},{"key":"ref_3","unstructured":"MacKay, D.J.C. (2003). Information Theory, Inference and Learning Algorithms, Cambridge University Press."},{"key":"ref_4","unstructured":"Silverman, B.W. (1986). Density Estimation for Statistics and Data Analysis, Chapmans & Hall."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"043001","DOI":"10.1088\/0029-5515\/53\/4\/043001","article-title":"Non-power law scaling for access to the H-mode in tokamaks via symbolic regression","volume":"53","author":"Murari","year":"2013","journal-title":"Nucl. Fusion"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"014008","DOI":"10.1088\/0741-3335\/57\/1\/014008","article-title":"Symbolic regression via genetic programming for data driven derivation of confinement scaling laws without any assumption on their mathematical form","volume":"57","author":"Murari","year":"2015","journal-title":"Plasma Phys. Control. Fusion"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1088\/0029-5515\/55\/7\/073009","article-title":"A new approach to the formulation and validation of scaling expressions for plasma confinement in tokamaks","volume":"55","author":"Murari","year":"2015","journal-title":"Nucl. Fusion"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"26005","DOI":"10.1088\/0029-5515\/56\/2\/026005","article-title":"Application of symbolic regression to the derivation of scaling laws for tokamak energy confinement time in terms of dimensionless quantities","volume":"56","author":"Murari","year":"2015","journal-title":"Nucl. Fusion"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"033006","DOI":"10.1088\/0029-5515\/53\/3\/033006","article-title":"and JET-EFDA Contributors. Clustering based on the geodesic distance on Gaussian manifolds for the automatic classification of disruptions","volume":"53","author":"Murari","year":"2013","journal-title":"Nucl. Fusion"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1126\/science.1165893","article-title":"Distilling Free-Form Natural Laws from Experimental Data","volume":"324","author":"Schmid","year":"2019","journal-title":"Science"},{"key":"ref_11","unstructured":"Koza, J.R. (1992). Genetic Programming: On the Programming of Computers by Means of Natural Selection, MIT Press."},{"key":"ref_12","unstructured":"Goodfellow, I., Bengio, Y., and Courville, A. (2017). Deep Learning (Adaptive Computation and Machine Learning Series), MIT Press."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1093\/biomet\/30.1-2.81","article-title":"A New Measure of Rank Correlation","volume":"30","author":"Kendall","year":"1938","journal-title":"Biometrika"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Agresti, A. (2010). Analysis of Ordinal Categorical Data, John Wiley & Sons. [2nd ed.].","DOI":"10.1002\/9780470594001"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/2\/141\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:44:36Z","timestamp":1760363076000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/22\/2\/141"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,24]]},"references-count":14,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2020,2]]}},"alternative-id":["e22020141"],"URL":"https:\/\/doi.org\/10.3390\/e22020141","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,24]]}}}