{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T03:26:57Z","timestamp":1788406017106,"version":"build-2803163510"},"reference-count":38,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2021,12,30]],"date-time":"2021-12-30T00:00:00Z","timestamp":1640822400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Interaction between variables is often found in statistical models, and it is usually expressed in the model as an additional term when the variables are numeric. However, when the variables are categorical (also known as nominal or qualitative) or mixed numerical-categorical, defining, detecting, and measuring interactions is not a simple task. In this work, based on an entropy-based correlation measure for n nominal variables (named as Multivariate Symmetrical Uncertainty (MSU)), we propose a formal and broader definition for the interaction of the variables. Two series of experiments are presented. In the first series, we observe that datasets where some record types or combinations of categories are absent, forming patterns of records, which often display interactions among their attributes. In the second series, the interaction\/non-interaction behavior of a regression model (entirely built on continuous variables) gets successfully replicated under a discretized version of the dataset. It is shown that there is an interaction-wise correspondence between the continuous and the discretized versions of the dataset. Hence, we demonstrate that the proposed definition of interaction enabled by the MSU is a valuable tool for detecting and measuring interactions within linear and non-linear models.<\/jats:p>","DOI":"10.3390\/e24010064","type":"journal-article","created":{"date-parts":[[2021,12,30]],"date-time":"2021-12-30T21:41:21Z","timestamp":1640900481000},"page":"64","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Measuring Interactions in Categorical Datasets Using Multivariate Symmetrical Uncertainty"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6363-0833","authenticated-orcid":false,"given":"Santiago","family":"G\u00f3mez-Guerrero","sequence":"first","affiliation":[{"name":"Polytechnic School, National University of Asuncion, San Lorenzo 2111, Paraguay"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Inocencio","family":"Ortiz","sequence":"additional","affiliation":[{"name":"Polytechnic School, National University of Asuncion, San Lorenzo 2111, Paraguay"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9637-4319","authenticated-orcid":false,"given":"Gustavo","family":"Sosa-Cabrera","sequence":"additional","affiliation":[{"name":"Polytechnic School, National University of Asuncion, San Lorenzo 2111, Paraguay"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6867-7080","authenticated-orcid":false,"given":"Miguel","family":"Garc\u00eda-Torres","sequence":"additional","affiliation":[{"name":"Data Science and Big Data Lab, Universidad Pablo de Olavide, ES-41013 Seville, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0587-7704","authenticated-orcid":false,"given":"Christian E.","family":"Schaerer","sequence":"additional","affiliation":[{"name":"Polytechnic School, National University of Asuncion, San Lorenzo 2111, Paraguay"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,12,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1098\/rspl.1895.0041","article-title":"Note on regression and inheritance in the case of two parents","volume":"58","author":"Pearson","year":"1895","journal-title":"Proc. R. Soc. Lond."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"72","DOI":"10.2307\/1412159","article-title":"The proof and measurement of association between two things","volume":"15","author":"Spearman","year":"1904","journal-title":"Am. J. Psychol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1080\/00031305.1972.10477345","article-title":"Some Interpretations of the Multiple Correlation Coefficient","volume":"26","author":"Crocker","year":"1972","journal-title":"Am. Stat."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Viole, F., and Nawrocki, D.N. (2012). Deriving Nonlinear Correlation Coefficients from Partial Moments. SSRN Electron. J.","DOI":"10.2139\/ssrn.2148522"},{"key":"ref_5","unstructured":"Colignatus, T. (2021, September 30). Correlation and Regression in Contingency Tables. A Measure of Association or Correlation in Nominal Data (Contingency Tables), Using Determinants. Available online: https:\/\/mpra.ub.uni-muenchen.de\/3660\/."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1109\/TIT.1954.1057469","article-title":"Multivariate information transmission","volume":"4","author":"McGill","year":"1954","journal-title":"Trans. Ire Prof. Group Inf. Theory"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1147\/rd.41.0066","article-title":"Information theoretical analysis of multivariate correlation","volume":"4","author":"Watanabe","year":"1960","journal-title":"IBM J. Res. Dev."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1016\/S0019-9958(80)90478-7","article-title":"Multiple mutual informations and multiple interactions in frequency data","volume":"46","author":"Han","year":"1980","journal-title":"Inf. Control"},{"key":"ref_9","unstructured":"Williams, P.L., and Beer, R.D. (2021, September 30). Nonnegative Decomposition of Multivariate Information. Available online: https:\/\/arxiv.org\/abs\/1004.2515."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1007\/s10827-010-0271-2","article-title":"Multivariate information-theoretic measures reveal directed information structure and task relevant changes in fMRI connectivity","volume":"30","author":"Lizier","year":"2011","journal-title":"J. Comput. Neurosci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1007\/s10827-013-0458-4","article-title":"Synergy, redundancy, and multivariate information measures: An experimentalist\u2019s perspective","volume":"36","author":"Timme","year":"2014","journal-title":"J. Comput. Neurosci."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1005","DOI":"10.1089\/cmb.2015.0051","article-title":"Biological data analysis as an information theory problem: Multivariable dependence measures and the Shadows algorithm","volume":"22","author":"Sakhanenko","year":"2015","journal-title":"J. Comput. Biol."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Mohammadi, S., Desai, V., and Karimipour, H. (2018, January 10\u201311). Multivariate mutual information-based feature selection for cyber intrusion detection. Proceedings of the 2018 IEEE Electrical Power and Energy Conference (EPEC), Toronto, ON, Canada.","DOI":"10.1109\/EPEC.2018.8598326"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"5194","DOI":"10.1103\/PhysRevLett.79.5194","article-title":"Negative entropy and information in quantum mechanics","volume":"79","author":"Cerf","year":"1997","journal-title":"Phys. Rev. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"939","DOI":"10.1086\/521878","article-title":"Information-theoretic metrics for visualizing gene-environment interactions","volume":"81","author":"Chanda","year":"2007","journal-title":"Am. J. Hum. Genet."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Jakulin, A., Bratko, I., Smrke, D., Dem\u0161ar, J., and Zupan, B. (2003). Attribute interactions in medical data analysis. Conference on Artificial Intelligence in Medicine in Europe, Springer.","DOI":"10.1007\/978-3-540-39907-0_32"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1531","DOI":"10.1162\/089976600300015259","article-title":"Synergy in a neural code","volume":"12","author":"Brenner","year":"2000","journal-title":"Neural Comput."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.ins.2019.04.046","article-title":"A Multivariate approach to the Symmetrical Uncertainty Measure: Application to Feature Selection Problem","volume":"494","author":"Schaerer","year":"2019","journal-title":"Inf. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ince, R.A. (2017). Measuring multivariate redundant information with pointwise common change in surprisal. Entropy, 19.","DOI":"10.3390\/e19070318"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Arias-Michel, R., Garc\u00eda-Torres, M., Schaerer, C., and Divina, F. (2016, January 18\u201320). Feature Selection Using Approximate Multivariate Markov Blankets. Proceedings of the Hybrid Artificial Intelligent Systems\u201411th International Conference, HAIS 2016, Seville, Spain.","DOI":"10.1007\/978-3-319-32034-2_10"},{"key":"ref_21","unstructured":"Sosa-Cabrera, G., G\u00f3mez-Guerrero, S., Schaerer, C., Garc\u00eda-Torres, M., and Divina, F. (2016, January 7\u201310). Understanding a Version of Multivariate Symmetric Uncertainty to assist in Feature Selection. Proceedings of the 4th Conference of Computational Interdisciplinary Science, S\u00e3o Jos\u00e9 dos Campos, Brazil."},{"key":"ref_22","unstructured":"Sosa-Cabrera, G., Garc\u00eda-Torres, M., G\u00f3mez-Guerrero, S., Schaerer, C., and Divina, F. (2018, January 17\u201321). Understanding a multivariate semi-metric in the search strategies for attributes subset selection. Proceedings of the Brazilian Society of Computational and Applied Mathematics, Campinas, Brazil."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1016\/S0004-3702(97)00043-X","article-title":"Wrappers for feature subset selection","volume":"97","author":"Kohavi","year":"1997","journal-title":"Artif. Intell."},{"key":"ref_24","first-page":"1205","article-title":"Efficient feature selection via analysis of relevance and redundancy","volume":"5","author":"Yu","year":"2004","journal-title":"J. Mach. Learn. Res."},{"key":"ref_25","unstructured":"Janzing, D., Minorics, L., and Bl\u00f6baum, P. (2020, January 26\u201328). Feature relevance quantification in explainable AI: A causal problem. Proceedings of the International Conference on Artificial Intelligence and Statistics. PMLR, Online."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2656","DOI":"10.1016\/j.patcog.2015.02.025","article-title":"A novel feature selection method considering feature interaction","volume":"48","author":"Zeng","year":"2015","journal-title":"Pattern Recognit."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/j.knosys.2015.07.004","article-title":"Feature selection with redundancy-complementariness dispersion","volume":"89","author":"Chen","year":"2015","journal-title":"Knowl.-Based Syst."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Lopez-Arevalo, I., Aldana-Bobadilla, E., Molina-Villegas, A., Galeana-Zapi\u00e9n, H., Mu\u00f1iz-Sanchez, V., and Gausin-Valle, S. (2020). A Memory-Efficient Encoding Method for Processing Mixed-Type Data on Machine Learning. Entropy, 22.","DOI":"10.3390\/e22121391"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Dinh, D.T., and Huynh, V.N. (2020). k-PbC: An improved cluster center initialization for categorical data clustering. Appl. Intell., 50.","DOI":"10.1007\/s10489-020-01677-5"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Rivera Rios, E.J., Medina-P\u00e9rez, M.A., Lazo-Cort\u00e9s, M.S., and Monroy, R. (2021). Learning-Based Dissimilarity for Clustering Categorical Data. Appl. Sci., 11.","DOI":"10.3390\/app11083509"},{"key":"ref_31","unstructured":"Hanck, C., Arnold, M., Gerber, A., and Schmelzer, M. (2020). Introduction to Econometrics with R, University of Duisburg."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1177\/2515245917746792","article-title":"Improving present practices in the visual display of interactions","volume":"1","author":"McCabe","year":"2018","journal-title":"Adv. Methods Pract. Psychol. Sci."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1023\/A:1011996210207","article-title":"Understanding the crucial role of attribute interaction in data mining","volume":"16","author":"Freitas","year":"2001","journal-title":"Artif. Intell. Rev."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Jaccard, J.J. (1997). Interaction Effects in Factorial Analysis of Variance, SAGE Publications, Inc.","DOI":"10.4135\/9781412984508"},{"key":"ref_35","unstructured":"Vajapeyam, S. (2021, September 30). Understanding Shannon\u2019s Entropy Metric for Information. Available online: https:\/\/arxiv.org\/ftp\/arxiv\/papers\/1405\/1405.2061.pdf."},{"key":"ref_36","unstructured":"Johnson, R.A., and Wichern, D.W. (2007). Applied Multivariate Statistical Analysis, Pearson-Prentice Hall. [6th ed.]."},{"key":"ref_37","unstructured":"Joseph, L. (2021, September 30). Interactions in Multiple Linear Regression. Department of Epidemiology and Biostatistics, McGill University. Available online: https:\/\/www.medicine.mcgill.ca\/epidemiology\/joseph\/courses\/EPIB-621\/interaction.pdf."},{"key":"ref_38","unstructured":"Stats.Blue (2021, September 30). Multiple Linear Regression Calculator. Available online: https:\/\/stats.blue\/Stats_Suite\/multiple_linear_regression_calculator.html."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/1\/64\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:55:50Z","timestamp":1760169350000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/1\/64"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,12,30]]},"references-count":38,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,1]]}},"alternative-id":["e24010064"],"URL":"https:\/\/doi.org\/10.3390\/e24010064","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,12,30]]}}}