{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,29]],"date-time":"2025-12-29T11:29:15Z","timestamp":1767007755784,"version":"build-2065373602"},"reference-count":46,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2019,8,9]],"date-time":"2019-08-09T00:00:00Z","timestamp":1565308800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computation"],"abstract":"<jats:p>The so-called Relevance Index (RI) metrics are a set of recently-introduced indicators based on information theory principles that can be used to analyze complex systems by detecting the main interacting structures within them. Such structures can be described as subsets of the variables which describe the system status that are strongly statistically correlated with one another and mostly independent of the rest of the system. The goal of the work described in this paper is to apply the same principles to pattern recognition and check whether the RI metrics can also identify, in a high-dimensional feature space, attribute subsets from which it is possible to build new features which can be effectively used for classification. Preliminary results indicating that this is possible have been obtained using the RI metrics in a supervised way, i.e., by separately applying such metrics to homogeneous datasets comprising data instances which all belong to the same class, and iterating the procedure over all possible classes taken into consideration. In this work, we checked whether this would also be possible in a totally unsupervised way, i.e., by considering all data available at the same time, independently of the class to which they belong, under the hypothesis that the peculiarities of the variable sets that the RI metrics can identify correspond to the peculiarities by which data belonging to a certain class are distinguishable from data belonging to different classes. The results we obtained in experiments made with some publicly available real-world datasets show that, especially when coupled to tree-based classifiers, the performance of an RI metrics-based unsupervised feature extraction method can be comparable to or better than other classical supervised or unsupervised feature selection or extraction methods.<\/jats:p>","DOI":"10.3390\/computation7030039","type":"journal-article","created":{"date-parts":[[2019,8,9]],"date-time":"2019-08-09T11:11:31Z","timestamp":1565349091000},"page":"39","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["From Complex System Analysis to Pattern Recognition: Experimental Assessment of an Unsupervised Feature Extraction Method Based on the Relevance Index Metrics"],"prefix":"10.3390","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3288-5945","authenticated-orcid":false,"given":"Laura","family":"Sani","sequence":"first","affiliation":[{"name":"Department of Engineering and Architecture, University of Parma, Parco Area delle Scienze 181\/A, 43124 Parma, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5948-5845","authenticated-orcid":false,"given":"Riccardo","family":"Pecori","sequence":"additional","affiliation":[{"name":"Department of Engineering and Architecture, University of Parma, Parco Area delle Scienze 181\/A, 43124 Parma, Italy"},{"name":"SMARTEST Research Centre, eCampus University, Via Isimbardi 10, 22060 Novedrate, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5916-9770","authenticated-orcid":false,"given":"Monica","family":"Mordonini","sequence":"additional","affiliation":[{"name":"Department of Engineering and Architecture, University of Parma, Parco Area delle Scienze 181\/A, 43124 Parma, Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4669-512X","authenticated-orcid":false,"given":"Stefano","family":"Cagnoni","sequence":"additional","affiliation":[{"name":"Department of Engineering and Architecture, University of Parma, Parco Area delle Scienze 181\/A, 43124 Parma, Italy"}]}],"member":"1968","published-online":{"date-parts":[[2019,8,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Filisetti, A., Villani, M., Roli, A., Fiorucci, M., and Serra, R. Exploring the organisation of complex systems through the dynamical interactions among their relevant subsets. Proceedings of the European Conference on Artificial Life 2015.","DOI":"10.7551\/978-0-262-33027-5-ch054"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Ghidini, C., Magnini, B., Passerini, A., and Traverso, P. (2018). An Integration-Based Approach to Pattern Clustering and Classification. AI*IA 2018\u2014Advances in Artificial Intelligence, Springer.","DOI":"10.1007\/978-3-030-03840-3"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Sim, K., and Kaufmann, P. (2018). Can the Relevance Index be Used to Evolve Relevant Feature Sets?. International Conference on the Applications of Evolutionary Computation, Springer.","DOI":"10.1007\/978-3-319-77538-8"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Sani, L., Amoretti, M., Vicari, E., Mordonini, M., Pecori, R., Roli, A., Villani, M., Cagnoni, S., and Serra, R. (2016). Efficient Search of Relevant Structures in Complex Systems. Conference of the Italian Association for Artificial Intelligence, Springer.","DOI":"10.1007\/978-3-319-49130-1_4"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Vicari, E., Amoretti, M., Sani, L., Mordonini, M., Pecori, R., Roli, A., Villani, M., Cagnoni, S., and Serra, R. (2017). GPU-based parallel search of relevant variable sets in complex systems. Italian Workshop on Artificial Life and Evolutionary Computation, Springer.","DOI":"10.1007\/978-3-319-57711-1_2"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3687839","DOI":"10.1155\/2018\/3687839","article-title":"An iterative information-theoretic approach to the detection of structures in complex systems","volume":"2018","author":"Villani","year":"2018","journal-title":"Complexity"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"691","DOI":"10.1016\/j.dss.2012.08.014","article-title":"Mutual information based input feature selection for classification problems","volume":"54","author":"Cang","year":"2012","journal-title":"Decis. Support Syst."},{"key":"ref_8","unstructured":"Motoda, H., and Liu, H. (2002). Feature Selection Extraction and Construction, Institute of Information and Computing Machinery. Communication of IICM."},{"key":"ref_9","first-page":"305","article-title":"Unsupervised Feature Extraction for Time Series Clustering Using Orthogonal Wavelet Transform","volume":"30","author":"Zhang","year":"2006","journal-title":"Informatica"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"316","DOI":"10.1016\/j.patcog.2017.10.008","article-title":"Joint bilateral filtering and spectral similarity-based sparse representation: A generic framework for effective feature extraction and data classification in hyperspectral imaging","volume":"77","author":"Qiao","year":"2018","journal-title":"Pattern Recognit."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.advwatres.2018.11.016","article-title":"Calibration of astigmatic particle tracking velocimetry based on generalized Gaussian feature extraction","volume":"124","author":"Franchini","year":"2019","journal-title":"Adv. Water Resour."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1016\/j.neunet.2018.10.001","article-title":"Unsupervised feature extraction by low-rank and sparsity preserving embedding","volume":"109","author":"Zhan","year":"2019","journal-title":"Neural Netw."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2420","DOI":"10.1109\/TIP.2018.2804218","article-title":"Local Deep-Feature Alignment for Unsupervised Dimension Reduction","volume":"27","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"4581","DOI":"10.1109\/TGRS.2018.2828029","article-title":"SuperPCA: A Superpixelwise PCA Approach for Unsupervised Feature Extraction of Hyperspectral Imagery","volume":"56","author":"Jiang","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1139","DOI":"10.1109\/TMI.2018.2879369","article-title":"Unsupervised Feature Extraction via Deep Learning for Histopathological Classification of Colon Tissue Images","volume":"38","author":"Sari","year":"2019","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Taguchi, Y.H. (2018). Tensor Decomposition-Based Unsupervised Feature Extraction Can Identify the Universal Nature of Sequence-Nonspecific Off-Target Regulation of mRNA Mediated by MicroRNA Transfection. Cells, 7.","DOI":"10.3390\/cells7060054"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Taguchi, Y.H. (2018). Tensor decomposition-based and principal-component-analysis-based unsupervised feature extraction applied to the gene expression and methylation profiles in the brains of social insects with multiple castes. BMC Bioinform., 19.","DOI":"10.1186\/s12859-018-2068-7"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1109\/TGRS.2006.885412","article-title":"Unsupervised Linear Feature-Extraction Methods and Their Effects in the Classification of High-Dimensional Data","volume":"45","year":"2007","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Fleming, M.K., and Cottrell, G.W. (1990, January 17\u201321). Categorization of faces using unsupervised feature extraction. Proceedings of the 1990 IJCNN International Joint Conference on Neural Networks, San Diego, CA, USA.","DOI":"10.1109\/IJCNN.1990.137696"},{"key":"ref_20","unstructured":"Fisher, J.W., and Principe, J.C. (1998, January 4\u20139). A methodology for information theoretic feature extraction. Proceedings of the 1998 IEEE International Joint Conference on Neural Networks, Anchorage, AK, USA."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"449","DOI":"10.1109\/TIP.2005.860593","article-title":"Unsupervised image-set clustering using an information theoretic framework","volume":"15","author":"Goldberger","year":"2006","journal-title":"IEEE Trans. Image Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1385","DOI":"10.1109\/TPAMI.2006.186","article-title":"Feature extraction using information-theoretic learning","volume":"28","author":"Hild","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_23","unstructured":"Shi, Y., and Sha, F. (July, January 26). Information-theoretical Learning of Discriminative Clusters for Unsupervised Domain Adaptation. Proceedings of the 29th International Conference on Machine Learning, Edinburgh, UK."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"412","DOI":"10.1162\/ARTL_a_00184","article-title":"The Search for Candidate Relevant Subsets of Variables in Complex Systems","volume":"21","author":"Villani","year":"2015","journal-title":"Artif. Life"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"5033","DOI":"10.1073\/pnas.91.11.5033","article-title":"A measure for brain complexity: Relating functional segregation and integration in the nervous system","volume":"91","author":"Tononi","year":"1994","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1006\/nimg.1997.0313","article-title":"Functional clustering: Identifying strongly interactive brain regions in neuroimaging data","volume":"7","author":"Tononi","year":"1998","journal-title":"Neuroimage"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Villani, M., Filisetti, A., Benedettini, S., Roli, A., Lane, D., and Serra, R. (2013). The detection of intermediate-level emergent structures and patterns. Artificial Life Conference Proceedings 13, The MIT Press.","DOI":"10.7551\/978-0-262-31709-2-ch054"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Pelillo, M., Poli, I., Roli, A., Serra, R., Slanzi, D., and Villani, M. (2018). A Relevance Index Method to Infer Global Properties of Biological Networks. Artificial Life and Evolutionary Computation, Springer.","DOI":"10.1007\/978-3-319-78658-2"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Sim, K., and Kaufmann, P. (2018). Social Relevance Index for Studying Communities in a Facebook Group of Patients. Applications of Evolutionary Computation, Springer.","DOI":"10.1007\/978-3-319-77538-8"},{"key":"ref_30","first-page":"482032","article-title":"Particle Swarm Optimization for Multimodal Functions: A Clustering Approach","volume":"2008","author":"Passaro","year":"2008","journal-title":"J. Artif. Evol. Appl."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Pelillo, M., Poli, I., Roli, A., Serra, R., Slanzi, D., and Villani, M. (2018). Searching Relevant Variable Subsets in Complex Systems Using K-Means PSO. Artificial Life and Evolutionary Computation, Springer.","DOI":"10.1007\/978-3-319-78658-2"},{"key":"ref_32","unstructured":"Cover, T.M., and Thomas, J.A. (2006). Elements of Information Theory (Wiley Series in Telecommunications and Signal Processing), Wiley-Interscience."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"60","DOI":"10.1214\/aoms\/1177732360","article-title":"The Large-Sample Distribution of the Likelihood Ratio for Testing Composite Hypotheses","volume":"9","author":"Wilks","year":"1938","journal-title":"Ann. Math. Stat."},{"key":"ref_34","unstructured":"Papoulis, A., and Pillai, S.U. (2015). Probability, Random Variables, and Stochastic Processes, McGraw-Hill."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1214\/aos\/1176347494","article-title":"Empirical Likelihood Ratio Confidence Regions","volume":"18","author":"Owen","year":"1990","journal-title":"Ann. Stat."},{"key":"ref_36","unstructured":"Bishop, C.M. (2006). Pattern Recognition And Machine Learning, Springer."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1007\/BF00116251","article-title":"Induction of decision trees","volume":"1","author":"Quinlan","year":"1986","journal-title":"Mach. Learn."},{"key":"ref_38","unstructured":"Greenwood, C., and Nikulin, M.S. (1996). A Guide to Chi-Squared Testing, Wiley."},{"key":"ref_39","unstructured":"Everitt, B. (1996). The Cambridge Dictionary of Statistics, Cambridge University Press."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random Forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_41","unstructured":"Quinlan, J.R. (1993). C4.5: Programs for Machine Learning, Morgan Kaufmann Publishers Inc."},{"key":"ref_42","unstructured":"(2019, August 06). CUDA Toolkit. Available online: http:\/\/developer.nvidia.com\/cuda-toolkit."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Kohonen, T. (2001). Self-Organizing Maps, Springer. [3rd ed.].","DOI":"10.1007\/978-3-642-56927-2"},{"key":"ref_44","unstructured":"Poli, R., Langdon, W.B., McPhee, N.F., and Koza, J.R. (2008). A Field Guide to Genetic Programming, Lulu Press."},{"key":"ref_45","unstructured":"Duda, R.O., Hart, P.E., and Stork, D.G. (2012). Pattern Classification, John Wiley & Sons."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Scholkopf, B., and Smola, A.J. (2001). Learning With Kernels: Support Vector Machines, Regularization, Optimization, and Beyond, MIT Press.","DOI":"10.7551\/mitpress\/4175.001.0001"}],"container-title":["Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-3197\/7\/3\/39\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:09:57Z","timestamp":1760188197000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-3197\/7\/3\/39"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,9]]},"references-count":46,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2019,9]]}},"alternative-id":["computation7030039"],"URL":"https:\/\/doi.org\/10.3390\/computation7030039","relation":{},"ISSN":["2079-3197"],"issn-type":[{"type":"electronic","value":"2079-3197"}],"subject":[],"published":{"date-parts":[[2019,8,9]]}}}