{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T05:08:17Z","timestamp":1789967297423,"version":"4.0.1"},"reference-count":50,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T00:00:00Z","timestamp":1789516800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100009102","name":"Education Department of Jiangxi Province","doi-asserted-by":"publisher","award":["YC2025-S759"],"award-info":[{"award-number":["YC2025-S759"]}],"id":[{"id":"10.13039\/501100009102","id-type":"DOI","asserted-by":"publisher"}]},{"award":["YC2025-S759"],"award-info":[{"award-number":["YC2025-S759"]}],"id":[{"id":"https:\/\/ror.org\/04d8xwh61","id-type":"ROR","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100010857","name":"Jiangxi Provincial Department of Science and Technology","doi-asserted-by":"publisher","award":["20242BAB26024"],"award-info":[{"award-number":["20242BAB26024"]}],"id":[{"id":"10.13039\/501100010857","id-type":"DOI","asserted-by":"publisher"}]},{"award":["20242BAB26024"],"award-info":[{"award-number":["20242BAB26024"]}],"id":[{"id":"https:\/\/ror.org\/00t30yz20","id-type":"ROR","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62666004"],"award-info":[{"award-number":["62666004"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"award":["62666004"],"award-info":[{"award-number":["62666004"]}],"id":[{"id":"https:\/\/ror.org\/01h0zpd94","id-type":"ROR","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Unsupervised feature selection is essential for high-dimensional data analysis, where irrelevant and redundant variables may obscure the intrinsic data structure, reduce interpretability, and degrade downstream learning performance. The key challenge is to identify informative features without label supervision while suppressing redundant selections under nonlinear dependencies. To address this issue, this paper proposes an unsupervised Hilbert\u2013Schmidt Independence Criterion (HSIC)\u2013Elastic Net (ENet) feature selection framework, termed U-HSIC-ENet. The proposed method reformulates unlabeled feature weighting as a self-supervised kernel alignment problem. Specifically, a target kernel is constructed directly from unlabeled data to encode global sample relationships, while each feature is represented by a centered and Frobenius-normalized feature-induced kernel. Feature relevance is then measured by centered kernel alignment (CKA) in a reproducing kernel Hilbert space (RKHS). The main novelty of U-HSIC-ENet lies in a unified relevance\u2013redundancy\u2013stability formulation. Feature\u2013target alignment is used to estimate nonlinear relevance, whereas pairwise similarities between feature-induced kernels are used to characterize inter-feature redundancy in the same kernel alignment space. On this basis, an explicit off-diagonal redundancy penalty is incorporated into a nonnegative Elastic Net-type objective, which strengthens the suppression of co-selected similar features while preserving sparse and stable feature weighting. The resulting quadratic formulation clarifies how relevance promotion, redundancy control, sparsity, and numerical stabilization are coupled within a single optimization framework. Experiments on eight benchmark datasets under a fixed-budget evaluation protocol show that U-HSIC-ENet achieves the strongest average performance on Normalized Mutual Information (NMI), the Adjusted Rand Index (ARI), and clustering accuracy (ACC) compared with representative graph-, spectral-, and HSIC-based baselines. The advantage is the most pronounced on NMI, suggesting that the self-supervised target kernel and CKA-based relevance modeling are effective in preserving the clustering-relevant nonlinear structure. Friedman tests and Wilcoxon signed-rank tests with Holm correction provide statistical support for the observed improvements. Subsampling-based stability evaluation reveals a trade-off between clustering effectiveness and selection reproducibility: several baselines achieve higher stability scores despite the stronger average clustering performance of U-HSIC-ENet. These results indicate that the proposed framework is effective for unsupervised nonlinear feature weighting when relevance estimation, redundancy control, and stability are considered jointly.<\/jats:p>","DOI":"10.3390\/e28091027","type":"journal-article","created":{"date-parts":[[2026,9,16]],"date-time":"2026-09-16T16:07:29Z","timestamp":1789574849000},"page":"1027","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Unsupervised Feature Selection via Self-Supervised HSIC and Elastic Net Regularization"],"prefix":"10.3390","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-8048-0604","authenticated-orcid":false,"given":"Yuhong","family":"Chen","sequence":"first","affiliation":[{"name":"Key Laboratory of Data Science and Artificial Intelligence of Jiangxi Education Institutes, Gannan Normal University, Ganzhou 341000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2484-6719","authenticated-orcid":false,"given":"Tinghua","family":"Wang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Data Science and Artificial Intelligence of Jiangxi Education Institutes, Gannan Normal University, Ganzhou 341000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Long","family":"Zou","sequence":"additional","affiliation":[{"name":"Key Laboratory of Data Science and Artificial Intelligence of Jiangxi Education Institutes, Gannan Normal University, Ganzhou 341000, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,9,16]]},"reference":[{"key":"ref_1","first-page":"1157","article-title":"An introduction to variable and feature selection","volume":"3","author":"Guyon","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_2","first-page":"94","article-title":"Feature selection: A data perspective","volume":"50","author":"Li","year":"2017","journal-title":"ACM Comput. Surv."},{"key":"ref_3","first-page":"845","article-title":"Feature selection for unsupervised learning","volume":"5","author":"Dy","year":"2004","journal-title":"J. Mach. Learn. Res."},{"key":"ref_4","unstructured":"He, X., Cai, D., and Niyogi, P. (2005, January 5\u20138). Laplacian score for feature selection. Proceedings of the 18th International Conference on Neural Information Processing Systems (NIPS 2005), Vancouver, BC, Canada."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Zhao, Z., and Liu, H. (2007, January 20\u201324). Spectral feature selection for supervised and unsupervised learning. Proceedings of the 24th International Conference on Machine Learning (ICML 2007), Corvallis, OR, USA.","DOI":"10.1145\/1273496.1273641"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Cai, D., Zhang, C., and He, X. (2010, January 25\u201328). Unsupervised feature selection for multi-cluster data. Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Washington, DC, USA.","DOI":"10.1145\/1835804.1835848"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Yan, Z., Ma, Z., Ma, J., and Li, H. (2025). Robust unsupervised feature selection algorithm based on fuzzy anchor graph. Entropy, 27.","DOI":"10.3390\/e27080827"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Gretton, A., Bousquet, O., Smola, A., and Sch\u00f6lkopf, B. (2005, January 8\u201311). Measuring statistical dependence with Hilbert\u2013Schmidt norms. Proceedings of the 16th International Conference on Algorithmic Learning Theory (ALT 2005), Singapore.","DOI":"10.1007\/11564089_7"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"107567","DOI":"10.1016\/j.knosys.2021.107567","article-title":"Learning with Hilbert\u2013Schmidt independence criterion: A review and new perspectives","volume":"234","author":"Wang","year":"2021","journal-title":"Knowl.-Based Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1162\/NECO_a_00537","article-title":"High-dimensional feature selection by feature-wise kernelized Lasso","volume":"26","author":"Yamada","year":"2014","journal-title":"Neural Comput."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"3703","DOI":"10.1109\/TFUZZ.2018.2848224","article-title":"Two-stage fuzzy multiple kernel learning based on Hilbert\u2013Schmidt independence criterion","volume":"26","author":"Wang","year":"2018","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"109703","DOI":"10.1016\/j.fss.2025.109703","article-title":"Dually feature-weighted fuzzy SVM based on HSIC LASSO","volume":"528","author":"Wang","year":"2026","journal-title":"Fuzzy Sets Syst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"115934","DOI":"10.1016\/j.knosys.2026.115934","article-title":"A survey on Hilbert\u2013Schmidt independence criterion Lasso","volume":"342","author":"Wang","year":"2026","journal-title":"Knowl.-Based Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"537","DOI":"10.1109\/72.298224","article-title":"Using mutual information for selecting features in supervised neural net learning","volume":"5","author":"Battiti","year":"1994","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_15","first-page":"1205","article-title":"Efficient feature selection via analysis of relevance and redundancy","volume":"5","author":"Yu","year":"2004","journal-title":"J. Mach. Learn. Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1226","DOI":"10.1109\/TPAMI.2005.159","article-title":"Feature selection based on mutual information: Criteria of max-dependency, max-relevance, and min-redundancy","volume":"27","author":"Peng","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_17","first-page":"27","article-title":"Conditional likelihood maximisation: A unifying framework for information theoretic feature selection","volume":"13","author":"Brown","year":"2012","journal-title":"J. Mach. Learn. Res."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1111\/j.1467-9868.2005.00503.x","article-title":"Regularization and variable selection via the elastic net","volume":"67","author":"Zou","year":"2005","journal-title":"J. R. Stat. Soc. Ser. B Stat. Methodol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1111\/j.1467-9868.2011.01034.x","article-title":"Variable selection with error control: Another look at stability selection","volume":"75","author":"Shah","year":"2013","journal-title":"J. R. Stat. Soc. Ser. B Stat. Methodol."},{"key":"ref_20","first-page":"1","article-title":"On the stability of feature selection algorithms","volume":"18","author":"Nogueira","year":"2018","journal-title":"J. Mach. Learn. Res."},{"key":"ref_21","first-page":"795","article-title":"Algorithms for learning kernels based on centered alignment","volume":"13","author":"Cortes","year":"2012","journal-title":"J. Mach. Learn. Res."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1007\/s10462-012-9369-4","article-title":"An overview of kernel alignment and its applications","volume":"43","author":"Wang","year":"2015","journal-title":"Artif. Intell. Rev."},{"key":"ref_23","unstructured":"Kornblith, S., Norouzi, M., Lee, H., and Hinton, G. (2019, January 9\u201315). Similarity of neural network representations revisited. Proceedings of the 36th International Conference on Machine Learning (ICML 2019), Long Beach, CA, USA. Proceedings of Machine Learning Research."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1016\/j.fss.2019.09.017","article-title":"Centered kernel alignment inspired fuzzy support vector machine","volume":"394","author":"Wang","year":"2020","journal-title":"Fuzzy Sets Syst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"861","DOI":"10.21105\/joss.00861","article-title":"UMAP: Uniform manifold approximation and projection","volume":"3","author":"McInnes","year":"2018","journal-title":"J. Open Source Softw."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"124502","DOI":"10.1016\/j.eswa.2024.124502","article-title":"Multi-cluster nonlinear unsupervised feature selection via joint manifold learning and generalized Lasso","volume":"255","author":"Wang","year":"2024","journal-title":"Expert Syst. Appl."},{"key":"ref_27","first-page":"4182","article-title":"Unsupervised nonlinear feature selection from high-dimensional signed networks","volume":"34","author":"Huang","year":"2020","journal-title":"Proc. AAAI Conf. Artif. Intell."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"103544","DOI":"10.1016\/j.inffus.2025.103544","article-title":"Unsupervised feature selection via unifying distribution alignment and structure preservation","volume":"126","author":"Cao","year":"2026","journal-title":"Inf. Fusion"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"104807","DOI":"10.1016\/j.chemolab.2023.104807","article-title":"A unified view of feature selection based on Hilbert\u2013Schmidt independence criterion","volume":"236","author":"Wang","year":"2023","journal-title":"Chemom. Intell. Lab. Syst."},{"key":"ref_30","first-page":"2399","article-title":"Manifold regularization: A geometric framework for learning from labeled and unlabeled examples","volume":"7","author":"Belkin","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"111523","DOI":"10.1016\/j.knosys.2024.111523","article-title":"GAEFS: Self-supervised graph auto-encoder enhanced feature selection","volume":"290","author":"Tan","year":"2024","journal-title":"Knowl.-Based Syst."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Li, N., Peng, M., and Wu, Q. (2023). Multiview data clustering with similarity graph learning guided unsupervised feature selection. Entropy, 25.","DOI":"10.3390\/e25121606"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Zhang, B., and Suzuki, J. (2023). Extending Hilbert\u2013Schmidt independence criterion for testing conditional independence. Entropy, 25.","DOI":"10.3390\/e25030425"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Fan, K., Subedi, S., Yang, G., Lu, X., Ren, J., and Wu, C. (2024). Is Seeing Believing? A Practitioner\u2019s Perspective on High-Dimensional Statistical Inference in Cancer Genomics Studies. Entropy, 26.","DOI":"10.3390\/e26090794"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"108358","DOI":"10.1016\/j.csda.2026.108358","article-title":"Robust Bayesian high-dimensional variable selection and inference with the horseshoe family of priors","volume":"219","author":"Fan","year":"2026","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1137\/080716542","article-title":"A fast iterative shrinkage-thresholding algorithm for linear inverse problems","volume":"2","author":"Beck","year":"2009","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1561\/2400000003","article-title":"Proximal algorithms","volume":"1","author":"Parikh","year":"2014","journal-title":"Found. Trends Optim."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2385","DOI":"10.1109\/TGRS.2016.2642479","article-title":"Sparse Hilbert Schmidt independence criterion and surrogate-kernel-based feature selection for hyperspectral image classification","volume":"55","author":"Damodaran","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1352","DOI":"10.1109\/TKDE.2018.2789451","article-title":"Ultra high-dimensional nonlinear feature selection for big biological data","volume":"30","author":"Yamada","year":"2018","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"i427","DOI":"10.1093\/bioinformatics\/btz333","article-title":"Block HSIC Lasso: Model-free biomarker detection for ultra-high dimensional data","volume":"35","author":"Azencott","year":"2019","journal-title":"Bioinformatics"},{"key":"ref_41","first-page":"2837","article-title":"Information theoretic measures for clusterings comparison: Variants, properties, normalization and correction for chance","volume":"11","author":"Vinh","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1007\/BF01908075","article-title":"Comparing partitions","volume":"2","author":"Hubert","year":"1985","journal-title":"J. Classif."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1002\/nav.3800020109","article-title":"The Hungarian method for the assignment problem","volume":"2","author":"Kuhn","year":"1955","journal-title":"Nav. Res. Logist. Q."},{"key":"ref_44","first-page":"1","article-title":"Statistical comparisons of classifiers over multiple data sets","volume":"7","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"ref_45","first-page":"2677","article-title":"An extension on \u201cStatistical comparisons of classifiers over multiple data sets\u201d for all pairwise comparisons","volume":"9","author":"Herrera","year":"2008","journal-title":"J. Mach. Learn. Res."},{"key":"ref_46","first-page":"65","article-title":"A simple sequentially rejective multiple test procedure","volume":"6","author":"Holm","year":"1979","journal-title":"Scand. J. Stat."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1111\/j.1469-8137.1912.tb05611.x","article-title":"The distribution of the flora in the alpine zone","volume":"11","author":"Jaccard","year":"1912","journal-title":"New Phytol."},{"key":"ref_48","unstructured":"Kuncheva, L.I. (2007, January 12\u201314). A stability index for feature selection. Proceedings of the IASTED International Conference on Artificial Intelligence and Applications (AIA 2007), Innsbruck, Austria."},{"key":"ref_49","unstructured":"Nogueira, S., Sechidis, K., and Brown, G. (2017, January 20\u201323). On the use of Spearman\u2019s rho to measure the stability of feature rankings. Proceedings of the 8th Iberian Conference on Pattern Recognition and Image Analysis (IbPRIA 2017), Faro, Portugal."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Daniu\u0161is, P., Juneja, S., Kuzma, L., and Marcinkevi\u010dius, V. (2025). Measuring statistical dependence via characteristic function IPM. Entropy, 27.","DOI":"10.3390\/e27121254"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/28\/9\/1027\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T04:39:31Z","timestamp":1789965571000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/28\/9\/1027"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,16]]},"references-count":50,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2026,9]]}},"alternative-id":["e28091027"],"URL":"https:\/\/doi.org\/10.3390\/e28091027","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,16]]}}}