{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T06:50:57Z","timestamp":1777704657710,"version":"3.51.4"},"reference-count":37,"publisher":"SAGE Publications","issue":"5","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["IFS"],"published-print":{"date-parts":[[2021,4,22]]},"abstract":"<jats:p>Tensor data are becoming more and more common in machine learning. Compared with vector data, the curse of dimensionality of tensor data is more serious. The motivation of this paper is to combine Hilbert-Schmidt Independence Criterion (HSIC) and tensor algebra to create a new dimensionality reduction algorithm for tensor data. There are three contributions in this paper. (1) An HSIC-based algorithm is proposed in which the dimension-reduced tensor is determined by maximizing HSIC between the dimension-reduced and high-dimensional tensors. (2) A tensor algebra-based algorithm is proposed, in which the high-dimensional tensor are projected onto a subspace and the projection coordinate is set to be the dimension-reduced tensor. The subspace is determined by minimizing the distance between the high-dimensional tensor data and their projection in the subspace. (3) By combining the above two algorithms, a new dimensionality reduction algorithm, called PDMHSIC, is proposed, in which the dimensionality reduction must satisfy two criteria at the same time: HSIC maximization and subspace projection distance minimization. The proposed algorithm is a new attempt to combine HSIC with other algorithms to create new algorithms and has achieved better experimental results on 8 commonly-used datasets than the other 7 well-known algorithms.<\/jats:p>","DOI":"10.3233\/jifs-202582","type":"journal-article","created":{"date-parts":[[2021,3,5]],"date-time":"2021-03-05T12:39:24Z","timestamp":1614947964000},"page":"10307-10322","source":"Crossref","is-referenced-by-count":0,"title":["Dimensionality reduction for tensor data based on projection distance minimization and hilbert-schmidt independence criterion maximization1"],"prefix":"10.1177","volume":"40","author":[{"given":"Weichao","family":"Gan","sequence":"first","affiliation":[{"name":"School of Electronics and Information Technology, Sun Yat-sen University, Guangzhou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zhengming","family":"Ma","sequence":"additional","affiliation":[{"name":"School of Electronics and Information Technology, Sun Yat-sen University, Guangzhou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shuyu","family":"Liu","sequence":"additional","affiliation":[{"name":"Public Experimental Teaching Center, Sun Yat-sen University, Guangzhou, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","reference":[{"issue":"3","key":"10.3233\/JIFS-202582_ref1","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1137\/07070111X","article-title":"Tensor decompositions and applications","volume":"51","author":"Kolda","year":"2009","journal-title":"SIAM Rev"},{"issue":"5","key":"10.3233\/JIFS-202582_ref2","doi-asserted-by":"crossref","first-page":"1299","DOI":"10.1162\/089976698300017467","article-title":"Nonlinear component analysis as a kernel eigenvalue problem","volume":"10","author":"Sch\u00f6lkopf","year":"1998","journal-title":"Neural Comput"},{"issue":"5","key":"10.3233\/JIFS-202582_ref5","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1109\/TNN.2009.2014229","article-title":"Building sparse multiplekernel SVM classifiers","volume":"20","author":"Hu","year":"2009","journal-title":"IEEE Trans Neural Netw"},{"key":"10.3233\/JIFS-202582_ref6","doi-asserted-by":"crossref","unstructured":"Shawe-Taylor J. and Cristianini N. , Kernel Methods for Pattern Analysis, Cambridge, U.K.: Cambridge Univ. Press, (2004).","DOI":"10.1017\/CBO9780511809682"},{"key":"10.3233\/JIFS-202582_ref7","unstructured":"Hein M. and Bousquet O. , Kernels, associated structures and generalizations, Max-Planck-Inst Biologische Kybernetik T\u00fcbingen Germany Tech Rep 127 (2004)."},{"key":"10.3233\/JIFS-202582_ref8","unstructured":"Mood A.M. , Introduction to the Theory of Statistics, New York, NY, USA: McGraw-Hill, (1950)."},{"issue":"12","key":"10.3233\/JIFS-202582_ref9","doi-asserted-by":"crossref","first-page":"2162","DOI":"10.1109\/TPAMI.2010.43","article-title":"3D face recognition using is geodesic stripes","volume":"32","author":"Berretti","year":"2010","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"10.3233\/JIFS-202582_ref10","first-page":"1","article-title":"A novel approach based on high order tensor and multi-scale locals features for 3D face recognition[C]\/\/","volume":"2018","author":"Bessaoudi","journal-title":"2018 4th International Conference on Advanced Technologies for Signal and Image Processing (ATSIP). IEEE"},{"issue":"10","key":"10.3233\/JIFS-202582_ref11","doi-asserted-by":"crossref","first-page":"4882","DOI":"10.1109\/TNNLS.2017.2783384","article-title":"Local regression and global information-embedded dimension reduction[J]","volume":"29","author":"Yao","year":"2018","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"issue":"5","key":"10.3233\/JIFS-202582_ref12","doi-asserted-by":"crossref","first-page":"2420","DOI":"10.1109\/TIP.2018.2804218","article-title":"Local deep-feature alignment for unsupervised dimension reduction[J]","volume":"27","author":"Zhang","year":"2018","journal-title":"IEEE Transactions on Image Processing"},{"key":"10.3233\/JIFS-202582_ref13","doi-asserted-by":"crossref","unstructured":"Voulodimos A. , Doulamis N. , Doulamis A. et al., Deep learning for computer vision: A brief review[J], Computational intelligence and neuroscience 2018, 2018.","DOI":"10.1155\/2018\/7068349"},{"key":"10.3233\/JIFS-202582_ref14","doi-asserted-by":"crossref","first-page":"436","DOI":"10.1038\/nature14539","article-title":"Deep learning","volume":"521","author":"LeCun","year":"2015","journal-title":"Nature"},{"issue":"1","key":"10.3233\/JIFS-202582_ref15","first-page":"3297","article-title":"Human gesture recognition on product manifolds","volume":"13","author":"Lui","year":"2012","journal-title":"J Mach Learn Res"},{"key":"10.3233\/JIFS-202582_ref16","doi-asserted-by":"crossref","first-page":"633","DOI":"10.1016\/j.cma.2017.03.037","article-title":"A framework for datadriven analysis of materials under uncertainty: Countering the curse of dimensionality[J]","volume":"320","author":"Bessa","year":"2017","journal-title":"Computer Methods in Applied Mechanics and Engineering"},{"issue":"1","key":"10.3233\/JIFS-202582_ref18","doi-asserted-by":"crossref","first-page":"172","DOI":"10.1109\/TPAMI.2016.2539944","article-title":"Semi-supervised tensor-based graph embedding learning and its application to visual discriminant tracking[J]","volume":"39","author":"Hu","year":"2016","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"3","key":"10.3233\/JIFS-202582_ref19","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1109\/TPAMI.2013.164","article-title":"Simultaneous tensor decomposition and completion using factor priors","volume":"36","author":"Chen","year":"2014","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"2","key":"10.3233\/JIFS-202582_ref20","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1109\/LGRS.2017.2786223","article-title":"Modified tensor locality preserving projection for dimensionality reduction of hyperspectral images[J]","volume":"15","author":"Deng","year":"2018","journal-title":"IEEE Geoscience and Remote Sensing Letters"},{"issue":"12","key":"10.3233\/JIFS-202582_ref21","doi-asserted-by":"crossref","first-page":"1485","DOI":"10.3390\/rs11121485","article-title":"Tensor Based Multiscale Low Rank Decomposition for Hyperspectral Images Dimensionality Reduction[J]","volume":"11","author":"An","year":"2019","journal-title":"Remote Sensing"},{"issue":"12","key":"10.3233\/JIFS-202582_ref22","doi-asserted-by":"crossref","first-page":"7183","DOI":"10.1109\/TGRS.2018.2849085","article-title":"Tensor low-rank discriminant embedding for hyperspectral image dimensionality reduction[J]","volume":"56","author":"Deng","year":"2018","journal-title":"IEEE Transactions on Geoscience and Remote Sensing"},{"issue":"5","key":"10.3233\/JIFS-202582_ref23","doi-asserted-by":"crossref","first-page":"452","DOI":"10.3390\/rs9050452","article-title":"Hyperspectral dimensionality reduction by tensor sparse and low-rank graph-based discriminant analysis[J]","volume":"9","author":"Pan","year":"2017","journal-title":"Remote Sensing"},{"issue":"1\u20133","key":"10.3233\/JIFS-202582_ref25","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1023\/A:1023709501986","article-title":"A framework for robust subspace learning[J]","volume":"54","author":"De La Torre","year":"2003","journal-title":"International Journal of Computer Vision"},{"key":"10.3233\/JIFS-202582_ref26","first-page":"63","article-title":"Measuring statistical dependence with Hilbert-Schmidt norms[C]\/\/","volume":"2005","author":"Gretton","journal-title":"International conference on algorithmic learning theory. Springer, Berlin, Heidelberg"},{"issue":"8","key":"10.3233\/JIFS-202582_ref27","first-page":"1548","article-title":"Graph regularized nonnegative matrix factorization for data representation[J]","volume":"33","author":"Cai","year":"2010","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"7","key":"10.3233\/JIFS-202582_ref28","doi-asserted-by":"crossref","first-page":"1717","DOI":"10.1109\/TPAMI.2012.274","article-title":"Low-rank matrix approximation with manifold regularization[J]","volume":"35","author":"Zhang","year":"2012","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"3","key":"10.3233\/JIFS-202582_ref29","doi-asserted-by":"crossref","first-page":"476","DOI":"10.1109\/TPAMI.2015.2465901","article-title":"Heterogeneous tensor decomposition for clustering via manifold optimization[J]","volume":"38","author":"Sun","year":"2015","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"issue":"8","key":"10.3233\/JIFS-202582_ref30","doi-asserted-by":"crossref","first-page":"1787","DOI":"10.1109\/TNNLS.2016.2545400","article-title":"MR-NTD: Manifold regularization nonnegative tucker decomposition for tensor data dimension reduction and representation[J]","volume":"28","author":"Li","year":"2016","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"issue":"3","key":"10.3233\/JIFS-202582_ref31","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1109\/LSP.2017.2748604","article-title":"Low-Rank Regularized Heterogeneous Tensor Decomposition for Subspace Clustering[J]","volume":"25","author":"Zhang","year":"2018","journal-title":"IEEE Signal Processing Letters"},{"issue":"4","key":"10.3233\/JIFS-202582_ref32","doi-asserted-by":"crossref","first-page":"1417","DOI":"10.1109\/TCYB.2018.2802934","article-title":"Image representation and learning with graph-laplacian tucker tensor decomposition[J]","volume":"49","author":"Jiang","year":"2018","journal-title":"IEEE Transactions on Cybernetics"},{"issue":"8","key":"10.3233\/JIFS-202582_ref33","doi-asserted-by":"crossref","first-page":"1341","DOI":"10.1109\/JPROC.2018.2848209","article-title":"Extension of PCA to higher order data structures: An introduction to tensors, tensor decompositions, and tensor PCA[J]","volume":"106","author":"Zare","year":"2018","journal-title":"Proceedings of the IEEE"},{"issue":"10","key":"10.3233\/JIFS-202582_ref34","doi-asserted-by":"crossref","first-page":"1497","DOI":"10.1109\/LGRS.2016.2593789","article-title":"Dimensionality reduction based on group-based tensor model for hyperspectral image classification[J]","volume":"13","author":"An","year":"2016","journal-title":"IEEE Geoscience and Remote Sensing Letters"},{"key":"10.3233\/JIFS-202582_ref35","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1109\/TIP.2020.3034498","article-title":"Dimensionality Reduction for Tensor Data Based on Local Decision Margin Maximization[J]","volume":"30","author":"Zhang","year":"2020","journal-title":"IEEE Transactions on Image Processing"},{"key":"10.3233\/JIFS-202582_ref36","first-page":"8613","article-title":"Graph Regularized Nonnegative Tucker Decomposition for Tensor Data Representation[C]\/\/","volume":"2019","author":"Qiu","journal-title":"ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE"},{"key":"10.3233\/JIFS-202582_ref38","first-page":"1","article-title":"Nonlinear Dimensionality Reduction Based on HSIC Maximization[J]","volume":"2018","author":"Ma","journal-title":"IEEE Access"},{"issue":"1","key":"10.3233\/JIFS-202582_ref39","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1007\/BF01385798","article-title":"Eigenvalues of Rayleigh quotient matrices[J]","volume":"59","author":"Sun","year":"1991","journal-title":"Numerische Mathematik"},{"issue":"Preprint","key":"10.3233\/JIFS-202582_ref40","first-page":"1","article-title":"Dimensionality reduction of tensor based on subspace learning and local homeomorphism[J]","volume":"2020","author":"Zhang","journal-title":"Journal of Intelligent & Fuzzy Systems"},{"key":"10.3233\/JIFS-202582_ref41","doi-asserted-by":"crossref","first-page":"193593","DOI":"10.1109\/ACCESS.2020.3032346","article-title":"Maximum Discriminant Difference Criterion for Dimensionality Reduction of Tensor Data[J]","volume":"8","author":"Peng","year":"2020","journal-title":"IEEE Access"},{"key":"10.3233\/JIFS-202582_ref42","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1109\/TIP.2020.3034498","article-title":"Dimensionality Reduction for Tensor Data Based on Local Decision Margin Maximization[J]","volume":"30","author":"Zhang","year":"2020","journal-title":"IEEE Transactions on Image Processing"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"link":[{"URL":"https:\/\/content.iospress.com\/download?id=10.3233\/JIFS-202582","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:41:43Z","timestamp":1777455703000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/full\/10.3233\/JIFS-202582"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,22]]},"references-count":37,"journal-issue":{"issue":"5"},"URL":"https:\/\/doi.org\/10.3233\/jifs-202582","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4,22]]}}}