{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:49:41Z","timestamp":1760240981971,"version":"build-2065373602"},"reference-count":40,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2019,11,15]],"date-time":"2019-11-15T00:00:00Z","timestamp":1573776000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61971121, 61601112"],"award-info":[{"award-number":["61971121, 61601112"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Dimensionality reduction has always been a major problem for handling huge dimensionality datasets. Due to the utilization of labeled data, supervised dimensionality reduction methods such as Linear Discriminant Analysis tend achieve better classification performance compared with unsupervised methods. However, supervised methods need sufficient labeled data in order to achieve satisfying results. Therefore, semi-supervised learning (SSL) methods can be a practical selection rather than utilizing labeled data. In this paper, we develop a novel SSL method by extending anchor graph regularization (AGR) for dimensionality reduction. In detail, the AGR is an accelerating semi-supervised learning method to propagate the class labels to unlabeled data. However, it cannot handle new incoming samples. We thereby improve AGR by adding kernel regression on the basic objective function of AGR. Therefore, the proposed method can not only estimate the class labels of unlabeled data but also achieve dimensionality reduction. Extensive simulations on several benchmark datasets are conducted, and the simulation results verify the effectiveness for the proposed work.<\/jats:p>","DOI":"10.3390\/e21111125","type":"journal-article","created":{"date-parts":[[2019,11,15]],"date-time":"2019-11-15T11:25:56Z","timestamp":1573817156000},"page":"1125","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Sub-Graph Regularization on Kernel Regression for Robust Semi-Supervised Dimensionality Reduction"],"prefix":"10.3390","volume":"21","author":[{"given":"Jiao","family":"Liu","sequence":"first","affiliation":[{"name":"School of Management Studies, Shanghai University of Engineering Science, Shanghai 201600, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mingbo","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Donghua University, Shanghai 201620, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weijian","family":"Kong","sequence":"additional","affiliation":[{"name":"School of Information Science and Technology, Donghua University, Shanghai 201620, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,11,15]]},"reference":[{"key":"ref_1","unstructured":"Zhu, X., Ghahramani, Z., and Lafferty, J.D. (2003, January 21\u201324). Semi-supervised learning using gaussian fields and harmonic functions. Proceedings of the 20th International conference on Machine learning (ICML-03), Washington, DC, USA."},{"key":"ref_2","unstructured":"Zhou, D., Bousquet, O., Lal, T.N., Weston, J., and Scholkopf, B. (2004). Learning with local and global consistency. Advances in Neural Information Processing Systems, MIT."},{"key":"ref_3","first-page":"2399","article-title":"Manifold regularization: A geometric framework for learning from labeled and unlabeled samples","volume":"7","author":"Belkin","year":"2006","journal-title":"J. Mach. Learn. Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"549","DOI":"10.1007\/s00521-009-0305-8","article-title":"A general graph based semi-supervised learning with novel class discovery","volume":"19","author":"Nie","year":"2010","journal-title":"Neural Comput. Appl."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Cai, D., He, X., and Han, J. (2007, January 14\u201320). Semi-supervised discriminant analysis. Proceedings of the 2007 IEEE 11th International Conference on Computer Vision, Rio de Janeiro, Brazil.","DOI":"10.1109\/ICCV.2007.4408856"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1016\/j.cviu.2014.01.008","article-title":"Soft label based linear discriminant analysis for image recognition and retrieval","volume":"121","author":"Zhao","year":"2014","journal-title":"Comput. Image Underst."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/j.neunet.2014.03.005","article-title":"A general soft label based linear discriminant analysis for semi-supervised dimensionality reduction","volume":"55","author":"Zhao","year":"2014","journal-title":"Neural Netw."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1016\/j.ins.2015.06.021","article-title":"Learning from normalized local and global discriminative information for semi-supervised regression and dimensionality reduction","volume":"324","author":"Zhao","year":"2015","journal-title":"Inf. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.knosys.2014.12.014","article-title":"Automatic image annotation via compact graph based semi-supervised learning","volume":"76","author":"Zhao","year":"2015","journal-title":"Knowl.-Based Syst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1482","DOI":"10.1016\/j.patcog.2011.10.008","article-title":"Trace ratio criterion based generalized discriminative learning for semi-supervised dimensionality reduction","volume":"45","author":"Zhao","year":"2012","journal-title":"Pattern Recognit."},{"key":"ref_11","first-page":"1149","article-title":"Introduction to statistical pattern classification","volume":"30","author":"Fukunaga","year":"1990","journal-title":"Patt. Recognit."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Gao, Y., Ma, J., and Yuille, A.L. (2016). Semi-supervised sparse representation based classification for face recognition with insufficient labeled samples. arXiv.","DOI":"10.1109\/TIP.2017.2675341"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1007\/s11263-018-1117-z","article-title":"Locality Preserving Matching","volume":"127","author":"Ma","year":"2019","journal-title":"Int. J. Comput. Vis."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1501","DOI":"10.1007\/s11263-019-01195-z","article-title":"Estimation of 3D Category-Specific Object Structure: Symmetry, Manhattan and\/or Multiple Images","volume":"127","author":"Gao","year":"2019","journal-title":"Int. J. Comput. Vis."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2319","DOI":"10.1126\/science.290.5500.2319","article-title":"A global geometric framework for nonlinear dimensionality reduction","volume":"290","author":"Tenenbaum","year":"2000","journal-title":"Science"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2323","DOI":"10.1126\/science.290.5500.2323","article-title":"Nonlinear dimensionality reduction by locally linear embedding","volume":"290","author":"Roweis","year":"2000","journal-title":"Science"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1109\/TPAMI.2005.55","article-title":"Face recognition using Laplacianfaces","volume":"27","author":"He","year":"2005","journal-title":"IEEE Trans. Pattern Anal. Mach."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1109\/TKDE.2007.190672","article-title":"Label propagation through linear neighborhoods","volume":"20","author":"Wang","year":"2008","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1600","DOI":"10.1109\/TPAMI.2008.216","article-title":"Linear neighborhood propagation and its applications","volume":"31","author":"Wang","year":"2009","journal-title":"IEEE Trans. Pattern Anal. Machine Intell."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"723","DOI":"10.1109\/TPAMI.2011.170","article-title":"A multimedia retrieval framework based on semi-supervised ranking and relevance feedback","volume":"34","author":"Yang","year":"2012","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2039","DOI":"10.1109\/TPAMI.2010.35","article-title":"Semi-supervised classification via local spline regression","volume":"32","author":"Xiang","year":"2010","journal-title":"IEEE Trans. Pattern Anal. Mach."},{"key":"ref_22","unstructured":"Liu, W., He, J., and Chang, S.-F. (2010, January 21\u201324). Large graph construction for scalable semi-supervised learning. Proceedings of the 27th international conference on machine learning (ICML-10), Haifa, Israel."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2624","DOI":"10.1109\/JPROC.2012.2197809","article-title":"Robust and scalable graph-based semisupervised learning","volume":"100","author":"Liu","year":"2012","journal-title":"Proc. IEEE"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1864","DOI":"10.1109\/TKDE.2016.2535367","article-title":"Scalable semi-supervised learning by efficient anchor graph regularization","volume":"28","author":"Wang","year":"2016","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_25","unstructured":"Fu, W., Wang, M., Hao, S., and Mu, T. (2017). Flag: Faster learning on anchor graph with label predictor optimization. IEEE Trans. Big Data."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1101","DOI":"10.1109\/TKDE.2017.2654445","article-title":"Learning on big graph: Label inference and regularization with anchor hierarchy","volume":"29","author":"Wang","year":"2017","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_27","unstructured":"Von Neumann, J. (1950). Functional Operators: Measures and Integrals, Princeton University Press."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Liu, W., and Chang, S.-F. (2009, January 20\u201325). Robust multi-class transductive learning with graphs. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.","DOI":"10.1109\/CVPR.2009.5206871"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhao, X., Wang, D., Zhang, X., Gu, N., and Ye, X. (2019). Semi-supervised learning based on coupled graph laplacian regularization. Proceedings of the 2018 Chinese Intelligent Systems Conference, Springer.","DOI":"10.1007\/978-981-13-2288-4_14"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1109\/34.927464","article-title":"From few to many: Illumination cone models for face recognition under variable lighting and pose","volume":"23","author":"Georghiades","year":"2001","journal-title":"IEEE Trans. Pattern Anal. Mach."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1615","DOI":"10.1109\/TPAMI.2003.1251154","article-title":"The CMU pose, illumination, and expression database","volume":"25","author":"Baker","year":"2003","journal-title":"IEEE Trans. Pattern Anal. Mach."},{"key":"ref_32","unstructured":"Nene, S.A., Nayar, S.K., and Murase, H. (1996). Columbia Object Image Library (COIL-100), Columbia University. Technical Report CUCS-005-96."},{"key":"ref_33","unstructured":"Leibe, B., and Schiele, B. (2003, January 18\u201320). Analyzing appearance and contour based methods for object categorization. Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, WI, USA."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"550","DOI":"10.1109\/34.291440","article-title":"A database for handwritten text recognition research","volume":"16","author":"Hull","year":"1994","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Liu, C.-L., Yin, F., Wang, D.-H., and Wang, Q.-F. (2011, January 18\u201321). CASIA online and offline chinese handwriting databases. Proceedings of the 2011 International Conference on Document Analysis and Recognition.","DOI":"10.1109\/ICDAR.2011.17"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"420","DOI":"10.1109\/TNN.2010.2099237","article-title":"Semisupervised learning using negative labels","volume":"22","author":"Hou","year":"2011","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Rodriguez, M.Z., Comin, C.H., Casanova, D., Bruno, O.M., Amancio, D.R., Costa, L.D.F., Rodrigues, F.A., and Kestler, H.A. (2019). Clustering algorithms: A comparative approach. PLoS ONE, 14.","DOI":"10.1371\/journal.pone.0210236"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"2027","DOI":"10.1109\/TPAMI.2019.2906603","article-title":"Social anchor unit graph regularized tensor completion for large scale image retagging","volume":"41","author":"Tang","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"68001","DOI":"10.1209\/0295-5075\/110\/68001","article-title":"Concentric network symmetry grasps authors\u2019 styles in word adjacency networks","volume":"110","author":"Amancio","year":"2015","journal-title":"EPL (Europhys. Lett.)"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Koplenig, A., and Wolfer, S. (2019). Studying lexical dynamics and language change via generalized entropies: The problem of sample size. Entropy, 21.","DOI":"10.3390\/e21050464"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/11\/1125\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:34:54Z","timestamp":1760189694000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/11\/1125"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,15]]},"references-count":40,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2019,11]]}},"alternative-id":["e21111125"],"URL":"https:\/\/doi.org\/10.3390\/e21111125","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2019,11,15]]}}}