{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,24]],"date-time":"2025-12-24T14:54:32Z","timestamp":1766588072563,"version":"build-2065373602"},"reference-count":46,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2025,3,13]],"date-time":"2025-03-13T00:00:00Z","timestamp":1741824000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62204044","SKLICS-K202302"],"award-info":[{"award-number":["62204044","SKLICS-K202302"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"State Key Laboratory of Integrated Chips and Systems","award":["62204044","SKLICS-K202302"],"award-info":[{"award-number":["62204044","SKLICS-K202302"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>In the field of video image processing, high definition is one of the main directions for future development. Faced with the curse of dimensionality caused by the increasingly large amount of ultra-high-definition video data, effective dimensionality reduction techniques have become increasingly important. Linear discriminant analysis (LDA) is a supervised learning dimensionality reduction technique that has been widely used in data preprocessing for dimensionality reduction and video image processing tasks. However, traditional LDA methods are not suitable for the dimensionality reduction and processing of small high-dimensional samples. In order to improve the accuracy and robustness of linear discriminant analysis, this paper proposes a new distributed sparse manifold constraint (DSC) optimization LDA method, called DSCLDA, which introduces L2,0-norm regularization for local sparse feature representation and manifold regularization for global feature constraints. By iterating the hard threshold operator and transforming the original problem into an approximate non-convex sparse optimization problem, the manifold proximal gradient (ManPG) method is used as a distributed iterative solution. Each step of the algorithm has an explicit solution. Simulation experiments have verified the correctness and effectiveness of this method. Compared with several advanced sparse linear discriminant analysis methods, this method effectively improves the average classification accuracy by at least 0.90%.<\/jats:p>","DOI":"10.3390\/jimaging11030081","type":"journal-article","created":{"date-parts":[[2025,3,13]],"date-time":"2025-03-13T10:16:45Z","timestamp":1741861005000},"page":"81","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Distributed Sparse Manifold-Constrained Optimization Algorithm in Linear Discriminant Analysis"],"prefix":"10.3390","volume":"11","author":[{"given":"Yuhao","family":"Zhang","sequence":"first","affiliation":[{"name":"State Key Laboratory of Integrated Chips and Systems, School of Microelectronics, Fudan University, Shanghai 200433, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaoxiang","family":"Chen","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Integrated Chips and Systems, School of Microelectronics, Fudan University, Shanghai 200433, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5199-3976","authenticated-orcid":false,"given":"Manlong","family":"Feng","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Integrated Chips and Systems, School of Microelectronics, Fudan University, Shanghai 200433, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jingjing","family":"Liu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Integrated Chips and Systems, School of Microelectronics, Fudan University, Shanghai 200433, China"},{"name":"Shanghai Key Laboratory of Automobile Intelligent Network Interaction Chip and System, School of Microelectronics, Shanghai University, Shanghai 200444, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,3,13]]},"reference":[{"key":"ref_1","unstructured":"Yu, W., Zhu, Q., Zheng, N., Huang, J., Zhou, M., and Zhao, F. (November, January 29). Learning non-uniform-sampling for ultra-high-definition image enhancement. Proceedings of the 31st ACM International Conference on Multimedia, Ottawa, ON, Canada."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Yu, X., Dai, P., Li, W., Ma, L., Shen, J., Li, J., and Qi, X. (2022, January 23\u201327). Towards efficient and scale-robust ultra-high-definition image demoir\u00e9ing. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.","DOI":"10.1007\/978-3-031-19797-0_37"},{"key":"ref_3","unstructured":"McLachlan, G.J. (2005). Discriminant Analysis and Statistical Pattern Recognition, John Wiley & Sons."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Ullah, S., Ahmad, Z., and Kim, J.M. (2024). Fault Diagnosis of a Multistage Centrifugal Pump Using Explanatory Ratio Linear Discriminant Analysis. Sensors, 24.","DOI":"10.3390\/s24061830"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1080\/00401706.2012.746208","article-title":"A note on the connection and equivalence of three sparse linear discriminant analysis methods","volume":"55","author":"Mai","year":"2013","journal-title":"Technometrics"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Ye, J., and Xiong, T. (2006, January 25\u201329). Null space versus orthogonal linear discriminant analysis. Proceedings of the 23rd International Conference on Machine Learning, Pittsburgh, PA, USA.","DOI":"10.1145\/1143844.1143979"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1312","DOI":"10.1109\/TKDE.2006.160","article-title":"Feature reduction via generalized uncorrelated linear discriminant analysis","volume":"18","author":"Ye","year":"2006","journal-title":"IEEE Trans. Knowl. Data Eng."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Shi, Y., Huang, W., Ye, H., Ruan, C., Xing, N., Geng, Y., Dong, Y., and Peng, D. (2018). Partial least square discriminant analysis based on normalized two-stage vegetation indices for mapping damage from rice diseases using PlanetScope datasets. Sensors, 18.","DOI":"10.3390\/s18061901"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1137\/23M1558781","article-title":"High-dimensional analysis of double descent for linear regression with random projections","volume":"6","author":"Bach","year":"2024","journal-title":"SIAM J. Math. Data Sci."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"135","DOI":"10.1007\/s11768-023-00194-3","article-title":"Variable projection algorithms with sparse constraint for separable nonlinear models","volume":"22","author":"Xu","year":"2024","journal-title":"Control Theory Technol."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Zhang, L., Wei, Y., Liu, J., Wu, J., and An, D. (2024). A hyperspectral band selection method based on sparse band attention network for maize seed variety identification. Expert Syst. Appl., 238.","DOI":"10.1016\/j.eswa.2023.122273"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"406","DOI":"10.1198\/TECH.2011.08118","article-title":"Sparse discriminant analysis","volume":"53","author":"Clemmensen","year":"2011","journal-title":"Technometrics"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1469","DOI":"10.1109\/TNNLS.2015.2448637","article-title":"Sparse uncorrelated linear discriminant analysis for undersampled problems","volume":"27","author":"Zhang","year":"2015","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1109\/TCSVT.2018.2799214","article-title":"Robust sparse linear discriminant analysis","volume":"29","author":"Wen","year":"2018","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Li, S., Zhang, H., Ma, R., Zhou, J., Wen, J., and Zhang, B. (2023). Linear discriminant analysis with generalized kernel constraint for robust image classification. Pattern Recognit., 136.","DOI":"10.1016\/j.patcog.2022.109196"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Sheikhpour, R., Berahmand, K., Mohammadi, M., and Khosravi, H. (2025). Sparse feature selection using hypergraph Laplacian-based semi-supervised discriminant analysis. Pattern Recognit., 157.","DOI":"10.1016\/j.patcog.2024.110882"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Wang, J., Yin, H., Nie, F., and Li, X. (2024). Adaptive and fuzzy locality discriminant analysis for dimensionality reduction. Pattern Recognit., 151.","DOI":"10.1016\/j.patcog.2024.110382"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1016\/j.neunet.2023.03.005","article-title":"Framework for Segmented threshold L0 gradient approximation based network for sparse signal recovery","volume":"162","author":"Vivekanand","year":"2023","journal-title":"Neural Netw."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"9995","DOI":"10.1007\/s00521-022-07200-w","article-title":"Graph non-negative matrix factorization with alternative smoothed L0 regularizations","volume":"35","author":"Chen","year":"2023","journal-title":"Neural Comput. Appl."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Wang, J., Wang, H., Nie, F., and Li, X. (2023). Sparse feature selection via fast embedding spectral analysis. Pattern Recognit., 139.","DOI":"10.1016\/j.patcog.2023.109472"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Chen, D.W., Miao, R., Yang, W.Q., Liang, Y., Chen, H.H., Huang, L., Deng, C.J., and Han, N. (2019). A feature extraction method based on differential entropy and linear discriminant analysis for emotion recognition. Sensors, 19.","DOI":"10.3390\/s19071631"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Zheng, W., Lu, S., Yang, Y., Yin, Z., and Yin, L. (2024). Lightweight transformer image feature extraction network. PeerJ Comput. Sci., 10.","DOI":"10.7717\/peerj-cs.1755"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Zhou, J., Zhang, Q., Zeng, S., Zhang, B., and Fang, L. (2024). Latent linear discriminant analysis for feature extraction via isometric structural learning. Pattern Recognit., 149.","DOI":"10.1016\/j.patcog.2023.110218"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"20781","DOI":"10.1007\/s11042-022-12708-3","article-title":"Robust sparse manifold discriminant analysis","volume":"81","author":"Wang","year":"2022","journal-title":"Multimed. Tools Appl."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Zhang, K., Zheng, D., Li, J., Gao, X., and Lu, J. (2024). Coupled discriminative manifold alignment for low-resolution face recognition. Pattern Recognit., 147.","DOI":"10.1016\/j.patcog.2023.110049"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"210","DOI":"10.1137\/18M122457X","article-title":"Proximal gradient method for nonsmooth optimization over the Stiefel manifold","volume":"30","author":"Chen","year":"2020","journal-title":"SIAM J. Optim."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3097","DOI":"10.1137\/20M1354313","article-title":"Exact Penalty Function for L2,1 Norm Minimization over the Stiefel Manifold","volume":"31","author":"Xiao","year":"2021","journal-title":"SIAM J. Optim."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"3029","DOI":"10.1109\/TSP.2022.3182883","article-title":"Decentralized optimization over the Stiefel manifold by an approximate augmented Lagrangian function","volume":"70","author":"Wang","year":"2022","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1480","DOI":"10.1137\/120869778","article-title":"Sparsity constrained nonlinear optimization: Optimality conditions and algorithms","volume":"23","author":"Beck","year":"2013","journal-title":"SIAM J. Optim."},{"key":"ref_30","first-page":"1","article-title":"Global and quadratic convergence of Newton hard-thresholding pursuit","volume":"22","author":"Zhou","year":"2021","journal-title":"J. Mach. Learn. Res."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1016\/j.automatica.2009.10.030","article-title":"Geometric properties of partial least squares for process monitoring","volume":"46","author":"Li","year":"2010","journal-title":"Automatica"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2721","DOI":"10.1109\/TII.2018.2868364","article-title":"Structured joint sparse principal component analysis for fault detection and isolation","volume":"15","author":"Liu","year":"2018","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1559","DOI":"10.1109\/TIE.2017.2733501","article-title":"Fault detection for non-Gaussian processes using generalized canonical correlation analysis and randomized algorithms","volume":"65","author":"Chen","year":"2017","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"932","DOI":"10.1109\/TNNLS.2017.2650943","article-title":"Manifold regularized reinforcement learning","volume":"29","author":"Li","year":"2017","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_35","unstructured":"Li, J., and Ma, S. (2022). Federated learning on Riemannian manifolds. arXiv."},{"key":"ref_36","unstructured":"Rockafellar, R.T., and Wets, R.J.B. (2009). Variational Analysis, Springer Science & Business Media."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1109\/TETCI.2024.3403912","article-title":"Efficient and Robust Sparse Linear Discriminant Analysis for Data Classification","volume":"9","author":"Liu","year":"2024","journal-title":"IEEE Trans. Emerg. Top. Comput. Intell."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1109\/MSP.2012.2211477","article-title":"The mnist database of handwritten digit images for machine learning research [best of the web]","volume":"29","author":"Deng","year":"2012","journal-title":"IEEE Signal Process. Mag."},{"key":"ref_39","unstructured":"Mantec\u00f3n, T., del Blanco, C.R., Jaureguizar, F., and Garc\u00eda, N. (2016, January 24\u201327). Hand gesture recognition using infrared imagery provided by leap motion controller. Proceedings of the Advanced Concepts for Intelligent Vision Systems: 17th International Conference, ACIVS 2016, Lecce, Italy. Proceedings 17."},{"key":"ref_40","unstructured":"Nene, S.A., Nayar, S.K., and Murase, H. (1996). Columbia Object Image Library (Coil-20), Department of Computer Science, Columbia University."},{"key":"ref_41","first-page":"1","article-title":"Triplet-graph reasoning network for few-shot metal generic surface defect segmentation","volume":"70","author":"Bao","year":"2021","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Kinnunen, T., Kamarainen, J.K., Lensu, L., Lankinen, J., and K\u00e4vi\u00e4inen, H. (2010, January 23\u201326). Making visual object categorization more challenging: Randomized caltech-101 data set. Proceedings of the 2010 20th International Conference on Pattern Recognition, Istanbul, Turkey.","DOI":"10.1109\/ICPR.2010.124"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Molchanov, P., Yang, X., Gupta, S., Kim, K., Tyree, S., and Kautz, J. (2016, January 27\u201330). Online detection and classification of dynamic hand gestures with recurrent 3d convolutional neural network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.456"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Carreira, J., and Zisserman, A. (2017, January 21\u201326). Quo vadis, action recognition? A new model and the kinetics dataset. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.502"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"D\u2019Eusanio, A., Simoni, A., Pini, S., Borghi, G., Vezzani, R., and Cucchiara, R. (2020, January 25\u201328). A transformer-based network for dynamic hand gesture recognition. Proceedings of the 2020 International Conference on 3D Vision (3DV), Fukuoka, Japan.","DOI":"10.1109\/3DV50981.2020.00072"},{"key":"ref_46","first-page":"1","article-title":"Generalized cross entropy loss for training deep neural networks with noisy labels","volume":"31","author":"Zhang","year":"2018","journal-title":"Adv. Neural Inf. Process. Syst."}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/11\/3\/81\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:53:11Z","timestamp":1760028791000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/11\/3\/81"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,13]]},"references-count":46,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2025,3]]}},"alternative-id":["jimaging11030081"],"URL":"https:\/\/doi.org\/10.3390\/jimaging11030081","relation":{},"ISSN":["2313-433X"],"issn-type":[{"type":"electronic","value":"2313-433X"}],"subject":[],"published":{"date-parts":[[2025,3,13]]}}}