{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,4]],"date-time":"2025-09-04T13:11:41Z","timestamp":1756991501110,"version":"3.37.3"},"reference-count":46,"publisher":"Springer Science and Business Media LLC","issue":"19","license":[{"start":{"date-parts":[[2022,5,20]],"date-time":"2022-05-20T00:00:00Z","timestamp":1653004800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,5,20]],"date-time":"2022-05-20T00:00:00Z","timestamp":1653004800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003451","name":"Universidad del Pa\u00eds Vasco","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100003451","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Neural Comput &amp; Applic"],"published-print":{"date-parts":[[2022,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The performance of machine learning and pattern recognition algorithms generally depends on data representation. That is why, much of the current effort in performing machine learning algorithms goes into the design of preprocessing frameworks and data transformations able to support effective machine learning. The method proposed in this work consists of a hybrid linear feature extraction scheme to be used in supervised multi-class classification problems. Inspired by two recent linear discriminant methods: robust sparse linear discriminant analysis (RSLDA) and inter-class sparsity-based discriminative least square regression (ICS_DLSR), we propose a unifying criterion that is able to retain the advantages of these two powerful methods. The resulting transformation relies on sparsity-promoting techniques both to select the features that most accurately represent the data and to preserve the row-sparsity consistency property of samples from the same class. The linear transformation and the orthogonal matrix are estimated using an iterative alternating minimization scheme based on steepest descent gradient method and different initialization schemes. The proposed framework is generic in the sense that it allows the combination and tuning of other linear discriminant embedding methods. According to the experiments conducted on several datasets including faces, objects, and digits, the proposed method was able to outperform competing methods in most cases.<\/jats:p>","DOI":"10.1007\/s00521-022-07332-z","type":"journal-article","created":{"date-parts":[[2022,5,20]],"date-time":"2022-05-20T04:03:14Z","timestamp":1653019394000},"page":"16879-16895","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["A supervised discriminant data representation: application to pattern classification"],"prefix":"10.1007","volume":"34","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6581-9680","authenticated-orcid":false,"given":"F.","family":"Dornaika","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"A.","family":"Khoder","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"A.","family":"Moujahid","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"W.","family":"Khoder","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,5,20]]},"reference":[{"issue":"1","key":"7332_CR1","first-page":"1","volume":"3","author":"S Boyd","year":"2011","unstructured":"Boyd S, Parikh N, Chu E, Peleato B, Eckstein J et al (2011) Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trend Regist Mach Learn 3(1):1\u2013122","journal-title":"Found Trend Regist Mach Learn"},{"key":"7332_CR2","doi-asserted-by":"crossref","unstructured":"Cai X, Ding C, Nie F, Huang H (2013) On the equivalent of low-rank linear regressions and linear discriminant analysis based regressions. In Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining, 1124\u20131132","DOI":"10.1145\/2487575.2487701"},{"issue":"3","key":"7332_CR3","first-page":"27","volume":"2","author":"C-C Chang","year":"2011","unstructured":"Chang C-C, Lin C-J (2011) Libsvm: a library for support vector machines. ACM Trans Intel Syst Technol(TIST) 2(3):27","journal-title":"ACM Trans Intel Syst Technol(TIST)"},{"key":"7332_CR4","doi-asserted-by":"crossref","unstructured":"Chen H-T, Chang H-W, Liu T-L (2005) Local discriminant embedding and its variants. In 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR\u201905), volume\u00a02, pp 846\u2013853. IEEE","DOI":"10.1109\/CVPR.2005.216"},{"issue":"4","key":"7332_CR5","doi-asserted-by":"publisher","first-page":"406","DOI":"10.1198\/TECH.2011.08118","volume":"53","author":"L Clemmensen","year":"2011","unstructured":"Clemmensen L, Hastie T, Witten D, Ersb\u00f8ll B (2011) Sparse discriminant analysis. Technometrics 53(4):406\u2013413","journal-title":"Technometrics"},{"issue":"8","key":"7332_CR6","first-page":"1","volume":"34","author":"P Cunningham","year":"2007","unstructured":"Cunningham P, Delany SJ (2007) k-nearest neighbour classifiers. Multiple Classif Syst 34(8):1\u201317","journal-title":"Multiple Classif Syst"},{"key":"7332_CR7","first-page":"1","volume":"7","author":"J Dem\u0161ar","year":"2006","unstructured":"Dem\u0161ar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1\u201330","journal-title":"J Mach Learn Res"},{"key":"7332_CR8","volume-title":"Pattern classification","author":"RO Duda","year":"2012","unstructured":"Duda RO, Hart PE, Stork DG (2012) Pattern classification. John Wiley & Sons, UK"},{"issue":"7","key":"7332_CR9","doi-asserted-by":"publisher","first-page":"1119","DOI":"10.1109\/TNN.2011.2152852","volume":"22","author":"Z Fan","year":"2011","unstructured":"Fan Z, Xu Y, Zhang D (2011) Local linear discriminant analysis framework using sample neighbors. IEEE Trans Neural Netw 22(7):1119\u20131132","journal-title":"IEEE Trans Neural Netw"},{"issue":"6","key":"7332_CR10","doi-asserted-by":"publisher","first-page":"2502","DOI":"10.1109\/TNNLS.2017.2693221","volume":"29","author":"X Fang","year":"2017","unstructured":"Fang X, Teng S, Lai Z, He Z, Xie S, Wong WK (2017) Robust latent subspace learning for image classification. IEEE Trans Neural Netw Learn Syst 29(6):2502\u20132515","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"key":"7332_CR11","doi-asserted-by":"publisher","first-page":"643","DOI":"10.1109\/34.927464","volume":"6","author":"AS Georghiades","year":"2001","unstructured":"Georghiades AS, Belhumeur PN, Kriegman DJ (2001) From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Trans Pattern Anal Mach Intel 6:643\u2013660","journal-title":"IEEE Trans Pattern Anal Mach Intel"},{"key":"7332_CR12","unstructured":"Kozma L (2008) K nearest neighbors algorithm (knn). Helsinki University of Technology"},{"key":"7332_CR13","doi-asserted-by":"publisher","first-page":"2247","DOI":"10.1007\/s13042-020-01113-7","volume":"11","author":"Z Lai","year":"2020","unstructured":"Lai Z, Bao J, Kong H, Wan M, Yang G (2020) Discriminative low-rank projection for robust subspace learning. Int J Mach Learn Cybern 11:2247\u20132260","journal-title":"Int J Mach Learn Cybern"},{"issue":"10","key":"7332_CR14","doi-asserted-by":"publisher","first-page":"1651","DOI":"10.1109\/TCSVT.2014.2305495","volume":"24","author":"Z Lai","year":"2014","unstructured":"Lai Z, Xu Y, Jin Z, Zhang D (2014) Human gait recognition via sparse discriminant projection learning. IEEE Trans Circuits Syst Video Technol 24(10):1651\u20131662","journal-title":"IEEE Trans Circuits Syst Video Technol"},{"key":"7332_CR15","doi-asserted-by":"crossref","unstructured":"Langley P (1994) Selection of relevant features in machine learning: Defense technical information center","DOI":"10.21236\/ADA292575"},{"issue":"9","key":"7332_CR16","first-page":"2138","volume":"26","author":"Z Li","year":"2013","unstructured":"Li Z, Liu J, Yang Y, Zhou X, Lu H (2013) Clustering-guided sparse structural learning for unsupervised feature selection. IEEE Trans Knowl Data Eng 26(9):2138\u20132150","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"7332_CR17","doi-asserted-by":"crossref","unstructured":"Liu L, Fieguth P, Kuang G (2011) Generalized local binary patterns for texture classification","DOI":"10.5244\/C.25.123"},{"issue":"2","key":"7332_CR18","doi-asserted-by":"publisher","first-page":"228","DOI":"10.1109\/34.908974","volume":"23","author":"AM Mart\u00ednez","year":"2001","unstructured":"Mart\u00ednez AM, Kak AC (2001) Pca versus lda. IEEE Trans Pattern Anal Mach Intell 23(2):228\u2013233","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"7332_CR19","unstructured":"Nene SA, Nayar SK, Murase H et\u00a0al. (1996) Columbia object image library (coil-20)"},{"issue":"11","key":"7332_CR20","doi-asserted-by":"publisher","first-page":"3583","DOI":"10.1109\/TCYB.2016.2572306","volume":"47","author":"X Peng","year":"2016","unstructured":"Peng X, Lu J, Yi Z, Yan R (2016) Automatic subspace learning via principal coefficients embedding. IEEE Transa Cyber 47(11):3583\u20133596","journal-title":"IEEE Transa Cyber"},{"key":"7332_CR21","volume-title":"C4. 5: programs for machine learning","author":"JR Quinlan","year":"2014","unstructured":"Quinlan JR (2014) C4. 5: programs for machine learning. Elsevier, Amsterdam"},{"issue":"1","key":"7332_CR22","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1023\/B:AMAI.0000018580.96245.c6","volume":"41","author":"LE Raileanu","year":"2004","unstructured":"Raileanu LE, Stoffel K (2004) Theoretical comparison between the gini index and information gain criteria. Ann Math Artif Intell 41(1):77\u201393","journal-title":"Ann Math Artif Intell"},{"key":"7332_CR23","unstructured":"Seewald AK (2005) Digits-a dataset for handwritten digit recognition. Austrian Research Institut for Artificial Intelligence Technical Report, Vienna (Austria)"},{"key":"7332_CR24","unstructured":"Smith LI (2002) A tutorial on principal components analysis. Technical report"},{"key":"7332_CR25","doi-asserted-by":"crossref","unstructured":"Sta\u0144czyk U, Zielosko B, Jain LC (2018) Advances in feature selection for data and pattern recognition: An introduction. In: Advances in Feature Selection for Data and Pattern Recognition, pp 1\u20139. Springer","DOI":"10.1007\/978-3-319-67588-6_1"},{"issue":"4","key":"7332_CR26","doi-asserted-by":"publisher","first-page":"796","DOI":"10.1109\/TNNLS.2015.2424721","volume":"27","author":"H Tao","year":"2015","unstructured":"Tao H, Hou C, Nie F, Jiao Y, Yi D (2015) Effective discriminative feature selection with nontrivial solution. IEEE Trans Neural Netw Learn Syst 27(4):796\u2013808","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"issue":"2","key":"7332_CR27","doi-asserted-by":"publisher","first-page":"169","DOI":"10.3233\/AIC-170729","volume":"30","author":"A Tharwat","year":"2017","unstructured":"Tharwat A, Gaber T, Ibrahim A, Hassanien AE (2017) Linear discriminant analysis: A detailed tutorial. AI Commun 30(2):169\u2013190","journal-title":"AI Commun"},{"key":"7332_CR28","doi-asserted-by":"publisher","first-page":"105501","DOI":"10.1016\/j.dib.2020.105501","volume":"30","author":"MC Thrun","year":"2020","unstructured":"Thrun MC, Ultsch A (2020) Clustering benchmark datasets exploiting the fundamental clustering problems. Data Brief 30:105501","journal-title":"Data Brief"},{"key":"7332_CR29","unstructured":"Ultsch A (1990) Kohonen\u2019s self organizing feature maps for exploratory data analysis. Proc. INNC90, pp 305\u2013308"},{"key":"7332_CR30","doi-asserted-by":"crossref","unstructured":"Ultsch A (1993) Self-organizing neural networks for visualisation and classification. InInformation and classification, pp 307\u2013313. Springer","DOI":"10.1007\/978-3-642-50974-2_31"},{"key":"7332_CR31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.ins.2021.02.006","volume":"563","author":"M Wan","year":"2021","unstructured":"Wan M, Chen X, Zhan T, Xu C, Yang G, Zhou H (2021) Sparse fuzzy two-dimensional discriminant local preserving projection (SF2DDLPP) for robust image feature extraction. Inf Sci 563:1\u201315","journal-title":"Inf Sci"},{"key":"7332_CR32","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1016\/j.fss.2016.06.001","volume":"318","author":"M Wan","year":"2017","unstructured":"Wan M, Lai Z, Yang G, Yang Z, Zhang F, Zheng H (2017) Local graph embedding based on maximum margin criterion via fuzzy set. Fuzzy Sets Syst 318:120\u2013131 (Theme: Clustering and Image Processing)","journal-title":"Fuzzy Sets Syst"},{"key":"7332_CR33","doi-asserted-by":"crossref","unstructured":"Wan M, Yao Y, Zhan T, Yang G (2021) Supervised low-rank embedded regression (SLRER) for robust subspace learning. IEEE Trans Circuits Syst Video Technol, pp 1","DOI":"10.1109\/TCSVT.2021.3090420"},{"issue":"10","key":"7332_CR34","doi-asserted-by":"publisher","first-page":"2743","DOI":"10.1109\/TKDE.2015.2426703","volume":"27","author":"D Wang","year":"2015","unstructured":"Wang D, Nie F, Huang H (2015) Feature selection via global redundancy minimization. IEEE Trans Knowl Data Eng 27(10):2743\u20132755","journal-title":"IEEE Trans Knowl Data Eng"},{"issue":"2","key":"7332_CR35","doi-asserted-by":"publisher","first-page":"390","DOI":"10.1109\/TCSVT.2018.2799214","volume":"29","author":"J Wen","year":"2018","unstructured":"Wen J, Fang X, Cui J, Fei L, Yan K, Chen Y, Xu Y (2018) Robust sparse linear discriminant analysis. IEEE Trans Circuits Syst Video Technol 29(2):390\u2013403","journal-title":"IEEE Trans Circuits Syst Video Technol"},{"issue":"4","key":"7332_CR36","doi-asserted-by":"publisher","first-page":"1279","DOI":"10.1109\/TCYB.2018.2799862","volume":"49","author":"J Wen","year":"2019","unstructured":"Wen J, Han N, Fang X, Fei L, Yan K, Zhan S (2019) Low-rank preserving projection via graph regularized reconstruction. IEEE Trans Cyber 49(4):1279\u20131291","journal-title":"IEEE Trans Cyber"},{"key":"7332_CR37","doi-asserted-by":"publisher","first-page":"36","DOI":"10.1016\/j.neunet.2018.02.002","volume":"102","author":"J Wen","year":"2018","unstructured":"Wen J, Xu Y, Li Z, Ma Z, Xu Y (2018) Inter-class sparsity based discriminative least square regression. Neural Netw 102:36\u201347","journal-title":"Neural Netw"},{"issue":"9","key":"7332_CR38","doi-asserted-by":"publisher","first-page":"1974","DOI":"10.1109\/TNNLS.2016.2562670","volume":"28","author":"J Xu","year":"2016","unstructured":"Xu J, Tang B, He H, Man H (2016) Semisupervised feature selection based on relevance and redundancy criteria. IEEE Trans Neural Netw Learn Syst 28(9):1974\u20131984","journal-title":"IEEE Trans Neural Netw Learn Syst"},{"issue":"10","key":"7332_CR39","doi-asserted-by":"publisher","first-page":"3306","DOI":"10.1007\/s10489-018-1140-3","volume":"48","author":"Y Xue","year":"2018","unstructured":"Xue Y, Zhang L, Wang B, Zhang Z, Li F (2018) Nonlinear feature selection using gaussian kernel svm-rfe for fault diagnosis. Appl Intell 48(10):3306\u20133331","journal-title":"Appl Intell"},{"issue":"6","key":"7332_CR40","doi-asserted-by":"publisher","first-page":"1550","DOI":"10.1109\/TSMCB.2012.2195000","volume":"42","author":"J-B Yang","year":"2012","unstructured":"Yang J-B, Ong C-J (2012) An effective feature selection method via mutual information estimation. IEEE Trans Syst, Man, Cybern, Part B (Cybern) 42(6):1550\u20131559","journal-title":"IEEE Trans Syst, Man, Cybern, Part B (Cybern)"},{"key":"7332_CR41","doi-asserted-by":"crossref","unstructured":"Zang S, Cheng Y, Wang X, Ma J (2019) Semi-supervised flexible joint distribution adaptation. In: Proceedings of the 2019 8th international conference on networks, communication and computing, pp 19\u201327","DOI":"10.1145\/3375998.3376022"},{"issue":"11","key":"7332_CR42","doi-asserted-by":"publisher","first-page":"5304","DOI":"10.1109\/TNNLS.2018.2797060","volume":"29","author":"H Zhang","year":"2018","unstructured":"Zhang H, Wang S, Xu X, Chow TW, Wu QJ (2018) Tree2vector: learning a vectorial representation for tree-structured data. IEEE Trans Neural Netw Learning Syst 29(11):5304\u20135318","journal-title":"IEEE Trans Neural Netw Learning Syst"},{"issue":"3","key":"7332_CR43","doi-asserted-by":"publisher","first-page":"689","DOI":"10.1109\/TKDE.2015.2493537","volume":"28","author":"Z Zhao","year":"2015","unstructured":"Zhao Z, He X, Cai D, Zhang L, Ng W, Zhuang Y (2015) Graph regularized feature selection with data reconstruction. IEEE Trans Knowl Data Eng 28(3):689\u2013700","journal-title":"IEEE Trans Knowl Data Eng"},{"key":"7332_CR44","doi-asserted-by":"publisher","first-page":"458","DOI":"10.1016\/j.patcog.2019.05.004","volume":"93","author":"R Zhu","year":"2019","unstructured":"Zhu R, Dornaika F, Ruichek Y (2019) Joint graph based embedding and feature weighting for image classification. Pattern Recogn 93:458\u2013469","journal-title":"Pattern Recogn"},{"issue":"2","key":"7332_CR45","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1111\/j.1467-9868.2005.00503.x","volume":"67","author":"H Zou","year":"2005","unstructured":"Zou H, Hastie T (2005) Regularization and variable selection via the elastic net. J Royal Stat Soc: Series B (Stat Methodol) 67(2):301\u2013320","journal-title":"J Royal Stat Soc: Series B (Stat Methodol)"},{"issue":"2","key":"7332_CR46","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1198\/106186006X113430","volume":"15","author":"H Zou","year":"2006","unstructured":"Zou H, Hastie T, Tibshirani R (2006) Sparse principal component analysis. J Comput Graph Stat 15(2):265\u2013286","journal-title":"J Comput Graph Stat"}],"container-title":["Neural Computing and Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-022-07332-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00521-022-07332-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00521-022-07332-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,9,25]],"date-time":"2024-09-25T16:04:54Z","timestamp":1727280294000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00521-022-07332-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,20]]},"references-count":46,"journal-issue":{"issue":"19","published-print":{"date-parts":[[2022,10]]}},"alternative-id":["7332"],"URL":"https:\/\/doi.org\/10.1007\/s00521-022-07332-z","relation":{},"ISSN":["0941-0643","1433-3058"],"issn-type":[{"type":"print","value":"0941-0643"},{"type":"electronic","value":"1433-3058"}],"subject":[],"published":{"date-parts":[[2022,5,20]]},"assertion":[{"value":"18 October 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 April 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 May 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest Statement"}}]}}