{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,6]],"date-time":"2026-05-06T04:15:01Z","timestamp":1778040901381,"version":"3.51.4"},"reference-count":38,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2021,3,26]],"date-time":"2021-03-26T00:00:00Z","timestamp":1616716800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100017596","name":"Natural Science Basic Research Program of Shaanxi Province","doi-asserted-by":"publisher","award":["2020JM-575"],"award-info":[{"award-number":["2020JM-575"]}],"id":[{"id":"10.13039\/501100017596","id-type":"DOI","asserted-by":"publisher"}]},{"name":"China 111 Project","award":["B16037"],"award-info":[{"award-number":["B16037"]}]},{"DOI":"10.13039\/501100001809","name":"National Science Foundation of China","doi-asserted-by":"crossref","award":["61472296,61672408,61972309"],"award-info":[{"award-number":["61472296,61672408,61972309"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2021,8,31]]},"abstract":"<jats:p>Linear discriminant analysis (LDA) is one of the important techniques for dimensionality reduction, machine learning, and pattern recognition. However, in many applications, applying the classical LDA often faces the following problems: (1) sensitivity to outliers, (2) absence of local geometric information, and (3) small sample size or matrix singularity that can result in weak robustness and efficiency. Although several researchers have attempted to address one or more of the problems, little work has been done to address all of them together to produce a more effective and efficient LDA algorithm. This article proposes 3E-LDA, an enhanced LDA algorithm, that deals with all three problems as an attempt to further improve LDA. It proposes to learn a weighted median rather than the mean of the samples to deal with (1), to embed both between-class and within-class local geometric information to deal with (2), and to calculate the projection vectors in the null space of the matrix to deal with (3). Experiments on six benchmark datasets show that these three enhancements enable 3E-LDA to markedly outperform state-of-the-art LDA baselines in both accuracy and efficiency.<\/jats:p>","DOI":"10.1145\/3442347","type":"journal-article","created":{"date-parts":[[2021,3,26]],"date-time":"2021-03-26T16:43:12Z","timestamp":1616776992000},"page":"1-20","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":20,"title":["3E-LDA"],"prefix":"10.1145","volume":"15","author":[{"given":"Yanni","family":"Li","sequence":"first","affiliation":[{"name":"Xidian University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bing","family":"Liu","sequence":"additional","affiliation":[{"name":"University of Illinois at Chicago, Chicago, IL"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yongbo","family":"Yu","sequence":"additional","affiliation":[{"name":"Xidian University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2382-6289","authenticated-orcid":false,"given":"Hui","family":"Li","sequence":"additional","affiliation":[{"name":"Xidian University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiacan","family":"Sun","sequence":"additional","affiliation":[{"name":"Xidian University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jiangtao","family":"Cui","sequence":"additional","affiliation":[{"name":"Xidian University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,3,26]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.598228"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2007.4408856"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-89796-5_116"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(99)00139-9"},{"key":"e_1_2_1_5_1","volume-title":"Proceedings of the 29th International Conference on Machine Learning (ICML\u201912)","author":"Chen Minhua","unstructured":"Minhua Chen , William R. Carson , Miguel R.D. Rodrigues , Lawrence Carin , and A. Robert Calderbank . 2012. Communications inspired linear discriminant analysis . In Proceedings of the 29th International Conference on Machine Learning (ICML\u201912) . Minhua Chen, William R. Carson, Miguel R.D. Rodrigues, Lawrence Carin, and A. Robert Calderbank. 2012. Communications inspired linear discriminant analysis. In Proceedings of the 29th International Conference on Machine Learning (ICML\u201912)."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2014.281"},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the 24th International Conference (ICML\u201907)","author":"Chris H.","unstructured":"Chris H. Q. Ding and Tao Li. 2007. Adaptive dimension reduction using discriminant analysis and K-means clustering . In Proceedings of the 24th International Conference (ICML\u201907) . 521--528. Chris H. Q. Ding and Tao Li. 2007. Adaptive dimension reduction using discriminant analysis and K-means clustering. In Proceedings of the 24th International Conference (ICML\u201907). 521--528."},{"key":"e_1_2_1_8_1","series-title":"Series in Machine Perception and Artificial Intelligence","volume-title":"Structural, Neural and Fuzzy Logic Approaches","author":"Friedman Menahem","unstructured":"Menahem Friedman and Abraham Kandel . 1999. Introduction to Pattern Recognition - Statistical , Structural, Neural and Fuzzy Logic Approaches . Series in Machine Perception and Artificial Intelligence , Vol. 32 . WorldScientific . Menahem Friedman and Abraham Kandel. 1999. Introduction to Pattern Recognition - Statistical, Structural, Neural and Fuzzy Logic Approaches. Series in Machine Perception and Artificial Intelligence, Vol. 32. WorldScientific."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2015.02.015"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2012.03.024"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of 10th IEEE International Conference on Computer Vision (ICCV\u201905)","author":"He Xiaofei","year":"2005","unstructured":"Xiaofei He , Deng Cai , Shuicheng Yan , and HongJiang Zhang . 2005 . Neighborhood preserving embedding . In Proceedings of 10th IEEE International Conference on Computer Vision (ICCV\u201905) . 1208--1213. Xiaofei He, Deng Cai, Shuicheng Yan, and HongJiang Zhang. 2005. Neighborhood preserving embedding. In Proceedings of 10th IEEE International Conference on Computer Vision (ICCV\u201905). 1208--1213."},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the Advances in Neural Information Processing Systems (NIPS\u201903)","author":"He Xiaofei","year":"2003","unstructured":"Xiaofei He and Partha Niyogi . 2003 . Locality preserving projections . In Proceedings of the Advances in Neural Information Processing Systems (NIPS\u201903) . 153--160. Xiaofei He and Partha Niyogi. 2003. Locality preserving projections. In Proceedings of the Advances in Neural Information Processing Systems (NIPS\u201903). 153--160."},{"key":"e_1_2_1_13_1","volume-title":"Proceedings of IEEE of Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905)","author":"Kong Hui","year":"2005","unstructured":"Hui Kong , Lei Wang , Eam Khwang Teoh , Jian-Gang Wang , and Ronda Venkateswarlu . 2005 . A framework of 2D Fisher discriminant analysis: Application to face recognition with small number of training samples . In Proceedings of IEEE of Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905) . 1083--1088. Hui Kong, Lei Wang, Eam Khwang Teoh, Jian-Gang Wang, and Ronda Venkateswarlu. 2005. A framework of 2D Fisher discriminant analysis: Application to face recognition with small number of training samples. In Proceedings of IEEE of Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905). 1083--1088."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2016.2578642"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2014.2314698"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2016.2621667"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.935849"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11265-010-0541-2"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.908974"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning (ICML\u201918)","author":"Pang Tianyu","year":"2018","unstructured":"Tianyu Pang , Chao Du , and Jun Zhu . 2018 . Max-Mahalanobis linear discriminant analysis networks . In Proceedings of the 35th International Conference on Machine Learning (ICML\u201918) . 4013--4022. Tianyu Pang, Chao Du, and Jun Zhu. 2018. Max-Mahalanobis linear discriminant analysis networks. In Proceedings of the 35th International Conference on Machine Learning (ICML\u201918). 4013--4022."},{"key":"e_1_2_1_21_1","volume-title":"Proceedings of the 22nd Annual Conference on Neural Information Processing Systems. 897--904","author":"Sha Fei","unstructured":"Fei Sha , Simon Lacoste-Julien , and Michael I. Jordan . 2008. DiscLDA: Discriminative learning for dimensionality reduction and classification . In Proceedings of the 22nd Annual Conference on Neural Information Processing Systems. 897--904 . Fei Sha, Simon Lacoste-Julien, and Michael I. Jordan. 2008. DiscLDA: Discriminative learning for dimensionality reduction and classification. In Proceedings of the 22nd Annual Conference on Neural Information Processing Systems. 897--904."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2011.11.012"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2008.2002078"},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning (ICML\u201918)","author":"Su Bing","year":"2018","unstructured":"Bing Su and Ying Wu . 2018 . Learning low-dimensional temporal representations . In Proceedings of the 35th International Conference on Machine Learning (ICML\u201918) . 4768--4777. Bing Su and Ying Wu. 2018. Learning low-dimensional temporal representations. In Proceedings of the 35th International Conference on Machine Learning (ICML\u201918). 4768--4777."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.5555\/1248659.1248694"},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the 31st International Conference on Machine Learning (ICML\u201914)","author":"Wang Hua","year":"2014","unstructured":"Hua Wang , Feiping Nie , and Heng Huang . 2014 . Robust distance metric learning via simultaneous L1-norm minimization and maximization . In Proceedings of the 31st International Conference on Machine Learning (ICML\u201914) . 1836--1844. Hua Wang, Feiping Nie, and Heng Huang. 2014. Robust distance metric learning via simultaneous L1-norm minimization and maximization. In Proceedings of the 31st International Conference on Machine Learning (ICML\u201914). 1836--1844."},{"key":"e_1_2_1_27_1","volume-title":"Introduction to Statistical Pattern Recognition","author":"Webb Andrew R.","unstructured":"Andrew R. Webb . 1990. Introduction to Statistical Pattern Recognition . John Wiley & Sons Ltd . Andrew R. Webb. 1990. Introduction to Statistical Pattern Recognition. John Wiley & Sons Ltd."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-005-4939-z"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/0169-7439(87)80084-9"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1008"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.imavis.2005.11.006"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2013.10.005"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10044-017-0594-y"},{"key":"e_1_2_1_34_1","volume-title":"Proceedings of the 30th International Conference on Machine Learning (ICML\u201913)","author":"Zhang Xiaowei","year":"2013","unstructured":"Xiaowei Zhang and Delin Chu . 2013 . Sparse uncorrelated linear discriminant analysis . In Proceedings of the 30th International Conference on Machine Learning (ICML\u201913) . 45--52. Xiaowei Zhang and Delin Chu. 2013. Sparse uncorrelated linear discriminant analysis. In Proceedings of the 30th International Conference on Machine Learning (ICML\u201913). 45--52."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2016.07.037"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2018.2842023"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIP.2013.2253476"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2014.2303798"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3442347","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3442347","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:21Z","timestamp":1750195461000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3442347"}},"subtitle":["Three Enhancements to Linear Discriminant Analysis"],"short-title":[],"issued":{"date-parts":[[2021,3,26]]},"references-count":38,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,8,31]]}},"alternative-id":["10.1145\/3442347"],"URL":"https:\/\/doi.org\/10.1145\/3442347","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,26]]},"assertion":[{"value":"2019-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-12-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-03-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}