{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T06:57:12Z","timestamp":1777532232387,"version":"3.51.4"},"reference-count":42,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2013,7,1]],"date-time":"2013-07-01T00:00:00Z","timestamp":1372636800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100006602","name":"Air Force Research Laboratory","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100006602","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2013,7]]},"abstract":"<jats:p>Knowledge discovery from big data demands effective representation of data. However, big data are often characterized by high dimensionality, which makes knowledge discovery more difficult. Many techniques for dimensionality reudction have been proposed, including well-known Fisher's Linear Discriminant Analysis (LDA). However, the Fisher criterion is incapable of dealing with heteroscedasticity in the data. A technique based on the Chernoff criterion for linear dimensionality reduction has been proposed that is capable of exploiting heteroscedastic information in the data. While the Chernoff criterion has been shown to outperform the Fisher's, a clear understanding of its exact behavior is lacking. In this article, we show precisely what can be expected from the Chernoff criterion. In particular, we show that the Chernoff criterion exploits the Fisher and Fukunaga-Koontz transforms in computing its linear discriminants. Furthermore, we show that a recently proposed decomposition of the data space into four subspaces is incomplete. We provide arguments on how to best enrich the decomposition of the data space in order to account for heteroscedasticity in the data. Finally, we provide experimental results validating our theoretical analysis.<\/jats:p>","DOI":"10.1145\/2499907.2499911","type":"journal-article","created":{"date-parts":[[2013,7,30]],"date-time":"2013-07-30T13:35:22Z","timestamp":1375191322000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Exploiting fisher and fukunaga-koontz transforms in chernoff dimensionality reduction"],"prefix":"10.1145","volume":"7","author":[{"given":"Jing","family":"Peng","sequence":"first","affiliation":[{"name":"Montclair State University"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guna","family":"Seetharaman","sequence":"additional","affiliation":[{"name":"Air Force Research Lab"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wei","family":"Fan","sequence":"additional","affiliation":[{"name":"Huawei Noah Ark Lab, Hong Kong"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aparna","family":"Varde","sequence":"additional","affiliation":[{"name":"Montclair State University"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2013,8,2]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.598228"},{"key":"e_1_2_1_2_1","volume-title":"Adaptive Control Precesses: A Guided Tour","author":"Bellman R. E.","unstructured":"Bellman , R. E. 1961. Adaptive Control Precesses: A Guided Tour . Princeton University Press . Bellman, R. E. 1961. Adaptive Control Precesses: A Guided Tour. Princeton University Press."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2010.189"},{"key":"e_1_2_1_4_1","unstructured":"Breiman L. Friedman J. H. Olshen R. A. and Stone C. J. 1984. Classification and Regression Trees. Wadsworth and Brooks Monterey CA.  Breiman L. Friedman J. H. Olshen R. A. and Stone C. J. 1984. Classification and Regression Trees. Wadsworth and Brooks Monterey CA."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0020-0255(76)90746-5"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-3203(99)00139-9"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/0022-247X(89)90335-1"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the British Machine Vision Conference. 9--18","author":"Cootes T. F.","unstructured":"Cootes , T. F. and Taylor , C. J . 1992. Active shape models: Smart snakes . In Proceedings of the British Machine Vision Conference. 9--18 . Cootes, T. F. and Taylor, C. J. 1992. Active shape models: Smart snakes. In Proceedings of the British Machine Vision Conference. 9--18."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TIT.1967.1053964"},{"key":"e_1_2_1_10_1","volume-title":"An Introduction to Support Vector Machines and other Kernel-Based Learning Methods","author":"Cristianini N.","unstructured":"Cristianini , N. and Shawe-Taylor , J. 2000. An Introduction to Support Vector Machines and other Kernel-Based Learning Methods . Cambridge University Press , Cambridge, UK . Cristianini, N. and Shawe-Taylor, J. 2000. An Introduction to Support Vector Machines and other Kernel-Based Learning Methods. Cambridge University Press, Cambridge, UK."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/11744085_24"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/0898-1221(77)90116-X"},{"key":"e_1_2_1_13_1","volume-title":"Recognition: A Statistical Approach","author":"Devijver P. A.","year":"1982","unstructured":"Devijver , P. A. and Pattern , J. K . 1982 . Recognition: A Statistical Approach . Prentice-Hall , London . Devijver, P. A. and Pattern, J. K. 1982. Recognition: A Statistical Approach. Prentice-Hall, London."},{"key":"e_1_2_1_14_1","volume-title":"Proceedings of the International Conference on Acoustics, Speech, and Signal Processing. 2148--2151","author":"Etemad K.","unstructured":"Etemad , K. and Chellappa , R . 1996. Discriminant analysis for recognition of human faces . In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing. 2148--2151 . Etemad, K. and Chellappa, R. 1996. Discriminant analysis for recognition of human faces. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing. 2148--2151."},{"key":"e_1_2_1_15_1","volume-title":"Flexible metric nearest neighbor classification. Tech. rep. Deptartment of Statistics","author":"Friedman J. H.","unstructured":"Friedman , J. H. 1994. Flexible metric nearest neighbor classification. Tech. rep. Deptartment of Statistics , Stanford University . http:\/\/www-stat.stanford.edu\/&sim;jhf\/ftp\/flexmet.pdf. Friedman, J. H. 1994. Flexible metric nearest neighbor classification. Tech. rep. Deptartment of Statistics, Stanford University. http:\/\/www-stat.stanford.edu\/&sim;jhf\/ftp\/flexmet.pdf."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/T-C.1970.222918"},{"key":"e_1_2_1_17_1","volume-title":"Introduction to Statistical Pattern Recognition","author":"Fukunaga K.","unstructured":"Fukunaga , K. 1990. Introduction to Statistical Pattern Recognition . Academic Press . Fukunaga, K. 1990. Introduction to Statistical Pattern Recognition. Academic Press."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/2283516.2283612"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the European Conference on Machine Learning.","author":"Gu Q.","unstructured":"Gu , Q. , Li , Z. , and Han , J . 2011b. Linear discriminant dimensionality reduction . In Proceedings of the European Conference on Machine Learning. Gu, Q., Li, Z., and Han, J. 2011b. Linear discriminant dimensionality reduction. In Proceedings of the European Conference on Machine Learning."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.70717"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2004.46"},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of 16th International Conference on Pattern Recognition.","volume":"3","author":"Huang R.","unstructured":"Huang , R. , Liu , Q. , Lu , H. , and Ma , S . 2002. Solving the small sample size problem of lda . In Proceedings of 16th International Conference on Pattern Recognition. Vol. 3 . 29--32. Huang, R., Liu, Q., Lu, H., and Ma, S. 2002. Solving the small sample size problem of lda. In Proceedings of 16th International Conference on Pattern Recognition. Vol. 3. 29--32."},{"key":"e_1_2_1_23_1","volume-title":"Proceedings of the SPIE Conference.","author":"Huo X.","year":"2003","unstructured":"Huo , X. , Elad , M. , Flesia , A. G. , Muise , R. R. , Stanfill , S. R. , 2003 . Optimal reduced-rank quadratic classiers using the fukunaga-koontz transform, with applications to automated target recognition . In Proceedings of the SPIE Conference. Huo, X., Elad, M., Flesia, A. G., Muise, R. R., Stanfill, S. R., et al. 2003. Optimal reduced-rank quadratic classiers using the fukunaga-koontz transform, with applications to automated target recognition. In Proceedings of the SPIE Conference."},{"key":"e_1_2_1_24_1","volume-title":"Proceedings of the 25th National Conference on Artificial Intelligence (AAAI'11)","author":"Juo D.","unstructured":"Juo , D. , Ding , C. , and Huang , H . 2011. Linear discriminant analysis: New formulations and overfit analysis . In Proceedings of the 25th National Conference on Artificial Intelligence (AAAI'11) . 417--422. Juo, D., Ding, C., and Huang, H. 2011. Linear discriminant analysis: New formulations and overfit analysis. In Proceedings of the 25th National Conference on Artificial Intelligence (AAAI'11). 417--422."},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the 9th International Conference on Machine Learning. 249--256","author":"Kira K.","unstructured":"Kira , K. and Rendell , L. A . 1992. A practical approach to feature selection . In Proceedings of the 9th International Conference on Machine Learning. 249--256 . Kira, K. and Rendell, L. A. 1992. A practical approach to feature selection. In Proceedings of the 9th International Conference on Machine Learning. 249--256."},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of the Joint Meeting of the American Statistical Association.","author":"Kumar N.","unstructured":"Kumar , N. and Andreou , A. G . 1996. Generalization of linear discriminant analysis in a maximum likelihood framework . In Proceedings of the Joint Meeting of the American Statistical Association. Kumar, N. and Andreou, A. G. 1996. Generalization of linear discriminant analysis in a maximum likelihood framework. In Proceedings of the Joint Meeting of the American Statistical Association."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2006.885038"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2005.860852"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2004.13"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.598227"},{"key":"e_1_2_1_31_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 471--477","author":"Nayar S. K.","unstructured":"Nayar , S. K. , Baker , S. , and Murase , H . 1994. Parametric feature detection . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 471--477 . Nayar, S. K., Baker, S., and Murase, H. 1994. Parametric feature detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 471--477."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1137\/0718026"},{"key":"e_1_2_1_33_1","volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 84--91","author":"Pentland A.","unstructured":"Pentland , A. , Moghaddam , B. , and Starner , T . 1994. View-based and modular eigenspaces for face recognition . In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 84--91 . Pentland, A., Moghaddam, B., and Starner, T. 1994. View-based and modular eigenspaces for face recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 84--91."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2008.01.016"},{"key":"e_1_2_1_35_1","volume-title":"Proceedings of the SIAM International Conference on Data Mining. 188--195","author":"Sun Y.","unstructured":"Sun , Y. and Wu , D . 2008. A relief based feature extraction algorithm . In Proceedings of the SIAM International Conference on Data Mining. 188--195 . Sun, Y. and Wu, D. 2008. A relief based feature extraction algorithm. In Proceedings of the SIAM International Conference on Data Mining. 188--195."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2008.70"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1162\/jocn.1991.3.1.71"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1137\/0713009"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.5555\/1046920.1088689"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2005.110"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2007.1089"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/1273496.1273639"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2499907.2499911","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2499907.2499911","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T07:34:00Z","timestamp":1750232040000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2499907.2499911"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,7]]},"references-count":42,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2013,7]]}},"alternative-id":["10.1145\/2499907.2499911"],"URL":"https:\/\/doi.org\/10.1145\/2499907.2499911","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,7]]},"assertion":[{"value":"2012-08-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-01-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-08-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}