{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,2]],"date-time":"2026-05-02T06:52:07Z","timestamp":1777704727248,"version":"3.51.4"},"reference-count":34,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2018,7,26]],"date-time":"2018-07-26T00:00:00Z","timestamp":1532563200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"published-print":{"date-parts":[[2019,2,16]]},"abstract":"<jats:p>Feature extraction is an important preprocessing step in many research areas. For anomaly detection, the purpose of feature extraction lies in not only extracting the most important features hidden in the datasets, but also discriminating different classes of samples. The latter is usually referred to as discriminative ability. The data collected from production systems usually do not follow Gaussian distribution. They may correspond to nonlinear mixture of independent components. In order to cope with non-Gaussian data and implement nonlinear feature extraction, this article proposes a feature extraction algorithm based on Supervised Independent Component Analysis with Kernel (termed SKICA). SKICA first adopts Kernel Principle Component Analysis (KPCA) to whiten the datasets. Further, by virtue of the within-cluster scatter matrix derived from Linear Discriminate Analysis (LDA), SKICA extends Independent Component Analysis (ICA) to supervised situation by introducing within-cluster information into solving independent components. The latter improvement makes SKICA obtain the independent components more beneficial to separating different classes of samples. In order to quantitatively measure discriminative ability of the feature extraction algorithms involved in experiments, this article defines three kinds of average square distance. This article conducts experiments on artificial datasets, Cloud datasets, and KDD Cup datasets to evaluate the effectiveness of SKICA. The experimental results show that SKICA outperforms several popular supervised feature extraction algorithms, including LDA, LDA with kernel (KDA), and supervised ICA (SICA).<\/jats:p>","DOI":"10.3233\/jifs-17749","type":"journal-article","created":{"date-parts":[[2018,7,27]],"date-time":"2018-07-27T19:32:04Z","timestamp":1532719924000},"page":"761-773","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":23,"title":["SKICA: A feature extraction algorithm based on supervised ICA with kernel for anomaly detection"],"prefix":"10.1177","volume":"36","author":[{"given":"Gui Ping","family":"Wang","sequence":"first","affiliation":[{"name":"College of Information Science and Engineering, Chongqing Jiaotong University, Chongqing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jian Xi","family":"Yang","sequence":"additional","affiliation":[{"name":"College of Information Science and Engineering, Chongqing Jiaotong University, Chongqing, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2018,7,26]]},"reference":[{"key":"e_1_3_2_2_2","doi-asserted-by":"publisher","DOI":"10.1145\/1541880.1541882"},{"key":"e_1_3_2_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cose.2011.05.008"},{"key":"e_1_3_2_4_2","unstructured":"HyvarinenA. KarhunenJ. and OjaE. Independent Component Analysis John-Wiley & Sons Inc. Press 2001."},{"issue":"3","key":"e_1_3_2_5_2","doi-asserted-by":"crossref","first-page":"169","DOI":"10.1007\/s10462-011-9225-y","article-title":"A survey on feature extraction for pattern recognition","volume":"37","author":"Ding S.F.","year":"2012","unstructured":"DingS.F., ZhuH., JiaW.K. and SuC.Y., A survey on feature extraction for pattern recognition, Artificial Intelligence Review 37(3) (2012), 169\u2013180.","journal-title":"Artificial Intelligence Review"},{"key":"e_1_3_2_6_2","doi-asserted-by":"publisher","DOI":"10.1080\/14786440109462720"},{"key":"e_1_3_2_7_2","doi-asserted-by":"crossref","unstructured":"PechenizkiyM. PuuronenS. and TsymbalA. The Impact of Sample Reduction on PCA-based Feature Extraction for Supervised Learning SAC (2006) pp. 553\u2013558.","DOI":"10.1145\/1141277.1141406"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1469-1809.1936.tb02137.x"},{"issue":"4","key":"e_1_3_2_9_2","doi-asserted-by":"crossref","first-page":"29","DOI":"10.1002\/ecj.10430","article-title":"An improvement of incremental recursive fisher linear discriminant for online feature extraction","volume":"96","author":"Ohta R.","year":"2013","unstructured":"OhtaR. and OzawaS., An improvement of incremental recursive fisher linear discriminant for online feature extraction, Electronics and Communications in Japan 96(4) (2013), 29\u201340.","journal-title":"Electronics and Communications in Japan"},{"issue":"8","key":"e_1_3_2_10_2","doi-asserted-by":"crossref","first-page":"2132","DOI":"10.1016\/j.sigpro.2011.02.016","article-title":"Color image canonical correlation analysis for face feature extraction and recognition","volume":"91","author":"Jing X.Y.","year":"2011","unstructured":"JingX.Y., LiS., LanC. et al., Color image canonical correlation analysis for face feature extraction and recognition, Signal Processing 91(8) (2011), 2132\u20132140.","journal-title":"Signal Processing"},{"issue":"4","key":"e_1_3_2_11_2","doi-asserted-by":"crossref","first-page":"596","DOI":"10.1109\/TNNLS.2012.2183645","article-title":"Feature extraction with deep neural networks by a generalized discriminant analysis","volume":"23","author":"Stuhlsatz A.","year":"2012","unstructured":"StuhlsatzA., LippelJ. and ZielkeT., Feature extraction with deep neural networks by a generalized discriminant analysis, IEEE Transactions on Neural Networks and Learning Systems 23(4) (2012), 596\u2013608.","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"e_1_3_2_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2012.09.011"},{"issue":"1","key":"e_1_3_2_13_2","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1063\/1.36258","article-title":"Space or Time Adaptive Signal Processing by Neural Network Models","volume":"15","author":"Herault J.","year":"1986","unstructured":"HeraultJ. and JuttenC., Space or Time Adaptive Signal Processing by Neural Network Models, AIP Conference Proceedings 15(1) (on Neural Networks for Computing), (1986), pp. 206\u2013211.","journal-title":"AIP Conference Proceedings"},{"key":"e_1_3_2_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/0165-1684(94)90029-9"},{"issue":"2","key":"e_1_3_2_15_2","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1109\/TPDS.2009.52","article-title":"Toward automated anomaly identification in large-scale systems","volume":"21","author":"Lan Z.L.","year":"2010","unstructured":"LanZ.L., ZhengZ.M. and LiY.W., Toward automated anomaly identification in large-scale systems, IEEE Transactions on Parallel and Distributed Systems 21(2) (2010), 174\u2013187.","journal-title":"IEEE Transactions on Parallel and Distributed Systems"},{"key":"e_1_3_2_16_2","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/S0925-2312(02)00518-0","article-title":"Conditionally independent component analysis for supervised feature extraction","volume":"49","author":"Akaho S.","year":"2002","unstructured":"AkahoS., Conditionally independent component analysis for supervised feature extraction, Neurocomputing 49 (2002), 139\u2013150.","journal-title":"Neurocomputing"},{"issue":"6","key":"e_1_3_2_17_2","doi-asserted-by":"crossref","first-page":"1374","DOI":"10.1109\/TKDE.2003.1245279","article-title":"Feature extraction based on ICA for binary classification problems","volume":"15","author":"Kwak N.","year":"2003","unstructured":"KwakN. and ChoiC.-H., Feature extraction based on ICA for binary classification problems, IEEE Transactions on Knowledge and Data Engineering 15(6) (2003), 1374\u20131388.","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"issue":"2","key":"e_1_3_2_18_2","doi-asserted-by":"crossref","first-page":"542","DOI":"10.1002\/eej.20522","article-title":"Feature extraction by supervised independent component analysis based on category information","volume":"161","author":"Takabatake H.","year":"2007","unstructured":"TakabatakeH., KotaniM. and OzawaS., Feature extraction by supervised independent component analysis based on category information, Electrical Engineering in Japan 161(2) (2007), 542\u2013547.","journal-title":"Electrical Engineering in Japan"},{"key":"e_1_3_2_19_2","doi-asserted-by":"crossref","unstructured":"WangX.M. Supervised Manifold Learning and Kernel Independent Component Analysis Applied lo the Face Image Recognition In Proceedings of the 15th Conference on Intelligent Computation Technology and Automation 2012 pp. 600\u2013603.","DOI":"10.1109\/ICICTA.2012.156"},{"key":"e_1_3_2_20_2","doi-asserted-by":"crossref","unstructured":"YamazakiM. and FelsS. Local Image Descriptors Using Supervised Kernel ICA In Proceedings of 3rd Pacific Rim Symposium on Advances in Image and Video Technology 2009. pp. 94\u2013105.","DOI":"10.1007\/978-3-540-92957-4_9"},{"key":"e_1_3_2_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/TGRS.2014.2360943"},{"issue":"2","key":"e_1_3_2_22_2","first-page":"265","article-title":"Kernel ICA feature extraction for anomaly detection in hyperspectral imagery","volume":"21","author":"Zhao C.H.","year":"2012","unstructured":"ZhaoC.H., WangY.L. and MeiF., Kernel ICA feature extraction for anomaly detection in hyperspectral imagery, Chinese Journal of Electronics 21(2) (2012), 265\u2013269.","journal-title":"Chinese Journal of Electronics"},{"key":"e_1_3_2_23_2","doi-asserted-by":"crossref","first-page":"2596","DOI":"10.1016\/j.neucom.2007.11.036","article-title":"Dimensionality reduction based on ICA for regression problems","volume":"71","author":"Kwak N.","year":"2008","unstructured":"KwakN., KimC. and KimH., Dimensionality reduction based on ICA for regression problems, Neurocomputing 71, (2008). 2596\u20132603.","journal-title":"Neurocomputing"},{"issue":"5","key":"e_1_3_2_24_2","doi-asserted-by":"crossref","first-page":"1113","DOI":"10.1002\/cpe.3061","article-title":"A distributed approach to network anomaly detection based on independent component analysis","volume":"26","author":"Palmieri F.","year":"2014","unstructured":"PalmieriF., FioreU. and CastiglioneA., A distributed approach to network anomaly detection based on independent component analysis, Concurrency and Computation: Practice and Experience 26(5) (2014), 1113\u20131129.","journal-title":"Concurrency and Computation: Practice and Experience"},{"key":"e_1_3_2_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2002.804287"},{"issue":"10","key":"e_1_3_2_26_2","doi-asserted-by":"crossref","first-page":"1784","DOI":"10.1016\/j.patcog.2005.01.023","article-title":"Kernel ICA: An alternative formulation and its application to face recognition","volume":"38","author":"Yang J.","year":"2005","unstructured":"YangJ., GaoX.M., ZhangD. and YangJ.Y., Kernel ICA: An alternative formulation and its application to face recognition, Pattern Recognition 38(10) (2005), 1784\u20131787.","journal-title":"Pattern Recognition"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.1162\/089976698300017467"},{"key":"e_1_3_2_28_2","doi-asserted-by":"crossref","unstructured":"MikaS. RatschG. WestonJ. ScholkopfB. and K.MiillerR. Fisher Discriminant Analysis with Kernels In Proceedings of the 1999 IEEE Signal Processing Society Workshop Neural Networks for Signal Processing IX 1999. pp. 41\u201348.","DOI":"10.1109\/NNSP.1999.788121"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.7.1483"},{"key":"e_1_3_2_30_2","unstructured":"NarasimhamurthyA. and KunchevaL.I. A Framework for Generating Data to Simulate Changing Environments In Proceedings of the 25th IASTED International Multi-conference: Artificial intelligence and applications (A\/AP) 2007. pp. 384\u2013389."},{"key":"e_1_3_2_31_2","unstructured":"KunchevaL.I. Artificial Data Sets (2007) http:\/\/pages.bangor.ac.uk\/ mas00a\/activities\/artificial_data.htm."},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1007\/BF00994018"},{"key":"e_1_3_2_33_2","unstructured":"DengN.Y. TianY.J. and ZhangC.H. Support Vector Machines - Optimization based Theory Algorithms and Extensions CRC Press 2013."},{"key":"e_1_3_2_34_2","unstructured":"HettichS. and BayS.D. The UCI KDD Archive 1999 http:\/\/kdd.ics.uci.edu\/databases\/kddcup99\/kddcup99.html."},{"key":"e_1_3_2_35_2","first-page":"12","article-title":"Evaluating Intrusion Detection Systems: The DARPA Off-line Intrusion Detection Evaluation","author":"Lippmann R.P.","year":"2000","unstructured":"LippmannR.P., FriedD.J., GrafI. et al., Evaluating Intrusion Detection Systems: The DARPA Off-line Intrusion Detection Evaluation, Proceedings of DARPA Information Survivability Conference and Exposition, 2000, pp. 12\u201326.","journal-title":"Proceedings of DARPA Information Survivability Conference and Exposition"}],"container-title":["Journal of Intelligent &amp; Fuzzy Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-17749","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.3233\/JIFS-17749","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.3233\/JIFS-17749","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T09:41:52Z","timestamp":1777455712000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.3233\/JIFS-17749"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,7,26]]},"references-count":34,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2019,2,16]]}},"alternative-id":["10.3233\/JIFS-17749"],"URL":"https:\/\/doi.org\/10.3233\/jifs-17749","relation":{},"ISSN":["1064-1246","1875-8967"],"issn-type":[{"value":"1064-1246","type":"print"},{"value":"1875-8967","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,7,26]]}}}